Introduction to Multi-Task Jobs

Summary

Learn how multi-task jobs provide a lightweight way to orchestrate tasks.

Description

After a recap of single-task jobs, as well the directed acyclic graph (DAG) model, you will learn how to create, trigger or schedule Multi-Task jobs in Databricks.

Learning objectives

  • Explain what Multi-Task Jobs are.

  • Describe how Multi-Task Jobs fits into the Databricks ecosystem.

  • Articulate how to use Multi-Task Jobs for appropriate use cases.

  • Demonstrate how to use Multi-Task Jobs.

Prerequisites

  • Experience working with the Databricks Workspace

Learning path

  • This course is part of the data engineering learning path.

Proof of completion

  • Upon 80% completion of this course, you will receive a proof of completion.