Propagating Changes with Delta Change Data Feed

Summary

Learn how to easily propagate inserts, deletes, and updates in the Lakehouse using Delta Change Data Feed.

Description

A Delta change data feed represents row-level changes between versions of a Delta table. When enabled on a Delta table, the runtime records “change events” for all the data written into the table. This includes the row data along with metadata indicating whether the specified row was inserted, deleted, or updated. In this course, we'll examine some of the motivations and use cases for this feature and see it in action.

Learning objectives

  • Describe how Delta Change Data Feed emits change data records.

  • Use appropriate syntax and settings to set up Change Data Feed.

  • Propagate inserts, updates, and deletes with Change Data Feed.

Prerequisites

  • Basic knowledge of Spark Structured Streaming APIs

  • Basic knowledge of Delta Lake

Learning path

  • This course is part of the Data Engineering learning path.

Proof of completion

  • Upon 80% completion of this course, you will receive a proof of completion. 

 

Part of Learning Pathway(s)