What's New In Spark 3.0

Summary

Learn about major improvements to Apache Spark™ in the 3.0 release.

Description

This course was created to teach Databricks users about some of the major improvements to Spark in the 3.0 release. It will give an overview of new features meant to improve performance and usability, as well as highlight new tools and developments within the Spark ecosystem. Students will also learn about backwards compatibility with 2.x and some of the considerations required for updating to Spark 3.0. Note: This course will not cover all improvements or necessary compatibility considerations.

Learning objectives

  • Identify major improvements to performance in Spark 3.0.

  • Identify major usability improvements in Spark 3.0.

  • Summarize developments and contributions to the Spark ecosystem.

  • Recognize relevant compatibility considerations for migrating to Spark 3.0.

Prerequisites

  • Beginning level of knowledge of Spark 2.x.

Learning path

  • This course is part of the SQL Analyst, Data Engineer, and Data Scientist learning paths.

Proof of completion

  • Upon 80% completion of this course, you will receive a proof of completion.