Advanced Spark for Data Science and Data Engineering - University of California

Gain a deeper understanding of Spark by learning about its APIs, architecture, and common use cases. This statistics and data analysis course will cover material relevant to both data engineers and data scientists. You’ll learn how Spark efficiently transfers data across the network via its shuffle, details of memory management, optimizations to reduce compute costs, and more. Learners will see several use cases for Spark and will work to solve a variety of real-world problems using public datasets. After taking this course, you should have a thorough understanding of how Spark works and how you can best utilize its APIs to write efficient, scalable code. You’ll also learn about a wide variety of Spark’s APIs, including the APIs in Spark Streaming.