This short course introduces you to the fundamentals of Data Engineering and Machine Learning with Apache Spark, including Spark Structured Streaming, ETL for Machine Learning (ML) Pipelines, and Spark ML. By the end of the course, you will have hands-on experience applying Spark skills to ETL and ML workflows.
What you'll learn
understand the fundamentals of Data Engineering
gain hands-on experience with Spark ML
apply Spark skills to ETL and ML workflows
work with Spark Structured Streaming in real-time data processing
Course objectives
provide practical skills in using Apache Spark
enable students to integrate ETL processes with Machine Learning
enhance understanding of streaming data processing