This course is for those who want to become data engineers or analysts. It covers the key skills needed to manage, process, and analyze large datasets using common industry tools. You will learn how to import data into Hadoop HDFS, Hive tables, and use Spark for direct HDFS imports. The course also covers handling streaming data with Apache Flume and connecting relational databases to Hadoop with Apache Sqoop. You will use Apache Zeppelin for developing Spark applications and learn how to install, monitor, and manage Hadoop clusters with Ambari. The course also introduces advanced HDFS features for data management. By the end, you will be able to use Hadoop and Spark in practical settings.
What you'll learn
import data into Hadoop HDFS
work with Hive tables
perform direct HDFS imports using Spark
handle streaming data with Apache Flume
connect relational databases to Hadoop using Sqoop
develop Spark applications with Apache Zeppelin
install and manage Hadoop clusters with Ambari
utilize advanced HDFS features for data management