Big Data Analyst -using Sqoop and Advance Hive (CCA159)

Udemy Certificate USD 19.99
Enroll now →
Big Data Analyst -using Sqoop and Advance Hive (CCA159)

About this course

You will start by learning what is Hadoop &  Hadoop distributed file system and most common hadoop commands required to work with Hadoop File systemThen you will be introduced to Sqoop Import Understand lifecycle of sqoop command.Use sqoop import command to migrate data from Mysql to HDFS.Use sqoop import command to migrate data from Mysql to Hive.Use various file formats, compressions, file delimeter,where clause and queries while importing the data.Understand split-by and boundary queries.Use incremental mode to migrate the data from Mysql to HDFS.Further, you will learn Sqoop Export to migrate data.What is sqoop exportUsing sqoop export, migrate data from HDFS to Mysql.Using sqoop export, migrate data from Hive to Mysql.Finally, we will start with Apache Hive [Advance]Hive IntroExternal & Managed TablesInsert & Multi InsertData Types & Complex Data TypesCollection FunctionConditional FunctionHive String FunctionsHive Date FunctionsMathematical FunctionHive AnalysisAlter CommandJoins, Multi Joins & Map JoinsWorking with Different Files - Parquet,AvroCompressionsPartitioningBucketingViewsLateral Views/ExplodeWindowing Functions - Rank/Dense Rank/lead/lag/min/maxWindow Specification

What you'll learn

  • Understand Hadoop and its distributed file system
  • Use Sqoop for data migration from MySQL to HDFS and Hive
  • Master Sqoop export commands to transfer data back to MySQL
  • Work with advanced features in Hive, including complex data types and functions

Course objectives

  • Gain proficiency in using Hadoop for big data applications
  • Learn how to import and export data using Sqoop
  • Understand various Hive functionalities for efficient data processing

Skills you'll gain

Related courses

Course details are provided by the platform and may change — always confirm on the provider's site. Links may be affiliate links.