Ditulis pada: January 22, 2021
Udemy Coupon - Master Big Data - Apache Spark/Hadoop/Sqoop/Hive/Flume, In-depth course on Big Data - Apache Spark , Hadoop , Sqoop , Flume & Apache Hive, Big Data Cluster setup
- Created by Navdeep Kaur
- English [Auto]
What you'll learn
- Hadoop distributed File system and commands. Lifecycle of sqoop command. Sqoop import command to migrate data from Mysql to HDFS.
100% Off Udemy Coupon . Free Udemy Courses . Online Classes
In this course, you will start by learning what is hadoop distributed file system and most common hadoop commands required to work with Hadoop File system.
Then you will be introduced to Sqoop Import
Understand lifecycle of sqoop command.
Use sqoop import command to migrate data from Mysql to HDFS.
Use sqoop import command to migrate data from Mysql to Hive.
Use various file formats, compressions, file delimeter,where clause and queries while importing the data.
Understand split-by and boundary queries.
Use incremental mode to migrate the data from Mysql to HDFS.
Further, you will learn Sqoop Export to migrate data.
What is sqoop export
Using sqoop export, migrate data from HDFS to Mysql.
Using sqoop export, migrate data from Hive to Mysql.
Further, you will learn about Apache Flume
Understand Flume Architecture.
Using flume, Ingest data from Twitter and save to HDFS.
Using flume, Ingest data from netcat and save to HDFS.
Using flume, Ingest data from exec and show on console.
Describe flume interceptors and see examples of using interceptors.
Flume multiple agents
In the next section, we will learn about Apache Hive
External & Managed Tables
Working with Different Files - Parquet,Avro
Hive String Functions
Hive Date Functions
Finally You will learn about Apache Spark
Actions & Transformations
Transformation & Action Examples
Spark Data frames
Spark Data frames - working with diff File Formats & Compression
Spark with Cassandra Integration
Who this course is for:
Who want to learn big data in detail