Duration
2 days
Overview
This course covers everything needed to take off for a journey to Hadoop. The course covers topics like:
- Core: HDFS, YARN
- Processing: Mapreduce, Spark, Pig
- SQL Engines: Hive, Impala, Spark SQL
- Workflow: Oozie
- Web UI: Hue
- NoSQL: Hbase
Intended Audience
The intended audience of the course is:
- Data Engineers
- Integration Engineers
- Architects
- Data Steward
- Developers
- Administrators
Prerequisites and Lab details
The intended audience should have a basic background on:
- Software Development
The lab setup for this course would be:
- Windows 7 or Higher
- 16 GB RAM
- VMWare Player
Course Objectives
- Big Data, Hadoop
- Use Cases of Hadoop
- Core: HDFS and YARN
- Extraction Tools {E}: Sqoop, Flume, Kafka
- Transformation Tools {T}: Mapreduce, Pig and Spark
- SQL {L}: Hive, Impala, Spark SQL
- Workflow: Oozie
- Real time: Spark Streaming
- Machine Learning: Spark ML
- Web UI: HUE
- Administration: Cloudera Manager
Labs
- Ingesting Data into HDFS using hdfs shell
- Ingesting Data into HDFS using Sqoop
- Running a Mapreduce Job
- Running a Spark Job
- Running a Pig Job
- Using Hive
- Using Impala
- Using Spark SQL
- Using Kafka with Spark Streaming
- Using Oozie
Programme scope, delivery arrangements and suitability are confirmed during enquiry.