Duration
5 days
Overview
This course covers everything needed to take off for a journey to Hadoop. The course covers topics like:
Core: HDFS, YARN
- Processing: Mapreduce, Spark, Pig
- SQL Engines: Hive, Impala, Spark SQL
- Search: Cloudera Search
- Workflow: Oozie
- Web UI: Hue
- NoSQL: Hbase
Intended Audience
The intended audience of the course is:
- Data Engineers
- Integration Engineers
- Architects
- Data Steward
- Developers
- Administrators
Prerequisite and Lab details
The intended audience should have a basic background on:
- Software Development
The lab setup for this course would be:
- Windows 7 or Higher
- 16 GB RAM
- VMWare Player
Course Outline
Hadoop Landscape (Day1)
Course Objectives
- Big Data, Hadoop
- Use Cases of Hadoop
- Core: HDFS and YARN
- Extraction Tools {E}: Sqoop, Flume, Kafka
- Transformation Tools {T}: Mapreduce, Pig and Spark
- SQL {L}: Hive, Impala, Spark SQL
Labs
- Ingesting Data into HDFS using hdfs shell
- Ingesting Data into HDFS using Sqoop
- Running a Mapreduce Job
- Running a Spark Job
- Running a Pig Job
- Using Hive
- Using Impala
Hadoop Landscape (Day2)
Course Objectives
- Workflow: Oozie
- Real time: Spark Streaming
- Machine Learning: Spark ML
- Web UI: HUE
- Administration: Cloudera Manager
- Introduction to Search
- Motivation for Search
- Cloudera Search in Real world
Labs
- Using Spark SQL
- Using Kafka with Spark Streaming
- Using Oozie
Cloudera Search (Day3)
Course Objectives
- Cloudera Search Architecture
- Key Components of Cloudera Search
- How Queries work on Cloudera Search
- Basic Querying
- Advanced Querying Using Filters
- Query Parsing
- Geospatial Search
- Faceting
Labs
- Getting around Cloudera Search
- Executing Basic Search
- Executing Advanced Search
Cloudera Search (Day4)
Course Objectives
- Pre Indexing
- How Indexing Works
- Configuration File Generation
- Schema Design
- Using Morphlines for ETL
- Using MapReduce for Indexing
- How Indexing on HDFS Works
- Using Mapreduce for Indexing
- Validation and Diagnosing Issues
- Near Real Time Indexing Using Flume
- Introduction to Flume
- How to Index
- Validation and Diagnosing Issues
- Hbase Indexing
- Introduction to Hbase
- How to Index
- Validation and Diagnosing Issues
Labs
- Preparing for Indexing
- Indexing using Mapreduce
- Indexing Using Flume
- Indexing Using Hbase
Cloudera Search (Day 5)
Course Objectives
- Field Types
- Analyzer Chains
- Word Stemming
- Introduction to Apache Tika
- Improving relevancy of results
- Query Performance Tuning
- Building Search UI
- Integrating Search with other applications
- Deploying Search in real world
Labs
- Improving relevancy
- Building search UI
Programme scope, delivery arrangements and suitability are confirmed during enquiry.