EIEIOTECHNOVATION
← Training programmes

EIEIO / DATA SCIENCE

Big Data Platform Training

Course outline

3 days
Discuss this programme →

Duration

3 days

Overview

Big Data Platform Training Program is a one-stop course that introduces you to the domain of hadoop development as well as gives you technical knowhow of the same. At the end of this course you will be able to earn a credential of hadoop professional and you will be capable of dealing with Terabyte scale of data and analyze it successfully using mapreduce.

Audience Profile

For: Typically professionals with basic knowledge of software development, programming languages, and databases will find this course really helpful. Basic knowledge should be enough to succeed at this course

Not For: Students who are absolute beginners at software development as a discipline will find it difficult to follow the course.

Day 1 - Phase 1: Hadoop Fundamentals

Big Data

  • - What is Big Data
  • - Dimensions of Big Data
  • - Big Data in Advertising
  • - Big Data in Banking
  • - Big Data in Telecom
  • - Big Data in eCommerce
  • - Big Data in Healthcare
  • - Big Data in Defense
  • - Processing options of Big Data
  • - Hadoop as an option

Hadoop

  • - What is Hadoop
  • - How Hadoop Works
  • - HDFS
  • - Mapreduce Deep Dive
  • - How Hadoop has an edge

Hadoop Ecosystem

  • - Sqoop
  • - Oozie
  • - Pig
  • - Hive
  • - Flume

Hadoop Hands On

  • - Running HDFS commands
  • - Running your Mapreduce program
  • - Running Sqoop Import and Sqoop Export
  • - Creating Hive tables directly from Sqoop
  • - Creating Hive tables
  • - Querying Hive tables
  • - Running an Oozie workflow

Day 2 - Phase 2: Hadoop Development

Apache Spark

  • - What is Spark?
  • - Using Spark Shell
  • - RDD Fundamentals
  • - Functional Programming

Program

RDD in Depth

  • - RDDs
  • - Creating RDDs from files
  • - Creating RDDs for another RDDs
  • - RDD operations
  • - Actions
  • - Transformations
  • - Pair RDDs
  • - Joins using RDD

Spark platforms

  • - Spark local mode
  • - Spark standalone mode
  • - Spark on YARN
  • - Spark on Mesos

Spark Hands On

  • - Python Spark Shell
  • - Scala Spark Shell
  • - Basic operations on RDDs
  • - Pair RDD Hands On

Spark SQL & Dataframes

  • - Spark SQL and the SQL Context
  • - Creating Dataframes
  • - Dataframe Queries and Transformations
  • - Saving Dataframes
  • - Dataframes and RDDs

Spark Dataframes Hands On

  • - Dataframes on a JSON file
  • - Dataframes on hive tables
  • - Dataframes on JSON
  • - Querying operations dataframes

Spark SQL & Dataframes

  • - What is Spark Streaming
  • - How it works
  • - DStreams
  • - Developing Spark Streaming Applications

Day 3- Phase 3: Hadoop BI

Hive

  • - Introduction
  • - Basic Data Analysis with Hive
  • - Hive Data Management
  • - Text Processing with Hive
  • - Transformations in Hive
  • - Optimizing Hive
  • - Hive Hands On
  • - Extending Hive

Impala

  • - Introduction
  • - Basic Data Analysis with Impala
  • - Text Processing with Impala
  • - Optimizing Impala
  • - Impala Hands On

Pig

  • - Introduction
  • - How Pig works
  • - Pig Hands On

Programme scope, delivery arrangements and suitability are confirmed during enquiry.