Duration
1 day
Course Introduction:
Big Data is one of the largest technological trends within many industries. Big Data allows us to store and process large amounts of data in a timely manner, which allowed business and organization to gain insights on their information and data. Big Data has been used by organisations worldwide to improve productivity, making better informed decision, developing market strategies, anomaly, and fraud detection, reducing costs and improve customer experience.
So how can we get started with Big Data?
What is the right direction and things to learn to dive into Big Data?
This workshop will prepare you for a glimpse of a real-world Data Engineer role!
- Get started with Big Data quickly leveraging free cloud cluster and solving a real-world use case.
- Learn Hadoop, Hive and Spark from scratch and practice on simple project to get started in Big Data to clean, transform, and analyse data guided by the instructor.
- Learn how to dive into Big Data fields and how to further grow your career with Big Data.
Target Audience:
- Anyone interested in Big Data in terms of Overview, Fundamental concepts, and want to know what Big Data is and how it works.
- Anyone interested to learn about Big Data or jumpstart their career in Big Data.
Prerequisite:
- Some experience with programming and SQL Queries will be good for the hands-on practices but not mandatory as the commands and syntax used will be explained.
- Some basic IT knowledge.
What you will learn:
- Overview of Big Data
- Big Data and Hadoop Fundamental Concepts
- Common technologies used in Big Data
- Relationships of Cloud, AI, Machine Learning and Data Science with Big Data
- How to create a free Hadoop and Spark cluster using Google Dataproc
- Hadoop hands-on - HDFS, Hive, Spark with simple project
- How to get started in Big Data and grow yourself in this field.
Workshop SYLLABUS
Module 1 - What is Big Data?
- Big Data Overview
- Characteristics of Big Data
- What are the 5 V’s of Big Data?
- The Impact of Big Data in the Industry
Module 2 - Big Data - Beyond the Horizon and Hype
- Application and Trends of Big Data
- Big Data Adoption and Practical Examples
- AI, Cloud, Data Science and Big Data Relationships
- Top Big Data Use Cases in the Industries
Module 3 - The Big Data Platforms and Tools
- Infrastructure of Big Data
- Using the Cloud for Big Data Analytics
- Common Big Data Framework and Tools
- Introduction to Hadoop
- Introduction to Spark
- Common Languages used in Big Data
Module 4 – Getting started with a Simple Big Data Project
- How to Setup the Lab Environment (Practice)
- How to use the HDFS?
- Storing a File in HDFS (Practice)
- Functions of MapReduce & YARN
- What is Hive?
- How to query data using Hive? (Practice)
- How to setup and run Spark?
- Basics of Python and Scala Languages
- Basic Data Transformation using Hadoop and Spark (Project)
Module 5 – Jumpstart Your Career with Big Data
- Where to get started?
- Learning and Training in Big Data
- How to practice with Big Data?
- Career Paths and Project Prospects
Duration: 1 day workshop
Class Size: 6 -12 pax (Personalized Guidance), >12 pax (General Guidance) during the hands-on practice.
Lab Practice Requirement: We will be using the Free Tier of Google Cloud Platform (GCP), so the trainees need at least a 1 Google Account. Lab Demo will be shown to the trainees, and they can practice based on the guide. Any trainees that are not interested in the Labs can just view the demo done by instructor or engage in discussions.
Programme scope, delivery arrangements and suitability are confirmed during enquiry.