Duration

Python for ETL

2 days

Overview

Extract, Transform, Load (ETL) is a process to process various data sources to be targeted data sources. ETL is one of required skill in data science to implement pre-processing and/or post-processing. This workshop is designed for anyone who wants to improve ETL skills.

Chapter 1: Overview

Introduction to ETL

Chapter 2: Setup

Python packages
Package installation

Chapter 3: Extract

Basic I/O Files and Directories
Extract data from PostgreSQL Database
Extract data from SqlServer Database
Extract data from Azure CosmoDB
Extract data from CSV File
Extract data from JSON File
Reading Files from HTTP Website

Chapter 4: Transform

Data Type Conversion
Data Manipulation using Expressions
Joins
Union
Filter
Sort
Transform CSV to JSON
Transform JSON to CSV

Chapter 5: Load

Load from Database to File
Load from Oracle to PostgreSQL Database
Load from PostgreSQL to SQLServer Database
Load Files into Azure Cloud Storage

Programme scope, delivery arrangements and suitability are confirmed during enquiry.