Duration
Data Integration & ETL with Talend Open Studio
2 days
What you'll learn
- Connect your data sources, such as files, databases, XML, web services, Google Drive and more formats
- Build your own integration processes using practical examples and comprehensive scenarios
- Master the most important transformations like mappings, joins, aggregations and sorting
- Orchestrate processes into larger units by using preJobs, postJobs, variable and hierachies
Outline
Data Warehousing, Data Integration and ETL
- Introduction to Data Warehousing
- Data Integration
- ETL
Setup For The Course
- Intro
- Installation on Windows
- Language of Talend Open Studio
"Hello World" Example
- Intro
- "Hello world" in Talend
The User Interface (UI)
- Intro
- Important Parts of the UI
- Useful Helpers
- Install External Libraries
- Find Errors
- Where is my tab?
Your First ETL Job
- Intro
- Your first job
- Get Component Help
Process Files
- Intro
- Read Files
- Write Files
- List Folder Contents
- File Processing Scenario
Properties In Talend
- Intro
- Built-In vs. Repository
- Schema
- Data Types
- Connection Types
- Ctrl + Spacebar
- Properties in Talend Test
Processing Databases
- Intro
- Your database
- Connect to a Database
- Write to a Database
- Read from a Database
- Iterate over Database Contents
- Database Processing Scenario
- Show Table List Task
Process Cloud, REST, JSON, XML, etc.
- Intro
- Process JSON
- Process XML
- Google Drive
- Google Cloud Storage
- REST Services
- Download Files
- Read RSS feeds
- Data Sources Test
Variables
- Intro
- Create Context Variables
- Create Variables and Environments
- Data Types for Context Variables
- Central Context Groups
- Context Groups for Metadata
- Write and Load Context
- Implicit Context Load
- Global Variables
- Variables Test
- Load External Variables Task
Transformations
- Intro
- Filter Data
- Sort Data
- Aggregate Data
- Convert Data Types
- Split Data
- Normalization and De-Normalization
- Simple Joins
- Install Sakila
- Mapping with Join
- Defining the match model for an explicit Join in tMap
- Mapping with Filter
- Mapping with Transformation
- Field extraction: Intro
- Field Extraction: JSON
- Field Extraction: XML
- Field Extraction: Positional
- Field Extraction: Delimited
- Field Extraction: Regex
- Field Extraction: Outro
- Generate XML and JSON Fields
- Generate Sample Data
- Pivot Data
- Transformations Test
- Aggregate Sales Data Task
Data Quality
- Intro
- Remove Duplicates
- Interval Match
- Make Replacements
- Schema Checking
- Redundancy Key
- Fuzzy Matching
- Check Address Data Task
File Management
- Intro
- Basic Operations
- File Comparison
- File Properties
- File Lists
- File Compression
- Temporary Files
- Load Data with Temporary File Task
Job Orchestration
- Intro
- Pre-Job and Post-Job
- MessageBox
- Replicate and Unite
- Flow to Iteration and Iteration to Flow
- Loops
- Wait and Measure
- System Interaction
- Job Hierarchies
- Subjob Triggers
- Component Triggers
- Conditional Triggers
- Job Orchestration Test
- Pass Dynamic Values to Child Job Task
Logging
- Intro
- Debug Data
- Test Assertions
- Log Data Volumes
- Log Errors and Warnings
- Log Executions
- Logging Jobs
- Logging Jobs Better
- Logging Projects
- Logging Test
Best Practices & Documentation
- Intro
- Common Best Practices
- Create Documentation
Deployment
- Intro
- Create Job Executables
- Change Parameters for Executables
- Deployment With Variables Task
Project Handling
- Intro
- Create and Delete Projects
- Export and Import Items
- Filtering Projects and Components
- Project Settings
Use Cases
- Intro
- Write an Excel file
- Read a Multi-Schema XML
- Append to a Text File
- Sync Tables with Talend
- Read Vault Credentials
- Read Excel with header
Programme scope, delivery arrangements and suitability are confirmed during enquiry.