EIEIOTECHNOVATION
← Training programmes

EIEIO / DATA SCIENCE

Pentaho Data Integration Fundaments

Course outline

3 days
Discuss this programme →

Duration

3 days

OVERVIEW

The volume, variety and velocity of data are increasing rapidly. Organizations need fast and easy-to-use tools to harness data for actionable insight. One of the biggest challenges facing organizations today is the requirement to provide a consistent, single version of the truth across all sources of information in an analytics-ready format. With powerful data extract, transform and load (ETL) capabilities, an intuitive and rich graphical design environment, and an open and standards-based architecture, Pentaho Data Integration is increasingly the choice over proprietary and home grown data integration tools. Pentaho Data Integration provides a full ETL solution, including:

  • Rich graphical designer to empower ETL developers
  • Broad connectivity to any type of data, including diverse and big data
  • Enterprise scalability and performance, including in-memory caching
  • Big data integration, analytics and reporting

Through this program and hands-on exercises, best practices, and design patterns, Pentaho Data Integration Fundamentals provides students the skills that they need to maximize the value of data to the organization.

PROGRAM OBJECTIVES

At the completion of this course, participant should be able to:

  • Create, preview, and run basic transformations containing steps and hops
  • View transformation results in the Step Metrics view and the Log view
  • Configure the Pentaho Enterprise Repository, including basic security
  • Use the Pentaho Enterprise Repository to create folders, store transformations and jobs, move, lock, revise, delete, and restore artifacts
  • Configure error handling for transformation steps
  • Create a database connection and use Database Explorer to interact with data
  • Table input, Table output, Text file output, CSV file input, Insert/Update, Add constants, Filter, Value Mapper, Stream lookup, Join rows, Merge join, Sort rows, JavaScript, Database Lookup, Set Environment Variables
  • How to use transformation steps to perform complex calculations on data stream
  • Transformations using parameterized values and environment variables
  • Use Pentaho Data Integration to cleanse and correct data
  • Load data from and write data to different data sources
  • Create Pentaho Data Integration jobs that: run multiple transformations, use variables, contain sub-jobs, provide built-in error notification, load and process multiple text files, and convert files into Microsoft Excel format
  • Configure logging for transformation steps and examine the logged data
  • Schedule and monitor the execution of a transformation in Pentaho Data Integration and in the Pentaho Enterprise Console

WHO SHOULD ATTEND

Students with prior database development or administration experience who are new to Pentaho Data Integration should take this course.

PREREQUISITE

There are no prerequisites for this course but some ETL experience is preferred.

COURSE OUTLINE

  • Pentaho Data Integration

Objectives

  • What is Pentaho Data Integration
  • Download and Install Pentaho software
  • Transformation Basics
  • The PDI User Interface
  • Transformations
  • Rows, Sequence, Select Values
  • Error Handling
  • Logging
  • Repositories
  • Reading & Writing Files
  • Input & Output Steps
  • Parameters
  • kettle.properties
  • CSV Input to Multiple Text Output Using Switch/Case
  • Serializing Multiple Text Files
  • De-serialize a File
  • Working with Databases
  • Connecting to Database
  • Exploring a Database
  • Table Input & Output
  • Reading from Database Tables
  • Writing to Database Tables
  • Insert, Update, & Delete Data
  • Data Cleansing
  • Using Parameters & Arguments in SQL
  • Input with Parameters & Table Copy Wizard
  • Data Flows & Lookups
  • Copying Data
  • Distributing Data
  • Parallel Processing
  • Lookups
  • Data Formatting
  • Merging Data
  • Calculations
  • Using the Group By Step
  • Calculator
  • Calculating & Aggregating Order Quantity
  • Regular Expression
  • User Defined Java Expression
  • JavaScript
  • Job Orchestration
  • Introduction to Jobs
  • Loading JVM Data into a Table
  • Sending Alerts
  • Looping
  • Conditions
  • Creating a Job with a Loop
  • Executing Jobs from a Terminal Window
  • Scheduling
  • Setting up the Scheduler
  • Monitoring Scheduled Tasks
  • Exploring Data Integration Repositories
  • Data Integration Repository
  • Enterprise Repository
  • Logging
  • Detailed Logging throughout Execution

Programme scope, delivery arrangements and suitability are confirmed during enquiry.