EIEIOTECHNOVATION
← Training programmes

EIEIO / DATA SCIENCE

Snowflake- Cloud Data Warehouse

Course outline

5 days

Duration

5 days

Session 1

Introduction to Snowflake

  • Snowflake Architecture
  • The Data Lifecycle

o Organizing and Storing Data

o Querying and Working with Data

  • Continuous Data Protection

Session 3

Building Blocks of Snowflake

  • Virtual Warehouses

o Sizes and Clusters

  • Databases, Schemas, Tables & Views

o Create objects using SQL and Web Interface

  • Stages, File format & Sequences

o Type of Stages

o File Formats and Sequences

  • Loading Data using Web Interface (Limited)

Hands On:

Create objects in Web UI and using SQL Multi-cluster Warehouse Database, Schema and Tables File Format & Stage

Load data using Web UI

Pre-requisites: Experience of SQL / database. Knowledge on data warehouse concepts

Note: Except the first 2, all sessions include demo and hands-on.

The duration for each topic is only a rough estimation.

Hands-on and reference materials provided as PDF.

Session 4

Loading / Unloading Data into/from Snowflake

  • Loading from external stages AWS & Azure

o Settings on Cloud Storage Services

o Methods of accessing the stage

  • Unloading from Snowflake databases to external stages

o Unloading Considerations

o Target Locations

Hands On:

Load data from external stage Unload data into an external stage

Session 5

Working with Semi-structured Data

  • Traversing Data
  • Querying Semi-structured Data
  • Functions for Parsing
  • Load into separate columns

Hands On:

Load semi-structured data Querying semi-structured data Using parse functions

Session 6

Querying Data in Staged Files

  • Query Syntax
  • Required Parameters

Using transformation methods

  • Subset of Table Data
  • Reorder of Columns
  • Convert Data Types

Hands On:

Load data with transformations Querying stage files

Session 7

Snowflake Special Features

  • External Tables

o External Table Columns

o Automatic Refreshing of Metadata

  • Materialized Views

o Comparison with Regular Views

o Limitations

o Securing Views

Hands On:

Create Storage Integration Create External tables Querying external tables Create materialized views

Session 8

SnowSQL – Command Line Interface

  • “Putting” files into internal stages
  • “Getting” data into a local system
  • SnowSQL commands

Temporary Objects

  • Temporary Tables and Stages
  • Transient Tables

Hands On:

Exploring SnowSQL

Loading / Unloading Data with Internal Stages Working with Temporary Objects

Session 9

Access Control

  • Built-in Roles
  • Creating Users
  • Assigning Roles
  • Restricting access for users

Hands On:

Create users and roles Working with permissions

Session 10

Data History and Multi-Environment

  • Time Travel & Fail-safe

o SQL Extensions

o Data Retention Period

o Access Control Requirements

  • Cloning

o Cloning Rules

o Impact of DDL

Hands On:

Using Time travel options

Setting parameters Cloning objects

Session 11

Automatic Continuous Load

  • Loading Continuously Using Snowpipe

o Using Notification Service in AWS

o Create Queuing in Snowflake

o Triggering external stage for loading

Hands On:

Automate Data Loading using Snowpipe Snowpipe REST API with Python

Session 12

Streams and Tasks

  • Table Versioning
  • Stream Columns
  • Task Scheduling
  • Tree of Tasks
  • Change Data Capture

Hands On:

Creating Table Streams Combining with Tasks

Handling CDC

Session 13

User Scripts

  • Stored Procedures

o JavaScript

o Using SQL statements

  • User Defined Functions

o Scalar Functions

o Table Functions

Hands On:

Creating Stored Procedures Using Table Functions

Section 14

Query Performance

  • Query Profile
  • Data Clustering
  • Managing the Cache
  • Load Monitoring Chart
  • Table & Warehouse Design Considerations
  • Data Load Planning

Hands On:

Understanding Query Profile Performance Tuning with clustering

Session 15

Sharing Data in Snowflake

  • Data Providers and Consumers
  • Using Secure Objects to Control Data Access
  • Managing Reader Accounts

Snowflake Data Marketplace

  • What is Data Marketplace
  • Types of Data Listings
  • Data Providers and Consumers
  • Data Exchange – Overview

Hands On:

Secure data sharing Reader account creation

Session 16

Managing Your Snowflake Account

  • Understanding Snowflake Credit and Storage Usage
  • Resource Monitors
  • Monitoring Account-level Credit and Storage Usage
  • Summary of Security Features

o Multi-Factor Authentication

o Data Encryption

o Other Authentication Methods

Hands On:

Resource Monitoring Estimating the cost Additional security features

Programme scope, delivery arrangements and suitability are confirmed during enquiry.