EIEIOTECHNOVATION
← Training programmes

EIEIO / AUTOMATION & EMERGING TECHNOLOGY

Snowflake

Course outline

Duration to discuss

Topics

Details

DAY - 1

Introduction to Cloud Data

Cloud Concepts

An overview of Data Warehousing & Cloud

OLTP vs OLAP

Warehousing

Need of the hour - Cloud Data Warehouse

Computing

Advantages of DW

Snowflake - Introduction

ETL and Staging

Snowflake Account Creation

Dimensional and Tabular Modelling

Advantages of Cloud Computing

Types of Cloud Services

The Pillars of Snowflake

Shared Disk and Shared-Nothing Architectures

Multi-cluster, Shared Data Architecture

Columnar & Micro-partition storage

Account Information

Supported Cloud Partners

Snowflake Editions

Geographical Locations

Three 'linked' independent layers

Storage Layer

Compute Layer

Cloud Service Layer

Snowflake - Fundamentals

Understanding Snowflake Accounts

Connecting to Snowflake

Web User Interface

Multiple way to connect with Snowflake

Using Snowsight

How Standard and Extended SQL Support used to manage data

Understanding Sessions

Virtual Warehouse

T-Shirt Sizes

Warehouse Clusters

Suspend & Resume

Local Cache

Credits

Object Catalogue

Base Objects of Snowflake Properties of each objects

Database Objects

Database, Schema & Tables Views

File Formats

Session Title

Topics

Details

DAY - 2

Loading Data from External Stages & Local system (Limited)

Internal and External Stages

Type of internal stages

External stage locations Accessing stage objects

Bulk Loading

Preparing Data for loading

Putting data into stages from local systems Load data from stages

Managing regular data load

Querying Stages

Query syntax and Parameters Supported Functions

Usage of File Formats

External Data Management & Data Dictionary

Apply Transformations while loading data from stages Concepts behind External Tables

Information Schema Usage

Transforming data while loading

Supported Stages and File formats CSV data transformations Transforming Semi-structured data

Supported Functions

External Tables

Schema on Read Virtual Columns

Refreshing external table metadata

External Table DDL

Information_Schema

ANSI Standard Views

Table Functions for Query History Load History Functions

Object Information

Session Title

Topics

Details

DAY - 3

Semi-structured Data. Transitory Data Management

Loading Semi-structured data into standard tables Transforming and Querying Semi-structured data

Working with Semi-structured data

Basic understanding of Semi-structured data Supported file formats

Supported Data Types

Transforming and Querying Semi- structured data

Flattening semi-structure data using SELECT to VIEW or load into relational tables

Semi-structured Data Functions

Temporary Stages & Tables

Using a temporary stage Temporary table usages Transient tables

Comparison of Table types

Change Data Capture Handling & Scheduling of Queries.

Unloading Data into stages

Change Data Capture Handling Scheduling of Queries

Unloading Data from Snowflake into Cloud and Local Storages

Table Streams

Table Versioning Repetable Read Isolation

Stream Types & Columns in Stream

Data Flow

Tasks

Task Scheduling Choosing a Warehouse Tree of Tasks

Task History

Data Unloading

Using COPY command to unload data into stages Options for unloading data

Getting data into local system from stages

Session Title

Topics

Details

DAY - 4

Continous Data Protection & Security Management

Snowflake way of Historical Data Maintenance Concepts and Consideration of Object Cloning Continous Data Loading

Time Travel

How Time Travel works Data Retention period

SQL Extensions for Time Travel

Zero Copy Cloning

How cloning is different from copying Access Control privileges for cloned objects Clonable Objects

Impact of DDL and DML

Cloning of Historical Objects

Configure Snowpipe

Using Cloud Messaging Services

Creating a Storage Integration (Optional)

File Size, Order of loading and data duplication Snowpipe DDL

Error Notification

Re-usable code & CLI

Working with Stored Procedures Creating functions to meet the needs Command Line Tool

Stored Procedures

Benefits of Stored Procedures Snowflake Scripting

Creating and Calling Procedures

Supported languages in Stored Procedures

User Defined Functions

UDF - Overview

Benefits of Table functions SQL Functions

Creating functions using other languages

SnowSQL

Configuring the SnowSQL SnowSQL Exlamatory Commands PUT and GET commands

VALIDATE - table function

Session Title

Topics

Details

DAY - 5

Query and Cache Management

Working with Query History and Logs Understanding Cache management in Snowflake

Query Profile

Query History Job Statistics Query Pruning

Disk Spilling

Information_Schema

ANSI Standard Views

Table Functions for Query History Load History Functions

Object Information

Cache Management

Result Cache Local Disk Cache

Managing the Result Cache

How Snowflake utilizes the Metadata Cache

Performance Considerations

Controlling the order of data stored in micro-partitions Query Performance Tuning Methods

Materialized Views Advantages

Design Considerations of Table & Warehouse

Data Clustering

Impact of Micro-partitions Clustering Keys

Clustering Depth

Re-clustering

Search Optimization

Search Optimization Work Flow Required Privielges

Benefitable tables

Cost of Search Optimization

Materialized Views

Advantages of Materialized View Limitations on Materialized View

Clustering a Materialized View

Best Practices

Suspending the Warehouse Scale out options settings Data Type for columns

Column length specification

Programme scope, delivery arrangements and suitability are confirmed during enquiry.