Building ETL Workflow in snowflake is not an easy task and if you have to build end to end ETL workflow (or ETL workflow) we need to use pipe, stream and task components along with external stages and orchestrate all the activities. This episode is a comprehensive 60min practical guide with hands-on exercise to demonstrate you how it works.
This guide will help you to answer the following questions
1. How to build ETL workflow pipeline in snowflake?
2. CDC & Incremental load via Snowflake?
3. Delta Data Load via SnowPipe?
4. Data Transformation via Stream & Task?
5. Task & Task Tree with Stream?
🚀🚀 CHEAT SHEET - Snowflake End To End Guide - [ Ссылка ] 🚀🚀
➥ Site: [ Ссылка ]
➥ Snowflake End To End Guide Cheat Sheet - [ Ссылка ]
➥ SQL Scripts [ Ссылка ]
🚀 🚀 Chapters 🚀 🚀
-----------------------------------------
➥ 00:00 ETL in Snowflake?
➥ 01:46 Episode-19 Introduction
➥ 02:20 Customer Order Use Case for Snowflake.
➥ 07:37 How many objects are needed for this ETL
➥ 07:40 Why to subscribe to this channel
➥ 10:35 Lets practice it together
➥ 10:52 Handson Part-1: Creating Landing Layer DDLs
➥ 16:43 Handson Part-2: Creating Curated Layer DDLs
➥ 20:40 Handson Part-3: Creating Consumption Layer DDLs
➥ 25:43 Handson Part-4: Stages & Pipes for Landing Layers
➥ 30:53 Handson Part-5: Stream & Tasks for Landing Layers
➥ 38:27 Handson Part-6: Stream & Tasks for Curated Layers
➥ 45:45 Handson Part-7: Data Loading via WebUI (Delta Load)
➥ 54:03 Handson Part-8: Delta Load via S3 Bucket
🚀 🚀 Snowflake Tutotorials (Beginners) All Episodes 🚀🚀
---------------------------------------------------------------------------------------------------
➥ Chapter 1-to-25 "Complete Playlist" 🌐 [ Ссылка ]
➥ Chapter-1 Snowflake Introduction & History 🌐 [ Ссылка ]
➥ Chapter-2 Snowflake Free Trial Registration 🌐 [ Ссылка ]
➥ Chapter-3 Snowflake Architecture 🌐 [ Ссылка ]
➥ Chapter-4 Snowflake Classic or Legacy WebUI 🌐 [ Ссылка ]
➥ Chapter-5 Snowflake SnowSight Modern WebUI 🌐 [ Ссылка ]
➥ Chapter-6 Snowflake Unique Features 🌐 [ Ссылка ]
➥ Chapter-7 Snowflake DB/Schema/Table & Data Loading 🌐 [ Ссылка ]
➥ Chapter-8 Snowflake Must Know Database Objects 🌐 [ Ссылка ]
➥ Chapter-9 Snowflake Fast Data Loading/Ingestion 🌐 [ Ссылка ]
➥ Chapter-10 Snowflake Continuous Data Loading 🌐 [ Ссылка ]
➥ Chapter-11 Snowflake External Table 🌐 [ Ссылка ]
➥ Chapter-12 Snowflake Virtual Warehouse 🌐 [ Ссылка ]
➥ Chapter-13 Snowflake Micro Partition 🌐 [ Ссылка ]
➥ Chapter-14 Snowflake Time Travel 🌐 [ Ссылка ]
➥ Chapter-15 Snowflake Clone Feature 🌐 [ Ссылка ]
➥ Chapter-16 Snowflake Secure Data Sharing 🌐 [ Ссылка ]
➥ Chapter-17 Snowflake Streams & Change Data Capture 🌐 [ Ссылка ]
➥ Chapter-18 Snowflake Task & Task Tree 🌐 [ Ссылка ]
➥ Chapter-19 ETL (Data Pipeline) in Snowflake 🌐 [ Ссылка ]
➥ Chapter-20 Role, Grants & Role Hierarchy in Snowflake 🌐 [ Ссылка ]
➥ Chapter-21 (Part-1) Stored Procedure in Snowflake 🌐 [ Ссылка ]
➥ Chapter-21 (Part-2) User Defined Function in Snowflake 🌐[ Ссылка ]
➥ Chapter-21 (Part-3) Snowflake Views (Standard, Secure & Materialized) 🌐 [ Ссылка ]
➥ Chapter-22 Snowflake Information Schema 🌐 [ Ссылка ]
➥ Chapter-23 Snowflake Resource Monitor 🌐 [ Ссылка ]
➥ Chapter-24 (Part-1) Snowflake JDBC Driver 🌐 [ Ссылка ]
➥ Chapter-24 (Part-2) Snowflake ODBC Driver 🌐 [ Ссылка ]
➥ Chapter-24 (Part-3) Snowflake Python Connector 🌐 [ Ссылка ]
➥ Chapter-25 (Part-1) Snowflake & PowerBI Reporting 🌐 coming-soon
➥ Chapter-25 (Part-2) Snowflake & Tableau Reporting 🌐 coming-soon
🚀 🚀 Snowflake Certification Complete Guide & Question Dump 🚀 🚀
-----------------------------------------------------------------------------------------------------------------
➥ Revised Sep 2020 Syllabus: [ Ссылка ]
➥ SnowPro Guide: [ Ссылка ]
➥ SnowPro Practice Test (60 Questions): [ Ссылка ]
#ETLSnowflake #ELTSnowflake #snowflakecomputing #securedatasharing #deltaloadsnowflake #continousdataload #incrementalload #etlpipeline
Disclaimer: All snowflake-related learning materials and tutorial videos published in this channel are the personal opinions of the data engineering simplified team and they're neither authorized by nor associated with Snowflake, Inc.
Ещё видео!