Канал: Amit Ranjan

Parquet File Format | Apache Spark

Parquet File Format | Apache Spark

Towards Mindfulness

Towards Mindfulness

Generative AI with LLM | Course Summary

Generative AI with LLM | Course Summary

Sort Merge Bucket (SMB): Explained | Hands-on with Joins | Scio | Part 2 of 2

Sort Merge Bucket (SMB): Explained | Hands-on with Joins | Scio | Part 2 of 2

Sort Merge Bucket (SMB): Explained | Hands-on with Aggregations | Scio | Part 1 of 2

Sort Merge Bucket (SMB): Explained | Hands-on with Aggregations | Scio | Part 1 of 2

Interplay of Data Mesh Principles

Interplay of Data Mesh Principles

Principles of Data Mesh

Principles of Data Mesh

What is Data Mesh

What is Data Mesh

Drivers for Data Mesh

Drivers for Data Mesh

Evolution of Data Architecture | Data Mesh

Evolution of Data Architecture | Data Mesh

"No More Mr Nice Guy" | Robert A Glover | Key Points | Part 2 of 3

"No More Mr Nice Guy" | Robert A Glover | Key Points | Part 2 of 3

"No More Mr Nice Guy" | Robert A Glover | Key Points | Part 1 of 3

"No More Mr Nice Guy" | Robert A Glover | Key Points | Part 1 of 3

Procrastination | What I have learnt

Procrastination | What I have learnt

A few things every Data Engineer should know

A few things every Data Engineer should know

Handling Skewed Data | Tips on running Spark in Production | Course on Apache Spark Core | Lesson 25

Handling Skewed Data | Tips on running Spark in Production | Course on Apache Spark Core | Lesson 25

Deciding the right size for executor | Spark in Production | Course on Apache Spark Core | Lesson 23

Deciding the right size for executor | Spark in Production | Course on Apache Spark Core | Lesson 23

Caching | Course on Apache Spark Core | Lesson 17

Caching | Course on Apache Spark Core | Lesson 17

Partitioners | Course on Apache Spark Core | Lesson 10

Partitioners | Course on Apache Spark Core | Lesson 10

Introduction to Resilient Distributed Dataset (RDD) | Course on Apache Spark Core | Lesson 4

Introduction to Resilient Distributed Dataset (RDD) | Course on Apache Spark Core | Lesson 4

Introduction to Map Reduce | Course on Apache Spark Core | Lesson 2

Introduction to Map Reduce | Course on Apache Spark Core | Lesson 2

Expectations from Data Processing Framework | Course of Apache Spark Core | Lesson 1

Expectations from Data Processing Framework | Course of Apache Spark Core | Lesson 1

Watermarking in stream processing | Course in Spark Structured Streaming 3.0 | Lesson 7

Watermarking in stream processing | Course in Spark Structured Streaming 3.0 | Lesson 7

Windows in stream processing | Course in Spark Structured Streaming 3.0 | Lesson 6

Windows in stream processing | Course in Spark Structured Streaming 3.0 | Lesson 6

Understanding output modes | Course in Spark Structured Streaming 3.0 | Lesson 5

Understanding output modes | Course in Spark Structured Streaming 3.0 | Lesson 5

Need and Challenges of Stream Processing | Course in Spark Structured Streaming 3.0 | Lesson 1

Need and Challenges of Stream Processing | Course in Spark Structured Streaming 3.0 | Lesson 1

Big Data Realtime Analytics | CDC | Maxwell | Part 2 of 3

Big Data Realtime Analytics | CDC | Maxwell | Part 2 of 3

Big Data Realtime Analytics | CDC | Maxwell | Part 1 of 3

Big Data Realtime Analytics | CDC | Maxwell | Part 1 of 3

Big Data Realtime Analytics | CDC | Maxwell | Part 3 of 3

Big Data Realtime Analytics | CDC | Maxwell | Part 3 of 3

Implementing SCD Type 2 | Apache Spark | Databricks Delta [Part 1 of 2]

Implementing SCD Type 2 | Apache Spark | Databricks Delta [Part 1 of 2]

Implementing SCD Type 2 | Apache Spark | Databricks Delta [Part 2 of 2]

Implementing SCD Type 2 | Apache Spark | Databricks Delta [Part 2 of 2]

Addressing Challenges of ETL Using Apache Spark

Addressing Challenges of ETL Using Apache Spark

Taxi Surge and Congestion Analysis using Apache Spark

Taxi Surge and Congestion Analysis using Apache Spark