Канал: learn by doing it

8. Python interview question -3 | Data Engineer

8. Python interview question -3 | Data Engineer

7. Python Coding Questions for Data Engineer Interviews | Data Engineer

7. Python Coding Questions for Data Engineer Interviews | Data Engineer

6. Python Interview Questions and Answers | data engineer

6. Python Interview Questions and Answers | data engineer

5. SQL Most Asked Interview question and answer | data engineer

5. SQL Most Asked Interview question and answer | data engineer

4. SQL Interview important question | Data Engineer Interview

4. SQL Interview important question | Data Engineer Interview

3 . Data engineer interview question | SQL Interview question

3 . Data engineer interview question | SQL Interview question

2. SQL Interview question and answer | Data Engineer

2. SQL Interview question and answer | Data Engineer

Data Engineer Interview Questions & Answers | SQL Question -1

Data Engineer Interview Questions & Answers | SQL Question -1

31. Triggers in SQL | Sql Triggers🔫 Real Life Example

31. Triggers in SQL | Sql Triggers🔫 Real Life Example

30. Subquery in SQL || SQL Subquery tutorial with examples

30. Subquery in SQL || SQL Subquery tutorial with examples

29. SQL Stored Procedures in SQL | CREATE PROCEDURE Statement | SQL

29. SQL Stored Procedures in SQL | CREATE PROCEDURE Statement | SQL

28. VIEWS in SQL | SQL VIEWS | SQL TUTORIAL

28. VIEWS in SQL | SQL VIEWS | SQL TUTORIAL

27. CTE in SQL | SQL WITH Clause | (Common Table Expression)

27. CTE in SQL | SQL WITH Clause | (Common Table Expression)

26. Lead and Lag in sql | SQL Playlist

26. Lead and Lag in sql | SQL Playlist

25. RANK, DENSE_RANK, ROW_NUMBER IN SQL |SQL Analytical Functions

25. RANK, DENSE_RANK, ROW_NUMBER IN SQL |SQL Analytical Functions

24. Windows function in SQL | Aggregate windows function

24. Windows function in SQL | Aggregate windows function

23. ALTER IN SQL | SQL Tutorial

23. ALTER IN SQL | SQL Tutorial

22. Union vs Union all IN SQL | SQL TUTORIAL

22. Union vs Union all IN SQL | SQL TUTORIAL

21.Complete SQL JOINS | SQL JOIN with Examples

21.Complete SQL JOINS | SQL JOIN with Examples

20. Coalesce IN SQL | SQL Tutorial

20. Coalesce IN SQL | SQL Tutorial

19. Distinct IN SQL | sql tutorial

19. Distinct IN SQL | sql tutorial

18. TOP OR LIMIT IN SQL | SQL Tutorial

18. TOP OR LIMIT IN SQL | SQL Tutorial

17. Having Clause IN SQL | SQL Tutorial

17. Having Clause IN SQL | SQL Tutorial

16. Like Operator IN SQL | SQL TUTORIAL

16. Like Operator IN SQL | SQL TUTORIAL

15. Group by IN SQL | SQL TUTORIAL

15. Group by IN SQL | SQL TUTORIAL

14. Aggregate Function IN SQL | sql tutorial

14. Aggregate Function IN SQL | sql tutorial

13. CONDITIONAL STATEMENT IN SQL | AND , OR, IN CONDITION IN SQL

13. CONDITIONAL STATEMENT IN SQL | AND , OR, IN CONDITION IN SQL

12. UPDATE IN SQL | SQL TUTORIAL

12. UPDATE IN SQL | SQL TUTORIAL

11. DELETE VS DROP VS TRUNCATE IN SQL | SQL TUTORIAL

11. DELETE VS DROP VS TRUNCATE IN SQL | SQL TUTORIAL

10. FILTER & SORT IN SQL | SQL TUTORIAL

10. FILTER & SORT IN SQL | SQL TUTORIAL

9. FOREIGN KEY IN SQL | SQL TUTORIAL

9. FOREIGN KEY IN SQL | SQL TUTORIAL

8. PRIMARY KEY IN SQL

8. PRIMARY KEY IN SQL

7 CHECK & DEFALT CONSTRAINTS IN SQL | SQL TUTORIAL

7 CHECK & DEFALT CONSTRAINTS IN SQL | SQL TUTORIAL

6. NOT NULL & UNIQUE CONSTRAINTS | sql tutorial

6. NOT NULL & UNIQUE CONSTRAINTS | sql tutorial

5. Constraints in SQL | SQL Tutorial

5. Constraints in SQL | SQL Tutorial

4. INSERT Statement in SQL | SQL Tutorial

4. INSERT Statement in SQL | SQL Tutorial

3. DATABASE PRACTICAL

3. DATABASE PRACTICAL

2. What is database | Database and types | SQL Tutorial

2. What is database | Database and types | SQL Tutorial

1 SQL Introduction | Install SQL Server

1 SQL Introduction | Install SQL Server

Complete azure data engineer Course | azure data engineer

Complete azure data engineer Course | azure data engineer

File Unzip Scenario - Azure Data Factory Project

File Unzip Scenario - Azure Data Factory Project

52. How to get email notifications for pipeline failures in ADF

52. How to get email notifications for pipeline failures in ADF

Copy Data From Rest API to ADLS using ADF | Azure data factory project

Copy Data From Rest API to ADLS using ADF | Azure data factory project

Validate schema and structure of the file before processing |Azure data factory project

Validate schema and structure of the file before processing |Azure data factory project

51. how to find total file count available in folder | ADF

51. how to find total file count available in folder | ADF

Azure data factory project | Delete file scenario Project

Azure data factory project | Delete file scenario Project

Azure data factory Project | Skip Empty Files scenario | ADF Project

Azure data factory Project | Skip Empty Files scenario | ADF Project

Databricks sales analysis Project | Databricks project

Databricks sales analysis Project | Databricks project

End to End Azure Data Factory Project | Data Migration Project

End to End Azure Data Factory Project | Data Migration Project

40 Scenario based pyspark interview question | pyspark interview

40 Scenario based pyspark interview question | pyspark interview

39. Missing Number question using PySpark | PySpark interview question

39. Missing Number question using PySpark | PySpark interview question

38 Cummulative sales - PySpark Interview Question | Running Total sales

38 Cummulative sales - PySpark Interview Question | Running Total sales

37. Pyspark interview question |JSON Parse | pyspark tutorial

37. Pyspark interview question |JSON Parse | pyspark tutorial

36. Pyspark Scenario based interview question | Pyspark Tutorial

36. Pyspark Scenario based interview question | Pyspark Tutorial

35. Important Pyspark Interview Question | LTIMindTree Interview

35. Important Pyspark Interview Question | LTIMindTree Interview

34. Pyspark Interview question asked in Tech Mahindra | Pyspark tutorial

34. Pyspark Interview question asked in Tech Mahindra | Pyspark tutorial

33. Duplicate records question using pyspark | pysaprk tutorial

33. Duplicate records question using pyspark | pysaprk tutorial

32. Cache and Persist in pyspark | Cache vs Persist | Pyspark Interview Question

32. Cache and Persist in pyspark | Cache vs Persist | Pyspark Interview Question

31. Explode Functions in Pyspark | Pyspark Tutorial

31. Explode Functions in Pyspark | Pyspark Tutorial

Databricks project end to end | Pyspark Project

Databricks project end to end | Pyspark Project

Databricks Pyspark Project | Pyspark Project | Databricks

Databricks Pyspark Project | Pyspark Project | Databricks

28 PartitionBy in pyspark | Pyspark tutorial

28 PartitionBy in pyspark | Pyspark tutorial

27. Different date functions in Pyspark | pyspark tutorial

27. Different date functions in Pyspark | pyspark tutorial

26. date format function in Pyspark | pyspark tutorial

26. date format function in Pyspark | pyspark tutorial

25. Windows function in Pyspark | PySpark Tutorial

25. Windows function in Pyspark | PySpark Tutorial

24. Create Temp view in PySpark | createOrReplaceTempView() function in PySpark

24. Create Temp view in PySpark | createOrReplaceTempView() function in PySpark

23 DataFrame.transform() function in PySpark | pyspark tutorial

23 DataFrame.transform() function in PySpark | pyspark tutorial

22. UDF in pyspark | UDF(user defined function) in PySpark

22. UDF in pyspark | UDF(user defined function) in PySpark

21. pivot and unpivot in pyspark | pyspark tutorial

21. pivot and unpivot in pyspark | pyspark tutorial

SCD TYPE-2 using ADF | Azure data engineering project

SCD TYPE-2 using ADF | Azure data engineering project

20. StructType & StructField in PySpark | Pyspark Tutorial

20. StructType & StructField in PySpark | Pyspark Tutorial

19. collect in pyspark| pyspark tutorial

19. collect in pyspark| pyspark tutorial

18. fill and fillna in pyspark | pyspark tutorial

18. fill and fillna in pyspark | pyspark tutorial

17 Union and union all in pyspark | pyspark tutorial

17 Union and union all in pyspark | pyspark tutorial

16. Joining in Pyspark | Pyspark Tutorial

16. Joining in Pyspark | Pyspark Tutorial

15 GroupBy in pyspark | pyspark tutorial

15 GroupBy in pyspark | pyspark tutorial

14 sort and orderBy function in pyspark | pyspark Tutorial

14 sort and orderBy function in pyspark | pyspark Tutorial

13. drop and dropDulicates function in pyspark | pyspark tutorial

13. drop and dropDulicates function in pyspark | pyspark tutorial

12. Filter in Pyspark | pyspark tutorial

12. Filter in Pyspark | pyspark tutorial

11. withColumn in pyspark | Pyspark Tutorial

11. withColumn in pyspark | Pyspark Tutorial

10. Select function in pyspark | pyspark tutorial

10. Select function in pyspark | pyspark tutorial

9. Read JSON file using pyspark | pyspark tutorial

9. Read JSON file using pyspark | pyspark tutorial

8. Create dataframe using csv | pyspark lab-1 | pyspark tutorial

8. Create dataframe using csv | pyspark lab-1 | pyspark tutorial

50. Dataflow import schema error | Import schema failed issue in adf

50. Dataflow import schema error | Import schema failed issue in adf

7. Databricks Overview | pyspark playlist

7. Databricks Overview | pyspark playlist

49. Import schema failed Error in adf | azure data factory

49. Import schema failed Error in adf | azure data factory

48. Error solution - Dataset is using 'AzureSqlDatabase' linked service with SQLVersion v2 type

48. Error solution - Dataset is using 'AzureSqlDatabase' linked service with SQLVersion v2 type

46 Rank transformation in azure data factory | azure data factory

46 Rank transformation in azure data factory | azure data factory

47. Azure data factory SCD Type 1 | Azure data factory project

47. Azure data factory SCD Type 1 | Azure data factory project

45. Alter row transformation in azure data factory | azure data factory

45. Alter row transformation in azure data factory | azure data factory

44. Windows transformation in azure data factory | azure data factory

44. Windows transformation in azure data factory | azure data factory

43. Surrogate Key Transformation in ADF | Azure data Factory

43. Surrogate Key Transformation in ADF | Azure data Factory

42. Unpivot Transformation in Azure Data Factory | Azure data factory

42. Unpivot Transformation in Azure Data Factory | Azure data factory

41. Pivot transformation in ADF | Azure data factory

41. Pivot transformation in ADF | Azure data factory

6. Setup Databricks Community Edition | PySpark tutorial

6. Setup Databricks Community Edition | PySpark tutorial

5. Spark Installation on Windows | Install Spark and PySpark

5. Spark Installation on Windows | Install Spark and PySpark

4 DAG & Lazy Evaluation in Spark | PySpark Tutorial

4 DAG & Lazy Evaluation in Spark | PySpark Tutorial

3. What is RDD in Spark | Spark RDD | Pyspark tutorial

3. What is RDD in Spark | Spark RDD | Pyspark tutorial

2. Spark Architecture | PySpark Tutorial

2. Spark Architecture | PySpark Tutorial

1. Introduction to Spark | Apache Spark | PySpark Tutorial

1. Introduction to Spark | Apache Spark | PySpark Tutorial

40. Conditional Split Transformation in azure data factory | Azure data factory

40. Conditional Split Transformation in azure data factory | Azure data factory

39 Exists Transformation in azure data factory | Azure data factory

39 Exists Transformation in azure data factory | Azure data factory

38. Script activity in azure data factory | Azure data factory

38. Script activity in azure data factory | Azure data factory

37. Fail activity in azure data factory | Azure data factory

37. Fail activity in azure data factory | Azure data factory

36. Web activity in azure data factory | Azure data factory

36. Web activity in azure data factory | Azure data factory

35. Until activity in azure data factory | Azure data factory

35. Until activity in azure data factory | Azure data factory

34. Filter activity in azure data factory | Azure data factory

34. Filter activity in azure data factory | Azure data factory

33. Execute pipeline activity in azure data factory | Azure data factory

33. Execute pipeline activity in azure data factory | Azure data factory

32. Validation activity in azure data factory | Azure data factory

32. Validation activity in azure data factory | Azure data factory

31. Switch activity in azure data factory | Azure data factory

31. Switch activity in azure data factory | Azure data factory

30. wait activity in azure data factory | Azure data factory

30. wait activity in azure data factory | Azure data factory

29. Lookup activity in azure data factory | Azure data factory

29. Lookup activity in azure data factory | Azure data factory

28. Stored Procedure Activity in ADF | Azure data factory

28. Stored Procedure Activity in ADF | Azure data factory

27. append variable activity in azure data factory| Azure data factory

27. append variable activity in azure data factory| Azure data factory

26. Set Variable activity in azure data factory | Azure data factory

26. Set Variable activity in azure data factory | Azure data factory

25. If Condition activity in azure data factory | Azure data factory

25. If Condition activity in azure data factory | Azure data factory

24 ForEach activity in azure data factory | Azure data factory

24 ForEach activity in azure data factory | Azure data factory

23. Get Metadata activity in azure data factory | Azure data factory

23. Get Metadata activity in azure data factory | Azure data factory

22. File naming in azure data factory | Azure data factory

22. File naming in azure data factory | Azure data factory

21. Pipeline parameterization in azure data factory | Azure data factory project

21. Pipeline parameterization in azure data factory | Azure data factory project

20. Linked service parameterization in azure data factory | Azure data factory

20. Linked service parameterization in azure data factory | Azure data factory

19. Parameterize dataset in azure data factory | Azure data factory

19. Parameterize dataset in azure data factory | Azure data factory

18. Aggregate transformation in azure data factory | Azure data factory

18. Aggregate transformation in azure data factory | Azure data factory

17 Derived Column transformation in azure data factory | Azure data factory

17 Derived Column transformation in azure data factory | Azure data factory

16. Select transformation in azure data factory | azure data factory

16. Select transformation in azure data factory | azure data factory

15 Union transformation in azure data factory | Azure data factory

15 Union transformation in azure data factory | Azure data factory

14 Join transformation in azure data factory | azure data factory

14 Join transformation in azure data factory | azure data factory

13. Data flow in Azure data factory | Filter and sort transformation in adf

13. Data flow in Azure data factory | Filter and sort transformation in adf

#12. Tumbling window triggers in azure data factory | Azure data factory

#12. Tumbling window triggers in azure data factory | Azure data factory

#11. Event based triggers in azure data factory | Azure data factory

#11. Event based triggers in azure data factory | Azure data factory

10. Scheduled triggers in azure data factory | Azure data factory

10. Scheduled triggers in azure data factory | Azure data factory

9 triggers in azure data factory | Azure data factory

9 triggers in azure data factory | Azure data factory

8 . Copy CSV file from AZURE Blob to AZURE SQL | Azure data factory

8 . Copy CSV file from AZURE Blob to AZURE SQL | Azure data factory

7. How to Create AZURE SQL Database | Azure data factory

7. How to Create AZURE SQL Database | Azure data factory

6. Delete activity in azure data factory | Azure data factory

6. Delete activity in azure data factory | Azure data factory

5. Copy Activity in azure data factory | Copy data activity in ADF

5. Copy Activity in azure data factory | Copy data activity in ADF

4 Azure storage theory & practical | Azure data factory

4 Azure storage theory & practical | Azure data factory

3. azure data factory components | Azure data factory

3. azure data factory components | Azure data factory

2. how to create azure data factory | ADF Lab-1 | Azure data factory

2. how to create azure data factory | ADF Lab-1 | Azure data factory

1. What is Azure data factory | Azure data Factory

1. What is Azure data factory | Azure data Factory

Azure Data Factory New Batch | Azure Data Factory

Azure Data Factory New Batch | Azure Data Factory

24. AWS SNS Project | AWS Data Engineer

24. AWS SNS Project | AWS Data Engineer

23 AWS SNS Tutorial | AWS Simple Notification service | AWS Data Engineer

23 AWS SNS Tutorial | AWS Simple Notification service | AWS Data Engineer

Azure data factory SCD Type 1 Project | Slowly Changing Dimension(SCD) Type 1 Using ADF

Azure data factory SCD Type 1 Project | Slowly Changing Dimension(SCD) Type 1 Using ADF

22. AWS Kinesis Practical Lab | AWS kinesis Firehose | AWS Data Engineer

22. AWS Kinesis Practical Lab | AWS kinesis Firehose | AWS Data Engineer

21. AWS kinesis Tutorial | AWS Kinesis | AWS Data Engineer

21. AWS kinesis Tutorial | AWS Kinesis | AWS Data Engineer

AWS Data Engineer Project | Building a Data Pipeline on AWS

AWS Data Engineer Project | Building a Data Pipeline on AWS

19. AWS Athena Practical Lab | Athena +Glue+s3 |AWS Data Engineer

19. AWS Athena Practical Lab | Athena +Glue+s3 |AWS Data Engineer

18 What is AWS Athena | AWS Athena theory & Lab | AWS Data Engineer

18 What is AWS Athena | AWS Athena theory & Lab | AWS Data Engineer

17 AWS Crawler | AWS Glue Crawler | AWS Data Engineer

17 AWS Crawler | AWS Glue Crawler | AWS Data Engineer

16. AWS Glue Practical lab-3 | AWS Glue multiple CSV | AWS Data engineer

16. AWS Glue Practical lab-3 | AWS Glue multiple CSV | AWS Data engineer

15 AWS Glue Practical | AWS Glue Lab- 2 | AWS Data Engineer

15 AWS Glue Practical | AWS Glue Lab- 2 | AWS Data Engineer

14. AWS Glue Practical | AWS Glue CSV to JSON | AWS Data Engineer

14. AWS Glue Practical | AWS Glue CSV to JSON | AWS Data Engineer

Azure data factory project | ADF Project

Azure data factory project | ADF Project

13 AWS Glue tutorial | AWS Data Engineer

13 AWS Glue tutorial | AWS Data Engineer

12. AWS EC2 Instance Type | AWS Data Engineer

12. AWS EC2 Instance Type | AWS Data Engineer

11. Introduction to AWS EC2 | Aws Data engineer

11. Introduction to AWS EC2 | Aws Data engineer

Real Time AWS Data Engineer Project

Real Time AWS Data Engineer Project

9 AWS Lambda Trigger | AWS Lambda Practical Lab| AWS Data Engineer

9 AWS Lambda Trigger | AWS Lambda Practical Lab| AWS Data Engineer

8 AWS Lambda practical lab-1 | AWS Data Engineer

8 AWS Lambda practical lab-1 | AWS Data Engineer

7. What is AWS Lambda | AWS Lambda Introduction | AWS Data Engineer

7. What is AWS Lambda | AWS Lambda Introduction | AWS Data Engineer

6. What is IAM Role in AWS | AWS IAM ROLE | AWS DATA ENGINEER

6. What is IAM Role in AWS | AWS IAM ROLE | AWS DATA ENGINEER

5. AWS IAM - Identity and Access Management | AWS Data Engineer

5. AWS IAM - Identity and Access Management | AWS Data Engineer

4. AWS S3 - Storage Classes | AWS S3 Standard - Infrequent - Glacier

4. AWS S3 - Storage Classes | AWS S3 Standard - Infrequent - Glacier

3. Amazon S3 Practical | S3 practical | AWS Data Engineer

3. Amazon S3 Practical | S3 practical | AWS Data Engineer

2. AWS S3 Tutorial | AWS S3 (Simple Storage Service) | AWS Data Engineer

2. AWS S3 Tutorial | AWS S3 (Simple Storage Service) | AWS Data Engineer

1. Introduction to Cloud | AWS Data Engineer

1. Introduction to Cloud | AWS Data Engineer

Data ENGINEER vs Data SCIENTIST vs Data ANALYST🧑🏼‍💻 | What does data engineer do ?

Data ENGINEER vs Data SCIENTIST vs Data ANALYST🧑🏼‍💻 | What does data engineer do ?

AWS DATA ENGINEER | AWS DATA ENGINEER PLAYLIST | INTRODUCTION

AWS DATA ENGINEER | AWS DATA ENGINEER PLAYLIST | INTRODUCTION

PySpark Interview Questions & Answers | PySpark Interview Questions

PySpark Interview Questions & Answers | PySpark Interview Questions

How to Load Multiple CSV Files | azure data factory Project

How to Load Multiple CSV Files | azure data factory Project

Databricks interview questions and answers

Databricks interview questions and answers

7. how to read json file using pyspark | pyspark Tutorial

7. how to read json file using pyspark | pyspark Tutorial

6 How to read CSV file in PySpark | PySpark Tutorial

6 How to read CSV file in PySpark | PySpark Tutorial

Databricks and Pyspark Project | Real Time ETL Pipeline Azure SQL to ADLS

Databricks and Pyspark Project | Real Time ETL Pipeline Azure SQL to ADLS

Install spark and PySpark on Windows | Spark Installation Guide

Install spark and PySpark on Windows | Spark Installation Guide

Spark DAG & Lazy Evaluation | DAG | Pyspark tutorial - 4

Spark DAG & Lazy Evaluation | DAG | Pyspark tutorial - 4

3. What is RDD in Spark | RDD Tutorial | Pyspark Tutorial

3. What is RDD in Spark | RDD Tutorial | Pyspark Tutorial

Spark Architecture | PySpark Tutorial

Spark Architecture | PySpark Tutorial

1. What Is Spark? | PySpark Tutorial

1. What Is Spark? | PySpark Tutorial

End to End Pyspark Project | Pyspark Project

End to End Pyspark Project | Pyspark Project

Azure data engineer resume | azure data engineer resume preparation

Azure data engineer resume | azure data engineer resume preparation

azure data engineer project | azure data engineer project end to end

azure data engineer project | azure data engineer project end to end

Tableau Project | Data Analyst Project

Tableau Project | Data Analyst Project

Partition vs Bucketing | Data Engineer interview

Partition vs Bucketing | Data Engineer interview

Git Pull Request | Git Pull Request Tutorial | Git Commands

Git Pull Request | Git Pull Request Tutorial | Git Commands

Azure data Engineer project | Incremental data load in Azure Data Factory

Azure data Engineer project | Incremental data load in Azure Data Factory

How to import CSV to SQL | CSV to SQL

How to import CSV to SQL | CSV to SQL

SQL Query Optimization | SQL Query Optimization and performance tuning

SQL Query Optimization | SQL Query Optimization and performance tuning

SQL Tricky Interview Questions | SQL Interview Questions | SQL JOINS Interview Question

SQL Tricky Interview Questions | SQL Interview Questions | SQL JOINS Interview Question

Azure data engineer project | Real time end to end azure data engineer project

Azure data engineer project | Real time end to end azure data engineer project

SQL interview Questions and Answers | Most Asked SQL Questions| part-3

SQL interview Questions and Answers | Most Asked SQL Questions| part-3

How to Generate Script in SQL Server With Data | Generate Script in SQL

How to Generate Script in SQL Server With Data | Generate Script in SQL

SQL interview Questions and Answers | Data Engineer Interview

SQL interview Questions and Answers | Data Engineer Interview

SQL interview Questions and Answers | Data Engineer Interview

SQL interview Questions and Answers | Data Engineer Interview

Power BI End to End Project💥 | Power BI project Dashboard

Power BI End to End Project💥 | Power BI project Dashboard

#26 SQL Stored procedure | Stored Procedure in SQL Server

#26 SQL Stored procedure | Stored Procedure in SQL Server

25. Views in SQL | SQL Views Complete | How to create view in sql

25. Views in SQL | SQL Views Complete | How to create view in sql

#24 SQL WITH Clause with examples | SQL CTE (Common Table Expression)

#24 SQL WITH Clause with examples | SQL CTE (Common Table Expression)

23. Subquery In SQL | SQL Subquery Tutorial With Examples

23. Subquery In SQL | SQL Subquery Tutorial With Examples