Канал: NextGen Learning

Adding users group and service principal to Databricks

Adding users group and service principal to Databricks

Databricks Connect to ADLS using service principal

Databricks Connect to ADLS using service principal

Manage Azure Databricks using API

Manage Azure Databricks using API

Databricks Credential Pass through

Databricks Credential Pass through

Introduction Databricks Unity Catalog

Introduction Databricks Unity Catalog

Lakehouse Federation in Unity Catalog #azuredatabricks #databricks

Lakehouse Federation in Unity Catalog #azuredatabricks #databricks

Column Masking in Unity Catalog Enabled Workspace #Databricks #azuredatabricks #notebook

Column Masking in Unity Catalog Enabled Workspace #Databricks #azuredatabricks #notebook

Enable web terminal for Databricks Single User cluster #python #Databrcks #DatabriksCluster

Enable web terminal for Databricks Single User cluster #python #Databrcks #DatabriksCluster

Databricks Kafka streaming Rad

Databricks Kafka streaming Rad

databricks Kafka batch read

databricks Kafka batch read

Stream processing with Apache Kafka and Azure Databricks

Stream processing with Apache Kafka and Azure Databricks

15 - Unity Catalog - Column Masking

15 - Unity Catalog - Column Masking

14 - Unity Catalog - Row Level Access Control

14 - Unity Catalog - Row Level Access Control

13 - Unity Catalog Lakehouse Federation

13 - Unity Catalog Lakehouse Federation

12 - Unity Catalog Change default Data location of Managed Table

12 - Unity Catalog Change default Data location of Managed Table

11- Unity Catalog Managed Tables

11- Unity Catalog Managed Tables

10 - Unity Catalog Admin Roles

10 - Unity Catalog Admin Roles

09- Unity Catalog - Create computer resources

09- Unity Catalog - Create computer resources

08- Databricks Unity Catalog - Azure Ad as identity provider

08- Databricks Unity Catalog - Azure Ad as identity provider

07- Databricks Unity Catalog Create external Location

07- Databricks Unity Catalog Create external Location

06- Unity Catalog Delta sharing ( Non databricks consumers )

06- Unity Catalog Delta sharing ( Non databricks consumers )

05- Unity Catalog Capture and view data lineage

05- Unity Catalog Capture and view data lineage

04-Unity Catalog Create Calatlog , Schema and Tables

04-Unity Catalog Create Calatlog , Schema and Tables

03- Unity Catalog Creating metastore in Azure Unity Catalog

03- Unity Catalog Creating metastore in Azure Unity Catalog

02-Unity Catalog Configuration - Prerequisites

02-Unity Catalog Configuration - Prerequisites

01-Unity Catalog Introduction

01-Unity Catalog Introduction

03 Deploy Resource Group in Azure using Terraform

03 Deploy Resource Group in Azure using Terraform

02 Prerequisites for this course

02 Prerequisites for this course

01-Terraform Introduction

01-Terraform Introduction

What is Terraform ?

What is Terraform ?

Project02 - Process image files using cognitive service and store its output to Cosmos DB

Project02 - Process image files using cognitive service and store its output to Cosmos DB

Copy data from ADLS to Azure SQL using Azure Data Factory

Copy data from ADLS to Azure SQL using Azure Data Factory

Secondary vs Standby NameNode

Secondary vs Standby NameNode

YARN Queue Manager

YARN Queue Manager

YARN Service in Cloudera Data Platform

YARN Service in Cloudera Data Platform

008 HDFS File permission

008 HDFS File permission

02 Dataflow - Cloud Storage to Big Query Batch Job

02 Dataflow - Cloud Storage to Big Query Batch Job

01 Cloud Dataflow - Pub/Sub to Big Query Streaming

01 Cloud Dataflow - Pub/Sub to Big Query Streaming

009 HDFS Balancer

009 HDFS Balancer

07 Virtual Private Cloud

07 Virtual Private Cloud

06 Cloud composer - Deploy Cloud Dataproc cluster and run simple MapReduce job

06 Cloud composer - Deploy Cloud Dataproc cluster and run simple MapReduce job

05 - Deploying Google Cloud Compute Engine ( Virtual machines ) using gcloud commands

05 - Deploying Google Cloud Compute Engine ( Virtual machines ) using gcloud commands

04 - Download install and configure google cloud SDK

04 - Download install and configure google cloud SDK

03- Geography Region zone racks explained

03- Geography Region zone racks explained

02 Deploying Virtual Machine in Google Cloud Platform

02 Deploying Virtual Machine in Google Cloud Platform

007 Configuring pre requsites on worker hosts part2

007 Configuring pre requsites on worker hosts part2

01 - Register and login google cloud platform

01 - Register and login google cloud platform

008 Deploying Cloudera cluster using Cloudera Manager Part2

008 Deploying Cloudera cluster using Cloudera Manager Part2

007 Configuring pre requsites on worker hosts part1

007 Configuring pre requsites on worker hosts part1

008 Deploying Cloudera cluster using Cloudera Manager Part1

008 Deploying Cloudera cluster using Cloudera Manager Part1

006 Deploying virtual machines worker hosts

006 Deploying virtual machines worker hosts

005 Creating parcels local repository

005 Creating parcels local repository

004 Installing Cloudera Manager server edit

004 Installing Cloudera Manager server edit

003 Configure Cloudera Manager Local Repository

003 Configure Cloudera Manager Local Repository

002 Configure prerequisites on master

002 Configure prerequisites on master

001 Deploying Master Host in Azure Cloud

001 Deploying Master Host in Azure Cloud

Connecting Azure Data Lake Gen-2 Storage Container with CDP cluster

Connecting Azure Data Lake Gen-2 Storage Container with CDP cluster

Creating Azure Data Lake Gen-2 Storage

Creating Azure Data Lake Gen-2 Storage

How to handle missing and corrupted block issue ?

How to handle missing and corrupted block issue ?

How to use find command to locate files and directories

How to use find command to locate files and directories

How to disable SELinux

How to disable SELinux

What is vm.swappiness ?

What is vm.swappiness ?

Cloudera Data Platform CDP Cloudera Manager UI Walkthrough

Cloudera Data Platform CDP Cloudera Manager UI Walkthrough

Starting HDP hosts deployed in Azure

Starting HDP hosts deployed in Azure

Cloudera Manager Vs Cloudera Runtime( CDH ) Compatibility matrices

Cloudera Manager Vs Cloudera Runtime( CDH ) Compatibility matrices

03 CDP Multi Node installation - Cloudera Manager installation

03 CDP Multi Node installation - Cloudera Manager installation

02 - CDP Multinode installation - Configure prerequisites for master

02 - CDP Multinode installation - Configure prerequisites for master

01 CDP MultiNode installation - Deploy master Virtual Machines on Azure

01 CDP MultiNode installation - Deploy master Virtual Machines on Azure

SSH password automation in Linux with sshpass

SSH password automation in Linux with sshpass

Cloudera Data Platform Introduction

Cloudera Data Platform Introduction

Creating scope in Azure Databricks and use key vault to secure credentials

Creating scope in Azure Databricks and use key vault to secure credentials

Azure Databricks Connect and mount blob container

Azure Databricks Connect and mount blob container

Install Powershell and Azure Az Module in Linux

Install Powershell and Azure Az Module in Linux

003 Cloudera Data Platform Installation

003 Cloudera Data Platform Installation

002 Installing Cloudera Manager - Cloudera Data Platform

002 Installing Cloudera Manager - Cloudera Data Platform

001_Configure Prerequisites Cloudera Data Platform Installation ( CDP )

001_Configure Prerequisites Cloudera Data Platform Installation ( CDP )

Installing Cloudera Hadoop

Installing Cloudera Hadoop

Installing Cloudera Manager Server

Installing Cloudera Manager Server

Configuring prerequisites - creating user

Configuring prerequisites - creating user

Configure Pre-requites for Cloudera Hadoop Installation

Configure Pre-requites for Cloudera Hadoop Installation

Deploying Virtual Machine on Azure

Deploying Virtual Machine on Azure

015 Custom functions in AWK

015 Custom functions in AWK

014 While loop in AWK

014 While loop in AWK

013 Using if else if in awk

013 Using if else if in awk

012 - Using if - else in AWK

012 - Using if - else in AWK

011 - AWK sample use case

011 - AWK sample use case

010 Using increment operators in AWK

010 Using increment operators in AWK

009 - Using Arithmetic Operators in AWK

009 - Using Arithmetic Operators in AWK

008 - Regular Expression in AWK

008 - Regular Expression in AWK

007 - Getting number of fields and records AWK

007 - Getting number of fields and records AWK

06 - Customizing output record separator in AWK

06 - Customizing output record separator in AWK

05- Customizing Input Record Separator in AWK

05- Customizing Input Record Separator in AWK

04 - AWK - Customize output field separator

04 - AWK - Customize output field separator

03 - Customize Input field separator in AWK

03 - Customize Input field separator in AWK

02 - Executing AWK in different ways

02 - Executing AWK in different ways

01-Introduction to AWK

01-Introduction to AWK

07 Finding files and directories in HDFS

07 Finding files and directories in HDFS

06 Getting the configuration information using getconf

06 Getting the configuration information using getconf

005 Changing the replication factor

005 Changing the replication factor

004 Familiarizing HDFS commands part 2

004 Familiarizing HDFS commands part 2

004 Apache Hadoop Familiarizing HDFS Commands part1

004 Apache Hadoop Familiarizing HDFS Commands part1

003 Apache Hadoop Installation - Configuring and testing YARN

003 Apache Hadoop Installation - Configuring and testing YARN

002 Apache Hadoop - Configuring HDFS Service

002 Apache Hadoop - Configuring HDFS Service

001 Apache Hadoop Installation on CentOS7 - Configuring Prerequisites

001 Apache Hadoop Installation on CentOS7 - Configuring Prerequisites

021 Deploying Virtual Network and Subets in Azure using Terraform

021 Deploying Virtual Network and Subets in Azure using Terraform

020 Creating Resource Group in Azure using terraform

020 Creating Resource Group in Azure using terraform

019 Creating AppID / Service Principal in Azure

019 Creating AppID / Service Principal in Azure

018 lookup function in terraform

018 lookup function in terraform

017 If else - Conditional Statements in Terraform

017 If else - Conditional Statements in Terraform

016 Modules in Terraform

016 Modules in Terraform

014 - How to use for loop in Terraform

014 - How to use for loop in Terraform

013 - Deploying multiple resources using terraform using foreach

013 - Deploying multiple resources using terraform using foreach

012 Read resource name from list

012 Read resource name from list

011 Count index

011 Count index

010 Deploying multiple resources using count

010 Deploying multiple resources using count

009 Substituting variables by adding values in file

009 Substituting variables by adding values in file

008 Terraform pass values during deployment using var option

008 Terraform pass values during deployment using var option

007 Terraform Passing values for variables during runtime

007 Terraform Passing values for variables during runtime

006 Define Variables in Terraform configuration

006 Define Variables in Terraform configuration

005 Deploying EC2 instance using Terraform

005 Deploying EC2 instance using Terraform

004 How to deploy infra usingTerraform

004 How to deploy infra usingTerraform

003 Creating user account in AWS

003 Creating user account in AWS

002 Installation and Configuration of Terraform

002 Installation and Configuration of Terraform

001 Introduction to Terraform

001 Introduction to Terraform

008 What is safe mode

008 What is safe mode

007 How HDFS CheckPoint Works

007 How HDFS CheckPoint Works

006 What is HDFS Block

006 What is HDFS Block

005 - What is secondary Namenode ?

005 - What is secondary Namenode ?

004 What is Namenode High Availability ?

004 What is Namenode High Availability ?

003 Namenode and Datanodes

003 Namenode and Datanodes

002 What is Hadoop Distributed File System

002 What is Hadoop Distributed File System

001 What is Bigdata and Hadoop ?

001 What is Bigdata and Hadoop ?

06 Terminating cluster using Cloudera Director

06 Terminating cluster using Cloudera Director

05 Deploying Cluster

05 Deploying Cluster

04 CreatingHostTemplate in Cloudera Altus Director

04 CreatingHostTemplate in Cloudera Altus Director

03 Registering Environment

03 Registering Environment

02 Installing Cloudera Director

02 Installing Cloudera Director

01 Deploying Virtual Machine for Cloudera Director installation

01 Deploying Virtual Machine for Cloudera Director installation

Cloudera Altus Director Introduction

Cloudera Altus Director Introduction

Changing ownership of files in Linux

Changing ownership of files in Linux

15 - Regex Character class

15 - Regex Character class

14- Sed with quantifier regex

14- Sed with quantifier regex

13 Regular Expression Basics Part-1

13 Regular Expression Basics Part-1

FilePermissions in Linux

FilePermissions in Linux

12 - Stream Editor | Sed | Part 4

12 - Stream Editor | Sed | Part 4

Adding local users in Linux

Adding local users in Linux

11 - Stream Editor | sed | Part 3

11 - Stream Editor | sed | Part 3

10 - Stream editor | sed | Part 2

10 - Stream editor | sed | Part 2

Creating directories in Linux

Creating directories in Linux

09 - Stream editor | sed | Part 1

09 - Stream editor | sed | Part 1

Listing files andDirectories

Listing files andDirectories

Linux directory structure

Linux directory structure

VmUsingVirtualBoxAndOsboxes

VmUsingVirtualBoxAndOsboxes

Cloudera manager basics

Cloudera manager basics

Building Kafka cluster using Docker

Building Kafka cluster using Docker

Creating hive cluster using docker

Creating hive cluster using docker

Docker bind mount | Sharing data between host and Container

Docker bind mount | Sharing data between host and Container

Building Hadoop Cluster Using Docker | Apache Hadoop Cluster Using Docker Compose

Building Hadoop Cluster Using Docker | Apache Hadoop Cluster Using Docker Compose

Difference between CMD and ENTRYPOINT

Difference between CMD and ENTRYPOINT

Docker mount bind | Sharing Container data with host

Docker mount bind | Sharing Container data with host

Docker Volume | Sharing data between Containerts

Docker Volume | Sharing data between Containerts

Docker - Copy files from Container to hostfile

Docker - Copy files from Container to hostfile

Docker compose Building docker image running container

Docker compose Building docker image running container

Docker Compose - Create MySQL and Nginx Containers

Docker Compose - Create MySQL and Nginx Containers

what is docker compose ?

what is docker compose ?

Installing Docker Compose

Installing Docker Compose

Creating Apache2 Docker Image and Container

Creating Apache2 Docker Image and Container

Cleaning docker Containers and Images

Cleaning docker Containers and Images

Cerete First Docker Image using Dockerfile

Cerete First Docker Image using Dockerfile

Pushing docker Images to Docker Hub

Pushing docker Images to Docker Hub

Create docker hub Account

Create docker hub Account

Download docker images from Docker Hub

Download docker images from Docker Hub

What is Docker and Containers

What is Docker and Containers

Creating my first docker container

Creating my first docker container

Docker installation on CentOS7

Docker installation on CentOS7

Installation configuration MIT Kerberos

Installation configuration MIT Kerberos

How to Disable Kerberos on Cloudera Managed Cluster

How to Disable Kerberos on Cloudera Managed Cluster

Creating Key pairs using puttygen

Creating Key pairs using puttygen

vi editot tips and tricks

vi editot tips and tricks

How to use vi editor

How to use vi editor

Cloudera manager external authentication

Cloudera manager external authentication

Creating Cloudera Manager Users using REST API

Creating Cloudera Manager Users using REST API

How to Simulate and Learn Common production issues

How to Simulate and Learn Common production issues

Doing HDFS checkpoint manually

Doing HDFS checkpoint manually

Creating keytab of a user

Creating keytab of a user

Deploying Windows Server 2012 on AWS - Active Directory Installation

Deploying Windows Server 2012 on AWS - Active Directory Installation

Integrating Linux Servers With Active Directory

Integrating Linux Servers With Active Directory

Active Directory Installation

Active Directory Installation

Install and Configure Cloudera Manager

Install and Configure Cloudera Manager

Configuring Local Repository for Cloudera Manager and CDH

Configuring Local Repository for Cloudera Manager and CDH

Cloudera Hadoop-6 Provisioning VM in Micosost Azure

Cloudera Hadoop-6 Provisioning VM in Micosost Azure

08 - Unix Shell scripting - while loops

08 - Unix Shell scripting - while loops

07 - Unix Shell Scripting for loop

07 - Unix Shell Scripting for loop

06 Unix Shell scripting conditional statement If part2

06 Unix Shell scripting conditional statement If part2

06 Unix Shell scripting conditional statement - Part 1

06 Unix Shell scripting conditional statement - Part 1

Installation and COnfiguration of Apache Ranger

Installation and COnfiguration of Apache Ranger

004 - Unix Shell scripting - test command

004 - Unix Shell scripting - test command

Upgrading Cluster to Hortonworks Data Platform 3.0.0

Upgrading Cluster to Hortonworks Data Platform 3.0.0

How to Generate Strong ans Secure Passwords

How to Generate Strong ans Secure Passwords

003-Unix Shell Scripting - Read command

003-Unix Shell Scripting - Read command