Azure Data Engineer Technologies for Beginners [DP-200, 201] (Udemy.com)

Microsoft Azure SQL Database, Data Lake, Data Factory, Synapse Analytics, Cosmos DB, Databricks,HDInsight,DP-200, DP-201

( 269 Reviews )

Created by: Eshant Garg

Produced in 2021

What you will learn

You will be able to identify right Azure SQL Server deployment option, purchasing model and service tier according to requirements and will be able to deploy it in cloud.
You will able to deploy Azure Synapse Analytics (formerly known as Azure SQLData warehouse) in Azure Cloud environment.
You will have good internal MPParchitecture understanding, and so you will be able to analyse your on-premises data warehouse, and migrate data to Azure Data Warehouse.
You will be able to create Azure Data Lake Gen1 storage account, populate it will data and analyze it using U-SQL Language.
You will understand Azure Data Factory key components and advantages. You will be able to create, schedule and monitor simple pipelines.
We will understand how HDInsight makes Hadoop easy, and we will go through simple demo where well fetch data from Data Lake, process it through Hive and later will store data in SQL Server.

Quality Score

Content Quality

Video Quality

Qualified Instructor

Course Pace

Course Depth & Coverage

Overall Score : 92 / 100

Course Description

Why Microsoft Azure Data Engineer?
Microsoft Azure Date Engineering is one of the fastest-growing and in-demand occupations among Data Science practitioners. According to a 2019 Dice report, there was an 88% year-over-year growth in job postings for data engineers, which was the highest growth rate among all technology jobs.
If you are interested in this domain, there cannot be a better time to start learning these Microsoft Azure Data Solution technologies. Expected OutcomesAfter this course:
Microsoft Azure SQLServer - You will be able to identify the right Azure SQL Server deployment option, purchasing model and service tier according to requirements and will be able to deploy it in the cloud. You will be able to set up a security configuration to secure your database.
Microsoft Azure SQLData Warehouse - You will able to deploy Azure Synapse Analytics (formerly known as Azure SQLData warehouse) in Azure Cloud environment. You will have good internal MPParchitecture understanding, and so you will be able to analyze your on-premises data warehouse and migrate data to Azure Data Warehouse. Microsoft Azure Data Lake - You will be able to create Azure Data Lake storage account, populate it will data using different tools and analyze it using Databricks and HDInsightMicrosoft Azure Data Factory - You will understand Azure Data Factory's key components and advantages. You will be able to create, schedule and monitor simple pipelines.
Hadoop Basics - You will learn the fundamental understanding of the Hadoop Ecosystem and 3 main building blocks. This module will prepare you to start learning Big Data in Azure Cloud using HDInsight.
Microsoft Azure HDInsight - We will understand how HDInsight makes Hadoop easy, and we will go through simple demo where well fetch data from Data Lake, process it through Hive and later will store data in SQL Server.
Cosmos DB - You will understand all basic concepts of Cosmos DB, and will be able to create a new database, container, documents, and choose right partition key, configure the global distribution and use other important featuresStreaming Service - Iwill add details soonDatabricks - Iwill add details soonStorage Service - Iwill add details soonIntended AudienceBeginners in Microsoft Azure PlatformMicrosoft Azure Data EngineersMicrosoft Azure Data ScientistDatabase and BI developersDatabase AdministratorsData Analyst or similar profilesOn-Premises Database related profiles who want to learn how to implement these technologies in Azure Cloud.
Anyone who is looking forward to starting his career as an Azure Data Engineer.
LevelBeginners (100)"if you are already experienced and working on these technologies, this may not be the best course for you."Ihave a few crash courses (Free) for absolute beginners, you can find links on my website. PrerequisitesBasic T-SQL and Database conceptsMicrosoft Azure Free trial SubscriptionLanguageEnglishIf you are not comfortable in English, please do not take a course, captions are not good enough to understand the course.
What's insideVideo lectures, PPTs, Demo Resources, Quiz, Assignment, other important linksFull lifetime access with all future updatesCertificate of course completion30-Day Money-Back GuaranteeCourse updatesI am consistently adding new content in terms of both lectures and demos. Please find below logs for past and upcoming changes. Previous Updates:
July 2021 - Monitoring and Optimization of servicesJuly 2021 - AMS(Azure Monitoring Service)July 2021 - Re-recorded Azure Data Factory with all new updatesJuly 2021 - NoSQL Databases in Microsoft Azure (Azure Blob Storage)July 2021 - Added Azure Databricks ModuleJuly 2021 - Added Azure Streaming Analytics ModuleJune 2021 - Added Azure Cosmos DB ModuleMay 2021 - Full-length course on Data LakeApr 2021 - Added modules on Azure cloud computing basics, and Data Engineer profileApr 2021 - Added crash course on cloud computing and data warehouseMar 2021 - Added Azure Synapse AnalyticsFeb 2021 - Added Azure SQL DatabaseOct 2019 - Added Azure HDInsightSep 2019 - Added Azure Data FactoryAug 2019 - Course Created on Azure Data LakeCourse In DetailBy the end of this courseMicrosoft Azure SQLServer - You will know the advantages of Azure Database over on-premises DatabaseYou will be able to provision all three types of Azure Database PaaS Deployments (Single, Elastic Pool, Managed Instance)You will learn different purchasing models and Service tiers and how to configure them according to requirements.
You will be able to provision Azure Database in Virtual Machine (IaaS)You will be able to deploy Elastic Pool Database and able to add/remove more databases from the pool.
You will be able to deploy the Managed Instance Database, configure it and connect it with your SQLServer Management studio.
Microsoft Azure Synapse Analytics ServiceYou will learn why we should consider warehousing solutions in the cloud.
You will learn about Microsoft's brand new Azure Synapse analytics service, and how this service brings together enterprise data warehousing and Big Data analytics, and provide a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.
You will learn the difference between Traditional vs Modern vs Synapse Architecture.
You will learn Azure famous MPP(Massive Parallel Processing) architectureYou will also learn many internal concepts like Data Distribution, Sharding, and partitioning. You will learn different migration methods and best practices.
You will learn PolyBase setup (Best Loading method)You will perform a lot of demos to migrate data to Azure SQLData warehouse using SSIS, Data Factory and PolyBase.
Microsoft Azure Data Lake Gen1You will learn the limitations of traditional database systems to handle the Big Data revolution. You will learn the difference between Azure Data Lake, SSIS, Hadoop and Data Warehouse. You will be able to create Azure Data Lake Gen1 storage account, populate it will data and analyze it using U-SQL Language. Microsoft Azure Data Factory - You will understand Azure Data Factory's key components and advantages. You will be able to create, schedule and monitor simple pipelines.
Hadoop Basics You will learn a fundamental understanding of the Hadoop Ecosystem and 3 main building blocks. This module will prepare you to start learning Big Data in Azure Cloud using HDInsight.
Microsoft HDInsight - You will learn what are the challenges with Hadoop and how HDInsight solves these challenges. You will also learn Cluster types, HDInsight Architecture and other important aspects of Azure HDInsight.
You will also go through demo where well fetch data from Data Lake, process it through Hive and later will store data in SQL Server.
Some students FeedbackOne of the most amazing courses i have ever taken on Udemy. Please don't hesitate to take this course. The instructor is really professional and has a great experience about the subject of the course. - Khadija BadaryVery nicely explained mos

Time: 33.5h

Instructor Details

Eshant Garg

4.6 Rating
269 Reviews

13 years of extensive professional experience with expertise in Microsoft Database and Business Intelligence Solutions, Advanced Analytics, Reporting and Azure cloud computing technologies
CERTIFICATIONS
- DP-200: Implementing an Azure Data Solution
- DP-201: Designing an Azure Data Solution
- Microsoft Certified Technology specialist (MCTS) SQL Server Database development
- Information Technology Infrastructure Library (ITIL V3) Certified
SPECIALITY
Azure : Data Lake, Data Factory, Synapse Analytics (DW), PolyBase, Stream Analytics & Storage
Big Data Tech : HDInsgiht, Databricks, CosmosDB, Hadoop, Spark, PySpark, Hive, Sqoop
Database versions : Microsoft SQL Server 2005-2016, NoSQL
Languages : T-SQL, USQL, Python, MDX, DAX, PySpark
BI Tools : SSRS, SSIS, SSAS, Power BI

I have been messing around with data for more than a decade now, I love to work on Database internals, performance tuning, and optimization, Database design, modeling, and implementation especially using Microsoft SQL Server and Azure database and analytics technologies.
As a developer and architect, I have worked closely with customers, users, and colleagues to support business solutions across a variety of industries including healthcare, insurance, finance, and government ranging from small companies to fortune 500 companies. These experiences provided opportunities to see varied implementations, troubleshoot performance-r