Skip to content
UdemyHadoopPaid courseAll LevelsCertificate

Apache Spark Core and Structured Streaming 3.0 In-Depth (Udemy.com)

In-Depth, Hands-On driven exposure to the features and concepts of Spark Core with tips on tuning its performance

Created by: Amit Ranjan

Last updated May 2024

icon
What you will learn

  • Strong focus on the practicality by getting into hands-on mode with plentiful of examples
  • Develop in-depth understanding of the underlying concepts the core of Apache Spark
  • Know the ways to get the best performance from Spark in production
  • Avoid the common pitfalls when writing Spark applications
  • In Depth exploration of Spark Structured Streaming 3.0 using Python API.
  • Get introduced to Apache Kafka on a high level in the process.
  • Understand the nuances of Stream Processing in Apache Spark
  • Discover various features Spark provides out of the box for Stream Processing

How it compares

Against the other 150 rated Udemy courses in Hadoop on CourseDuck:

  • Rating4.5 out of 5higher than 68% of them
  • Reviews394#75 of 151 by number of reviews
  • Length13.8 hourslonger than 80% of them
  • Last updatedMay 2024more recently than 58% of them

icon
Course Description

Apache Spark has turned out to be the most sought-after skill for any big data engineer. An evolution of MapReduce programming paradigm, Spark provides unified data processing from writing SQL to performing graph processing to implementing Machine Learning algorithms. It effectively uses cluster nodes and better memory management to spread the load across cluster of nodes to get faster results. Apache Spark drives the mission of data-driven-decision-making in thousands of organizations.

In order to fairly appreciate the benefits of the libraries of Apache Spark, it is essential to know the foundations right. This course aims exactly at that part. It starts from the beginner level and gradually explains all the complex concepts in an easy to reflect manner. It gives a profound description of the features and working of the framework through 5 different use cases with detailed hands on implementations. In fact, some hands-on sessions and solutions to the use-cases are explained in a full classroom mode with videos extending over 40 mins. After taking this course, you will gain the expertise on Spark Core and usage of further libraries like Spark SQL, Structured Streaming, Spark ML and GraphX will be much easier to visualize, implement and optimize.


This illustrative course will build your foundational knowledge. You will learn the differences between batch & stream processing, programming model, the APIs and the challenges specific to stream processing. Quickly we'll move to understand the concepts of stream processing with wide varieties of examples & hands-on, dealing with inner working and taking a use case towards the end. All of this activity will be on cloud using Spark 3.0.

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Amit Ranjan

Amit is a Senior Big Data Engineer and Tech Instructor. He has expertise in data management, platform development, and data analysis, using a wide array of technologies including Apache Spark, Apache Beam, Google Cloud Platform, and Amazon Web Services. He has led projects developing data-driven solutions for clients in diverse industries, leading to significant cost savings, increased user engagement, and the establishment of data-centric cultures.

He has dealt with huge volume of data, handling the storage and processing challenges. His portfolio includes working with multiple companies including Spotify (the music streaming service giant), Rakuten (one of the largest e-commerce company in Japan), Uber (the most used on-demand cab and delivery provider) and Apple. He has been a mentor to hundreds of professionals and his videos have helped thousands of learners.

icon
More Hadoop courses

$11.99

$12.99

$14.99

$94.99

$10.99

$39.99

icon
Reviews

4.5

394 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Aleksandar Petrovic on 1/24/2024

I have watched many tutorials about pyspark, but this is by far the best, an excellent teacher who explains every detail clearly and in detail in a very comprehensible way. I recommend this tutorial to everyone, even those who think they know pyspark, I think they will learn a lot here.

By Ronit Dhingra on 4/30/2023

Very Amateur explanation. Most of the times, the guy himself is confused on what is happening. Only Covered easy things, most of the complicated and core explanation is skipped. Wont recommend spending money

By Anonymized User on 11/13/2022

It covers the main fundamentals required to understand how spark works. Even with simple examples, author has covered how spark internally works to produce the desired results. A good course to opt for if someone is looking for strong fundamentals in spark.

By Saieswar Maroju on 10/24/2022

Course is excellent, When do you plan Data Frame and cloud related concepts. Eagerly waiting!

By Anonymized User on 8/10/2022

Amazing, very well explained (sometimes confused) but you feel his expertise on the subject!

By Anil Karnam on 7/7/2022

So much informative . I was thinking I know spark well but after taking up this course came to know so many more things and basics on how it works internally . Amazing

By Sankalp Sood on 5/4/2022

Learned alot but there are somethings which have been mentioned in interview but not in actual lecture.. one of the example is Dataframe... Please provide a course in Dataframe because the way you deliver is awesome.. I would lik tot take course may be small too because most od the concepts are explained in this course and an Data Engineer must know both the API's .. But Dataframe api if you explain, would be a great help.. Regardless... Thankyou alot..

By Rajesh on 5/13/2021

Spark concepts are well explained! Since RDDs are the building blocks for dataframes, it's important to understand how these work. All these and many more concepts are shown with detailed examples. A must refer course if you want to understand Spark. However, this course can't be called spark 3 as 3.0 is all about dataframes and not RDD

By Amit Priyadarshi on 8/30/2020

Well, This course deserved to be the best selling on the core spark concepts.. Every single topic is covered in so much depth with so detailed explanation that one can start visualizing himself the solution to the related problems. Most of the other courses which I have taken tells how things are done.. this one tells why that is done. Classes on performance, caching, broadcast variables are just awesome. Two feedback I had to improve more upon this course if you can take positively 1) Examples - Though it is very clear that you have a vast experience on spark, You should have taken some good examples from actual experiences..minimum you can take examples of products, customers, addresses which a professional can relate with.. Ideally start with these tables, stick from beginning to end then only one can relate all, like an use case.. Changing examples with different sections and taking example like Dogs and Cats kind of doesn't make any sense and are very random in nature for core concept building. 2) The interview part in the last section, I am sure you used for marketing purpose and left it free to watch, but in my view that is doing reverse. That is not really justifying the level of contents, depth inside the course. Overall an awesome course for sure.

By Vinay Gupta on 8/22/2020

This is a very nice course with advanced concepts of spark covered with examples. I would like to recommend this course to others.

Showing all 10 reviews on CourseDuck

Read all 394 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 90 / 100