Apache Spark 3 - Real-time Stream Processing using Scala (Udemy.com)
Learn to create Real-time Stream Processing applications using Apache Spark
Created by: Prashant Kumar Pandey
Last updated January 2023
What you will learn
- Real-time Stream Processing Concepts
- Spark Structured Streaming APIs and Architecture
- Working with File Streams
- Working With Kafka Source and Integrating Spark with Kafka
- State-less and State-full Streaming Transformations
- Windowing Aggregates using Spark Stream
- Watermarking and State Cleanup
- Streaming Joins and Aggregation
- Handling Memory Problems with Streaming Joins
- Creating Arbitrary Streaming Sinks
How it compares
Against the other 150 rated Udemy courses in Hadoop on CourseDuck:
- Rating4.7 out of 5higher than 91% of them
- Reviews521#67 of 151 by number of reviews
- Length4.3 hoursshorter than 68% of them
- Last updatedJanuary 2023earlier than 52% of them
Course Description
About the Course
I am creating Apache Spark 3 - Real-time Stream Processing using the Scala course to help you understand the Real-time Stream processing using Apache Spark and apply that knowledge to build real-time stream processing solutions. This course is example-driven and follows a working session like approach. We will be taking a live coding approach and explain all the needed concepts along the way.
Who should take this Course?
I designed this course for software engineers willing to develop a Real-time Stream Processing Pipeline and application using the Apache Spark. I am also creating this course for data architects and data engineers who are responsible for designing and building the organization’s data-centric infrastructure. Another group of people is the managers and architects who do not directly work with Spark implementation. Still, they work with the people who implement Apache Spark at the ground level.
Spark Version used in the Course
This Course is using the Apache Spark 3.x. I have tested all the source code and examples used in this Course on Apache Spark 3.0.0 open-source distribution.
Instructor Details
- 4.7 Rating
521 Reviews
Prashant Kumar Pandey
Prashant Kumar Pandey has spent over 25 years in IT as a developer, architect, consultant, trainer, and mentor, working with international software services organisations on data-centric, Big Data, and AI projects. That production experience — not just theory — is what shapes how he teaches Databricks, Spark, and cloud data engineering today.
He is the founder, lead author, and chief editor of ScholarNest, a skill-development platform offering courses, training, and technical articles since 2018. He also publishes free training content on his YouTube channel, Learning Journal, and writes for a following of 43,000+ data engineering professionals on LinkedIn.
Prashant is a firm believer in lifelong, continuous learning. Alongside his course work, he authors technical books and articles to help IT professionals and students close the gap between the skills they have and the skills the industry actually needs — the same gap this course is built to close.
More courses by Prashant Kumar Pandey
PySpark - Apache Spark Programming for Beginners (2026)
4.7 (17,491 Reviews)
Provider: Udemy
Time: 28.5h
$89.99
Apache Spark - Beyond Basics and Cracking Job Interviews (2024)
4.7 (5,132 Reviews)
Provider: Udemy
Time: 4.1h
$11.99
Apache Spark Programming in Scala for Beginners (2026)
4.4 (3,470 Reviews)
Provider: Udemy
Time: 17.5h
$84.99
Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)
Provider: Udemy
Time: 11h
$10.99
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
More Hadoop courses
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)
Provider: Udemy
Time: 4h
$12.99
Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)
Provider: Udemy
Time: 4.8h
$14.99
Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)
Provider: Udemy
Time: 11h
$10.99
Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)
Provider: Udemy
Time: 7.3h
$39.99
Reviews
By Amit Singh on 2/10/2026
All concept in this course is taught is so simple language which is easily grasped by anybody. Am grateful of taking this course because it clears my all confusion around spark streaming terminology.
By Jaid Mirajkar on 6/29/2024
An excellent walkthrough of the entire spark structured streaming journey using hands-on examples and explanation of various concepts via well structured slides. Thanks a lot for the wonderful course Prashant.
By Khoa Nguyen on 1/17/2023
Not great for Linux/Mac users -- there are no available scripts for Linux/Mac users unfortunately. The lessons are nicely paced, but missing scripts for Mac is a blocker.
By Shriram.Adiga on 3/22/2022
Superb teaching by Prashanth. good and needful information is given in the course. really got helpful in current working project.
By Erick Vazquez Gonzalez on 11/22/2021
Explica de manera practica y teórica los temas del curso, y cuenta con material adicional que enriquecen los temas.
By Raju Gatla on 4/4/2021
Good explanation along with good real world use cases examples. After completing this course one can understand how real-time stream processing works. Sir request you to please share course material as well.
By Sumedha on 1/20/2021
Excellent!!! The course content is exceptional and on point. Prashant sir has explained each and every topic in detail. Thank you so much for this informative course.
By Krishnaiah C on 1/10/2021
Thank you Prashant for the Course , I thoroughly enjoyed the course starting from ending with out any boring stuff. it's very details with concepts with real time practical examples, it's worthful and much useful in the current project. Once again i would thank you for the course. It's much recommended for the spark guy's
By Samuel Kumar on 1/5/2021
Very nicely explained, simple and easy to understand. Most of the topics were covered. I wish there is an addition of other modules to compliment in the course like Kudu, Storm, Beam. I am very happy with the resources provided as well. I wish to see another new extension to this course in the coming days. Instructor has a very neutral speech and easy to grasp. I would recommend this course if you're looking for Spark 3.
By Miodrag Stanić on 12/19/2020
So far so good, Prashant is an excellent teacher, he always dissolves the things to atoms so nothing remains unclear.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 94 / 100










