Apache Kafka - Real-time Stream Processing (Master Class) (Udemy.com)
Processing Real-time Streams using Apache Kafka and Kafka Streams API - Start as Beginner to Finish as PRO
Created by: Prashant Kumar Pandey
Last updated January 2023
What you will learn
- Apache Kafka Foundation and Kafka Architecture
- Creating Streams using Kafka Producer APIs
- Designing, Developing and Testing Real-time Stream Processing Applications using Kafka Streams Library
- Kafka Streams Architecture, Streams DSL, Processor API and Exactly Once Processing in Apache Kafka
- Auto-generating Java Objects from JSON Schema definition, Serializing, Deserializing and working with JSON messages without Schema Registry.
- Auto-generating Java Objects from AVRO Schema definition, Serializing, Deserializing and working with AVRO messages using Confluent Schema Registry.
- Unit Testing and Integration Testing your Kafka Streams Application.
- Supporting Microservices architecture and implementing Kafka Streams Interactive Query.
How it compares
Against the other 150 rated Udemy courses in Hadoop on CourseDuck:
- Rating4.8 out of 5higher than 96% of them
- Reviews2,925#26 of 151 by number of reviews
- Length11 hourslonger than 72% of them
- Last updatedJanuary 2023earlier than 53% of them
Course Description
This course does not require any prior knowledge of Apache Kafka. We have taken enough care to explain all necessary and complex Kafka Architecture concepts to help you come up to speed and grasp the content of this course.
About the Course
I am creating Kafka Streams - Real-time Stream Processing to help you understand the stream processing in general and apply that knowledge to Kafka Streams Programming. This course is based on my book on the same subject with the same title. My Book is already published and is available with all major online retailers as an eBook and Paperback.
My approach to creating this course is a progressive common-sense approach to teaching a complex subject. By using this unique approach, I will help you to apply your general ability to perceive, understand, and reason the concepts progressively that I am explaining in this course.
Who should take this Course?
Kafka Streams - Real-time Stream Processing course is designed for software engineers willing to develop a stream processing application using the Kafka Streams library. I am also creating this course for data architects and data engineers who are responsible for designing and building the organization’s data-centric infrastructure. Another group of people is the managers and architects who do not directly work with Kafka implementation, but they work with the people who implement Kafka Streams at the ground level.
Kafka Version used in the Course
This course is using the Kafka Streams library available in Apache Kafka 2.x. I have tested all the source code and examples used in this course on Apache Kafka 2.3 open source distribution. Some examples of this course also make use of the Confluent Community Version of Kafka. We will be using Confluent Community Version to explain and demonstrate functionalities that are only available in the Confluent Platform, such as Schema Registry and Avro Serdes.
Source Code, Development IDE, Build Tool, Logging, and Testing Tools
This course is fully example-driven, and I will be creating many examples in the class. The source code files for all the examples are included in your study material.
This course will be making extensive use of IntelliJ IDEA as the preferred development IDE. However, based on your prior experience, you should be able to work with any other IDE designed for Java application development.
This course will be using Apache Maven as the preferred build tool. However, based on your prior experience, you should be able to use any other build tool designed for Java applications.
This course also makes use of Log4J2 to teach you industry-standard log implementation in your application.
We will be using JUnit5, which is the latest version of JUnit for implementing Unit Test Cases.
Example and Exercises
Working examples and exercises are the most critical tool to convert your knowledge into a skill. I have already included a lot of examples in the course. This course also consists of objective questions and some programming assignments as and when appropriate. These exercises will help you to validate and check your concepts and apply your learning to solve programming problems.
Instructor Details
- 4.8 Rating
2,925 Reviews
Prashant Kumar Pandey
Prashant Kumar Pandey has spent over 25 years in IT as a developer, architect, consultant, trainer, and mentor, working with international software services organisations on data-centric, Big Data, and AI projects. That production experience — not just theory — is what shapes how he teaches Databricks, Spark, and cloud data engineering today.
He is the founder, lead author, and chief editor of ScholarNest, a skill-development platform offering courses, training, and technical articles since 2018. He also publishes free training content on his YouTube channel, Learning Journal, and writes for a following of 43,000+ data engineering professionals on LinkedIn.
Prashant is a firm believer in lifelong, continuous learning. Alongside his course work, he authors technical books and articles to help IT professionals and students close the gap between the skills they have and the skills the industry actually needs — the same gap this course is built to close.
More courses by Prashant Kumar Pandey
PySpark - Apache Spark Programming for Beginners (2026)
4.7 (17,491 Reviews)
Provider: Udemy
Time: 28.5h
$89.99
Apache Spark - Beyond Basics and Cracking Job Interviews (2024)
4.7 (5,132 Reviews)
Provider: Udemy
Time: 4.1h
$11.99
Apache Spark Programming in Scala for Beginners (2026)
4.4 (3,470 Reviews)
Provider: Udemy
Time: 17.5h
$84.99
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Python Programming - Foundation Course for Data Engineers (2024)
4.6 (1,417 Reviews)
Provider: Udemy
Time: 4.4h
$11.99
More Hadoop courses
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)
Provider: Udemy
Time: 4h
$12.99
Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)
Provider: Udemy
Time: 4.8h
$14.99
Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)
Provider: Udemy
Time: 7.3h
$39.99
PySpark - Apache Spark Programming for Beginners (2026)
4.7 (17,491 Reviews)
Provider: Udemy
Time: 28.5h
$89.99
Reviews
By Ebrahim Saed on 1/31/2026
This course exceeded my expectations! The instructor explains complex topics clearly and in a well-structured way, making it easy to follow along. The lessons are engaging, and the examples are practical and relevant By the end, I felt confident in Kafka streams processing, and I can already apply what I’ve learned. Highly recommended for anyone looking to learn Kafka Streams APIs!
By Shaikh Javed on 5/24/2025
Superb course. Learnt everything about kafka core, kafka streams and schema management. A superb course that packs everything with detailed structured step by step covering of topics and explanations. i wish the trainer can bring courses on machine learning/deep learning etc. or other kafka topics or system design
By Andres Ramilo on 7/30/2023
This is a really good course. The instructor explains the inner workings of Kafka Streams and always demonstrate with practical examples. It's really worth it. As a suggestion, the instructor could also create a course on KSQLDB using the same methodology presented here, it would be really nice.
By Anonymized User on 9/14/2022
Before taking this course I knew a little about Kafka and no experience with Java. Through this Kafka course I've gained a basic understanding of Java and further developed my knowledge of Apache Kafka. The instructor explains things methodically and as you progress through the course concepts taught earlier make more sense. I'm excited to start my first Kafka project. Thank you for sharing your knowledge!
By Hyder on 11/14/2020
looks better
By Sujatha Tumu on 11/7/2020
Very Nice explanation of aggregation and time window concepts in an easy way to understand. sequence of concepts in these sections are very well organized
By Abhish Lohithan on 11/7/2020
Recommend this course for learning the fundamentals and in understanding the working of kafka in detail. Great explanations and real world examples which is very helpful.
By Gouri Sankar Pathy on 10/24/2020
pace, expectation and assurance..
By VAnish Last Name on 10/23/2020
You rock..as you have articulated each topic in detail which makes it interesting and engaging. This can be seen in the effort which you have taken with your slides. Great job and thank you so much
By Mandar Ghodke on 10/18/2020
Truly in-depth teaching.
By Debsubhra Roy on 10/17/2020
A beautifully structured course. The explanation and walkthrough of each project is just fabulous.
By Samson Samuel on 10/11/2020
All concepts are explained in a very clear manner. There is a lot and lot to take away from this session. I am truly overwhelmed with the abundance of information and knowledge this class offered. The best class to attend to learn Kafka Streams. Can't wait for sessions on KSQLDB and Kafka Connect from Mr. Prashant Pandey. A great teacher.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 96 / 100










