Apache Spark Project for Beginners: A Complete Project Guide (Udemy.com)
Real-Time Message Processing Application
Created by: PARI MARGU
Last updated February 2020
What you will learn
- End to End Apache Spark Project Development
- How Real-Time Streaming Application Works
- Features of Spark Structured Streaming using Scala
- How Apache Kafka works well with Apache Spark
- How to make use of NoSQL like MongoDB and RDBMS like MySQL in Real-Time Streaming Application
- How to build nice Visualisation Dashboard using Python
How it compares
Against the other 150 rated Udemy courses in Hadoop on CourseDuck:
- Rating4.1 out of 5higher than 24% of them
- Reviews62#129 of 151 by number of reviews
- Length2.5 hoursshorter than 89% of them
- Last updatedFebruary 2020earlier than 72% of them
Course Description
End to End Project Development of Real-Time Message Processing Application: In this Apache Spark Project, we are going to build Meetup RSVP Stream Processing Application using Apache Spark with Scala API, Spark Structured Streaming, Apache Kafka, Python, Python Dash, MongoDB and MySQL. And we are going to build a data pipeline which takes data from stream data source(Meetup Dot Com RSVP Stream API Data) to Data Visualisation using Apache Spark and other big data frameworks.
Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming clusters with implicit data parallelism and fault tolerance.
Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written in Java and Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.
Apache Hadoop is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.
A NoSQL (originally referring to "non-SQL" or "non-relational") database provides a mechanism for storage and retrieval of data that is modeled in means other than the tabular relations used in relational databases.
Instructor Details
- 4.1 Rating
62 Reviews
PARI MARGU
Data Engineer(Big Data/Hadoop, Apache Spark, Python) cum Freelance Consultant, YouTube Creator. Having 12+ years of experience in implementing solutions to the enterprise clients and having strong Framework skills to implement complex business solutions. Worked on, Web, Windows, Mobile and Hadoop/Big Data, Apache Spark applications. Having 6+ years of experience with Hadoop/Big Data, Apache Spark Framework. Worked on Hadoop distributions like Cloudera CDH, Apache Hadoop.
More courses by PARI MARGU
Spark Project on Cloudera Hadoop(CDH) and GCP for Beginners (2021)
3.7 (124 Reviews)
Provider: Udemy
Time: 10.9h
$54.99
Real Time Spark Project for Beginners: Hadoop, Spark, Docker (2020)
3.7 (96 Reviews)
Provider: Udemy
Time: 6.6h
$44.99
More Hadoop courses
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)
Provider: Udemy
Time: 4h
$12.99
Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)
Provider: Udemy
Time: 4.8h
$14.99
Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)
Provider: Udemy
Time: 11h
$10.99
Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)
Provider: Udemy
Time: 7.3h
$39.99
Reviews
By Hadoop Spark on 12/17/2022
Good place to start on big data use case.
By Jai lohana on 10/30/2021
sound quality can be made alot better and also keeping in mind that it should be a little more in a detailed way like explaining what we have to do and how we have to follow the instructor rather than expecting from us to be ready with the pre requisites so a better explanation is required over there
By Manmohan Avinash Pusadkar on 9/24/2020
Got knowledge about spark mongodb kafta
By Sirish Karthik Naraharisetti on 8/22/2020
The course is great and it's nice to get an idea of building data pipeline in realtime
By Francisco Tena Flórez on 3/23/2020
enough to get in touch with apache spark along with a little bit of kafka in the producer side. I wish I would have seen more content about hadoop also.
By Amol Magar on 2/19/2020
Good Mongodb Course very nicely explained.
By Sathishkumar Govindasamy on 2/18/2020
Thank you pari for sharing your valuable knowledge.The course and teaching methodology are really impressive.
By Jagadish Gaglani on 2/2/2020
voice recording is very poor.Cant hear the trainer voice most of the time
By Suresh Rajagopal on 1/30/2020
This is good for beginners who want to understand on Kafka, Spark Streaming with live data.
By Sai Bala abhishek on 1/17/2020
This course was very helpful for beginners like me. thanks very much for sharing this.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 82 / 100








