Spark Project on Cloudera Hadoop(CDH) and GCP for Beginners (Udemy.com)
Building Data Processing Pipeline Using Apache NiFi, Apache Kafka, Apache Spark, Cassandra, MongoDB, Hive and Zeppelin
Created by: PARI MARGU
Last updated April 2021
What you will learn
- Complete Spark Project Development on Cloudera Hadoop and Spark Cluster
- Fundamentals of Google Cloud Platform(GCP)
- Setting up Cloudera Hadoop and Spark Cluster(CDH 6.3) on GCP
- Features of Spark Structured Streaming using Spark with Scala
- Features of Spark Structured Streaming using Spark with Python(PySpark)
- Fundamentals of Apache NiFi
- Fundamentals of Apache Kafka
- How to use NoSQL like MongoDB and Cassandra with Spark Structured Streaming
- How to build Data Visualisation using Python
- Fundamentals of Apache Hive and how to integrate with Apache Spark
- Features of Apache Zeppelin
- Fundamentals of Docker and Containerization
How it compares
Against the other 150 rated Udemy courses in Hadoop on CourseDuck:
- Rating3.7 out of 5higher than 10% of them
- Reviews124#109 of 151 by number of reviews
- Length10.9 hourslonger than 72% of them
- Last updatedApril 2021earlier than 62% of them
Course Description
In retail business, retail stores and eCommerce websites generates large amount of data in real-time.
There is always a need to process these data in real-time and generate insights which will be used by the business people and they make business decision to increase the sales in the retail market and provide better customer experience.
Since the data is huge and coming in real-time, we need to choose the right architecture with scalable storage and computation frameworks/technologies.
Hence we want to build the Data Processing Pipeline Using Apache NiFi, Apache Kafka, Apache Spark, Apache Cassandra, MongoDB, Apache Hive and Apache Zeppelin to generate insights out of this data.
The Spark Project is built using Apache Spark with Scala and PySpark on Cloudera Hadoop(CDH 6.3) Cluster which is on top of Google Cloud Platform(GCP).
Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming clusters with implicit data parallelism and fault tolerance.
Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written in Java and Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.
Apache Hadoop is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.
A NoSQL (originally referring to "non-SQL" or "non-relational") database provides a mechanism for storage and retrieval of data that is modeled in means other than the tabular relations used in relational databases.
Instructor Details
- 3.7 Rating
124 Reviews
PARI MARGU
Data Engineer(Big Data/Hadoop, Apache Spark, Python) cum Freelance Consultant, YouTube Creator. Having 12+ years of experience in implementing solutions to the enterprise clients and having strong Framework skills to implement complex business solutions. Worked on, Web, Windows, Mobile and Hadoop/Big Data, Apache Spark applications. Having 6+ years of experience with Hadoop/Big Data, Apache Spark Framework. Worked on Hadoop distributions like Cloudera CDH, Apache Hadoop.
More courses by PARI MARGU
Real Time Spark Project for Beginners: Hadoop, Spark, Docker (2020)
3.7 (96 Reviews)
Provider: Udemy
Time: 6.6h
$44.99
Apache Spark Project for Beginners: A Complete Project Guide (2020)
4.1 (62 Reviews)
Provider: Udemy
Time: 2.5h
$10.99
More Hadoop courses
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)
Provider: Udemy
Time: 4h
$12.99
Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)
Provider: Udemy
Time: 4.8h
$14.99
Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)
Provider: Udemy
Time: 11h
$10.99
Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)
Provider: Udemy
Time: 7.3h
$39.99
Reviews
By Serge Hodor on 3/17/2022
Poor audio quality as well as too many parasite words such as "ok". Besides, only at video 7 is a notification that the Cloudera environment, as well as GCP, won't be available due to some changes in their business models/licensing. This change makes this course almost irrelevant as the value (at least for me) was in leveraging Cloudera and GCP.
By Daneshwaran M on 10/19/2021
Zero Support the courses asks to refer his own youtube videos cloudera platform not available asks to install everything on th vm and no support or vidoes for that path
By Chaitanya Gokhale on 6/29/2021
You need to record this course again with proper audio. There were lot of background noise in the video, and you need to work on your English as well. You can copy the English transcript of each video into Grammarly tool for any errors and then read the same transcript again that will be much better for listeners. Please redo all the videos.
By Anonymized User on 6/21/2021
Instructor has good knowledge, but at times, repeat the same thing again and again. This can be improved, but not a stopper.
By Shree Vidhya Sampath on 3/20/2021
This course is a must buy if one wants to learn about big data. The project on building data pipeline is amazing and helped me to understand a lot more. The instructor explains things in a simple way and also responds quickly to my questions. It will be easier if the environment is set up with the correct versions as mentioned in this course. It took a lot of time for me to set up ,debug and get my project working as I had a lot of issues after installing latest versions. Though it took time, I definitely learnt a lot from this course. Thank you very much.
By Rohit Rajaram Chavan on 1/16/2021
This course was best for learn live data pipeline project with cloud platform. each and every basic step cover from configuration to build live data pipeline which was amazing.. Thank you so much for this informative course
By Deepak Garg on 9/8/2020
This is the course which i was looking for and finally my search ends. Detailed explanation in simple way. Must buy this course.
By Donatas Norkus on 7/14/2020
The videos are hardly edited and that makes them much longer than they should be. The demo at the end of the project "pulled" this course out of my refund basket.
By PyDoo ? on 3/14/2020
Yes, this is one of the amazing course for Big data. Especially the big data pipeline project is amazing and I was very much happy to learn building pipeline and it helped me to do more. It would be great if instructor also adds some videos on DStreams. But I would say that "this course should not be missed". Highly recommended.
By new learner on 2/20/2020
Good covarage of all topics and quality content. Only thing we are missing here is schedule data pipelines with Airflow and monitor and debug production pipelines and datalake. Hope to see more Spark Video projects
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 74 / 100








