Skip to content
UdemyHadoopPaid courseAll LevelsCertificate

Spark Project on Cloudera Hadoop(CDH) and GCP for Beginners (Udemy.com)

Building Data Processing Pipeline Using Apache NiFi, Apache Kafka, Apache Spark, Cassandra, MongoDB, Hive and Zeppelin

Created by: PARI MARGU

Last updated April 2021

icon
What you will learn

  • Complete Spark Project Development on Cloudera Hadoop and Spark Cluster
  • Fundamentals of Google Cloud Platform(GCP)
  • Setting up Cloudera Hadoop and Spark Cluster(CDH 6.3) on GCP
  • Features of Spark Structured Streaming using Spark with Scala
  • Features of Spark Structured Streaming using Spark with Python(PySpark)
  • Fundamentals of Apache NiFi
  • Fundamentals of Apache Kafka
  • How to use NoSQL like MongoDB and Cassandra with Spark Structured Streaming
  • How to build Data Visualisation using Python
  • Fundamentals of Apache Hive and how to integrate with Apache Spark
  • Features of Apache Zeppelin
  • Fundamentals of Docker and Containerization

How it compares

Against the other 150 rated Udemy courses in Hadoop on CourseDuck:

  • Rating3.7 out of 5higher than 10% of them
  • Reviews124#109 of 151 by number of reviews
  • Length10.9 hourslonger than 72% of them
  • Last updatedApril 2021earlier than 62% of them

icon
Course Description

  • In retail business, retail stores and eCommerce websites generates large amount of data in real-time.

  • There is always a need to process these data in real-time and generate insights which will be used by the business people and they make business decision to increase the sales in the retail market and provide better customer experience.

  • Since the data is huge and coming in real-time, we need to choose the right architecture with scalable storage and computation frameworks/technologies.

  • Hence we want to build the Data Processing Pipeline Using Apache NiFi, Apache Kafka, Apache Spark, Apache Cassandra, MongoDB, Apache Hive and Apache Zeppelin to generate insights out of this data.

  • The Spark Project is built using Apache Spark with Scala and PySpark on Cloudera Hadoop(CDH 6.3) Cluster which is on top of Google Cloud Platform(GCP).

  • Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming clusters with implicit data parallelism and fault tolerance.

    Apache Kafka is a distributed event store and stream-processing platform. It is an open-source system developed by the Apache Software Foundation written in Java and Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.

    Apache Hadoop is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.

    A NoSQL (originally referring to "non-SQL" or "non-relational") database provides a mechanism for storage and retrieval of data that is modeled in means other than the tabular relations used in relational databases.

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

PARI MARGU

Data Engineer(Big Data/Hadoop, Apache Spark, Python) cum Freelance Consultant, YouTube Creator. Having 12+ years of experience in implementing solutions to the enterprise clients and having strong Framework skills to implement complex business solutions. Worked on, Web, Windows, Mobile and Hadoop/Big Data, Apache Spark applications. Having 6+ years of experience with Hadoop/Big Data, Apache Spark Framework. Worked on Hadoop distributions like Cloudera CDH, Apache Hadoop.

icon
More courses by PARI MARGU

$44.99

$10.99

icon
More Hadoop courses

$11.99

$12.99

$14.99

$94.99

$10.99

$39.99

icon
Reviews

3.7

124 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Serge Hodor on 3/17/2022

Poor audio quality as well as too many parasite words such as "ok". Besides, only at video 7 is a notification that the Cloudera environment, as well as GCP, won't be available due to some changes in their business models/licensing. This change makes this course almost irrelevant as the value (at least for me) was in leveraging Cloudera and GCP.

By Daneshwaran M on 10/19/2021

Zero Support the courses asks to refer his own youtube videos cloudera platform not available asks to install everything on th vm and no support or vidoes for that path

By Chaitanya Gokhale on 6/29/2021

You need to record this course again with proper audio. There were lot of background noise in the video, and you need to work on your English as well. You can copy the English transcript of each video into Grammarly tool for any errors and then read the same transcript again that will be much better for listeners. Please redo all the videos.

By Anonymized User on 6/21/2021

Instructor has good knowledge, but at times, repeat the same thing again and again. This can be improved, but not a stopper.

By Shree Vidhya Sampath on 3/20/2021

This course is a must buy if one wants to learn about big data. The project on building data pipeline is amazing and helped me to understand a lot more. The instructor explains things in a simple way and also responds quickly to my questions. It will be easier if the environment is set up with the correct versions as mentioned in this course. It took a lot of time for me to set up ,debug and get my project working as I had a lot of issues after installing latest versions. Though it took time, I definitely learnt a lot from this course. Thank you very much.

By Rohit Rajaram Chavan on 1/16/2021

This course was best for learn live data pipeline project with cloud platform. each and every basic step cover from configuration to build live data pipeline which was amazing.. Thank you so much for this informative course

By Deepak Garg on 9/8/2020

This is the course which i was looking for and finally my search ends. Detailed explanation in simple way. Must buy this course.

By Donatas Norkus on 7/14/2020

The videos are hardly edited and that makes them much longer than they should be. The demo at the end of the project "pulled" this course out of my refund basket.

By PyDoo ? on 3/14/2020

Yes, this is one of the amazing course for Big data. Especially the big data pipeline project is amazing and I was very much happy to learn building pipeline and it helped me to do more. It would be great if instructor also adds some videos on DStreams. But I would say that "this course should not be missed". Highly recommended.

By new learner on 2/20/2020

Good covarage of all topics and quality content. Only thing we are missing here is schedule data pipelines with Airflow and monitor and debug production pipelines and datalake. Hope to see more Spark Video projects

Showing all 10 reviews on CourseDuck

Read all 124 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 74 / 100