Big Data Essentials: HDFS, MapReduce and Spark RDD

This specialization is made for people working with data (either small or big). If you are a Data Analyst, Data Scientist, Data Engineer or Data Architect (or you want to become one) " don't miss the opportunity to expand your knowledge and skills in the field of data engineering and data analysis on the large scale.In four concise courses you will learn the basics of Hadoop, MapReduce, Spark, methods of offline data processing for warehousing, real-time data processing and large-scale machine learning. And Capstone project for you to build and deploy your own Big Data Service (make your portf

( 102 Reviews )

Created by: Ivan Puzyrevskiy

Quality Score

Content Quality

Video Quality

Qualified Instructor

Course Pace

Course Depth & Coverage

Overall Score : 68 / 100

Course Description

Have you ever heard about such technologies as HDFS, MapReduce, Spark? Always wanted to learn these new tools but missed concise starting material? Don't miss this course either!In this 6-week course you will:- learn some basic technologies of the modern Big Data landscape, namely: HDFS, MapReduce and Spark;- be guided both through systems internals and their applications;- learn about distributed file systems, why they exist and what function they serve;- grasp the MapReduce framework, a workhorse for many modern Big Data applications;- apply the framework to process texts and solve sample business cases;- learn about Spark, the next-generation computational framework;- build a strong understanding of Spark basic concepts;- develop skills to apply these tools to creating solutions in finance, social networks, telecommunications and many other fields.Your learning experience will be as close to real life as possible with the chance to evaluate your practical assignments on a real cluster. No mocking, a friendly considerate atmosphere to make the process of your learning smooth and enjoyable.Get ready to work with real datasets alongside with real masters!Special thanks to:- Prof. Mikhail Roytberg, APT dept., MIPT, who was the initial reviewer of the project, the supervisor and mentor of half of the BigData team. He was the one, who helped to get this show on the road.- Oleg Sukhoroslov (PhD, Senior Researcher at IITP RAS), who has been teaching MapReduce, Hadoop and friends since 2008. Now he is leading the infrastructure team.- Oleg Ivchenko (PhD student APT dept., MIPT), Pavel Akhtyamov (MSc. student at APT dept., MIPT) and Vladimir Kuznetsov (Assistant at P.G. Demidov Yaroslavl State University), superbrains who have developed and now maintain the infrastructure used for practical assignments in this course.- Asya Roitberg, Eugene Baulin, Marina Sudarikova. These people never sleep to babysit this course day and night, to make your learning experience productive, smooth and exciting.

Time: 45h

Instructor Details

Ivan Puzyrevskiy

3.4 Rating
102 Reviews

A teacher at the Yandex School of Data Analysis, Ivan leads seminars on the analysis of internet data, and also organises project work in the National Research University Higher School of Economics' Faculty of Computer Science. At Yandex he heads a group developing the YT platform for distributed computing and data processing. Having started out in machine translation and natural language text processing, his interests currently are about big data.

Apache Kafka Series - Kafka Cluster Setup & Administration

Apache Kafka Series - Kafka Cluster Setup & Administration (2021)
4.8 (288 Reviews)

- Provider: Udemy
- Time: 4h

$11.99

Apache Kafka Series - Confluent Schema Registry & REST Proxy

Apache Kafka Series - Confluent Schema Registry & REST Proxy (2021)
4.8 (271 Reviews)

- Provider: Udemy
- Time: 4.5h

$11.99

Apache Spark for Java Developers (2021)
4.8 (195 Reviews)

- Provider: Udemy
- Time: 21.5h

$11.99

Apache Kafka - Real-time Stream Processing (Master Class)

Apache Kafka - Real-time Stream Processing (Master Class) (2021)
4.8 (117 Reviews)

- Provider: Udemy
- Time: 11h

$11.99

Apache Kafka Series - Kafka Monitoring & Operations

Apache Kafka Series - Kafka Monitoring & Operations (2021)
4.8 (98 Reviews)

- Provider: Udemy
- Time: 5h

$11.99

Apache Kafka for absolute beginners (2021)
4.7 (172 Reviews)

- Provider: Udemy
- Time: 5h

$11.99

All hadoop courses

Reviews

3.4

102 total reviews

5 star 4 star 3 star 2 star 1 star

Write a Review

By Carlos S G on 15-Nov-18

There are a lot of unclear things about the homeworks. So even when you can run your homework successfully in the docker image, you still can't pass the online tests. Besides, the error msgs shown by online test system (not logs) are also unclear. It can't tell you the real reason of failure.

By Michael S on 14-Sep-19

No support at all from the team, exercise description often imprecise, wrong formulas have been used.

By Yannic H on 13-Aug-19

I don't even know where to begin...The English is super hard to understand, the documents which are needed for working with the videos appear after the videos, the course jumps around with introducing knowledge and then just shrugs it off with a page of "yeah we know there are jumps here but please stay with us"

By Lorenzo M on 5-Aug-19

Some online tools that are really important for assignments do not work for days and noone in the stuff answers in the forum and neither in the slack channel dedicated to the course.

By Ratan J on 1-Aug-19

No support and badly worded problems.

By Li, H on 5-Jul-19

Too quick to follow

By Neeraj R on 19-Aug-18

no clear explanations.

By Jeremy K on 3-Apr-18

garbage

By Ali A M A on 1-Dec-17

Not fitted to me and i need to cancel my subscription at the earliest

By Nathan V on 1-Mar-18

extremely difficult to understand some of the trainers, lots of errors, hard to follow material presented, lots of material tested but not covered well in training.

By Kirill P on 3-Jun-19