CourseraHadoopFree courseCertificate

Big Data Analysis: Hive, Spark SQL, DataFrames and GraphFrames

This specialization is made for people working with data (either small or big). If you are a Data Analyst, Data Scientist, Data Engineer or Data Architect (or you want to become one) " don't miss the opportunity to expand your knowledge and skills in the field of data engineering and data analysis on the large scale.In four concise courses you will learn the basics of Hadoop, MapReduce, Spark, methods of offline data processing for warehousing, real-time data processing and large-scale machine learning. And Capstone project for you to build and deploy your own Big Data Service (make your portf

3.5

29 reviews

Created by: Alexey A. Dral

Quality Score

Content Quality

Video Quality

Qualified Instructor

Course Pace

Course Depth & Coverage

Overall Score : 70 / 100

Course Description

No doubt working with huge data volumes is hard, but to move a mountain, you have to deal with a lot of small stones. But why strain yourself? Using Mapreduce and Spark you tackle the issue partially, thus leaving some space for high-level tools. Stop struggling to make your big data workflow productive and efficient, make use of the tools we are offering you.This course will teach you how to:- Warehouse your data efficiently using Hive, Spark SQL and Spark DataFframes. - Work with large graphs, such as social graphs or networks. - Optimize your Spark applications for maximum performance.Precisely, you will master your knowledge in:- Writing and executing Hive & Spark SQL queries;- Reasoning how the queries are translated into actual execution primitives (be it MapReduce jobs or Spark transformations);- Organizing your data in Hive to optimize disk space usage and execution times;- Constructing Spark DataFrames and using them to write ad-hoc analytical jobs easily;- Processing large graphs with Spark GraphFrames;- Debugging, profiling and optimizing Spark application performance.Still in doubt? Check this out. Become a data ninja by taking this course!Special thanks to:- Prof. Mikhail Roytberg, APT dept., MIPT, who was the initial reviewer of the project, the supervisor and mentor of half of the BigData team. He was the one, who helped to get this show on the road.- Oleg Sukhoroslov (PhD, Senior Researcher at IITP RAS), who has been teaching MapReduce, Hadoop and friends since 2008. Now he is leading the infrastructure team.- Oleg Ivchenko (PhD student APT dept., MIPT), Pavel Akhtyamov (MSc. student at APT dept., MIPT) and Vladimir Kuznetsov (Assistant at P.G. Demidov Yaroslavl State University), superbrains who have developed and now maintain the infrastructure used for practical assignments in this course.- Asya Roitberg, Eugene Baulin, Marina Sudarikova. These people never sleep to babysit this course day and night, to make your learning experience productive, smooth and exciting.

Time: 70h

Instructor Details

Alexey A. Dral

3.5 Rating
29 Reviews

Alexey Dral is the Founder and CEO of BigData Team (https://bigdatateam.org/). He also the Head of Big Data and Machine Learning and the Senior Lecturer at Moscow Institute of Physics and Technologies. His 10 year working experience for the top Russian and international companies, including Amazon AWS, Yandex, Rambler and qualification on large-scale problems, leading R&D teams, defining strategy for the whole departments build up a great mentor with an aspiration to offer insights to his students. He teaches around the globe, launches new onsite and online courses to reduce the gap between industry and academia, supervise Data Science and Data Engineering initiatives. For instance, he is personally responsible for AI RoadMap at one of the biggest Russian financial institutes. Information about BigData Team. BigData Team provides 3 types of services: online course development, in-campus course development and BigData & Machine Learning research, development and consultations. BigData Team partners are the market leaders. For instance: - Yandex - the biggest Russian search engine company. We collaborate on online course development. See "Big Data for Data Engineers" Coursera specialization. - BigData Team provide courses and give lectures on Big Data and Machine Learning for top Russian universities (MSU, HSE, MIPT, ...) as well as for corporate clients (Sberbank, Megafon, -). BigData Team courses available on English (Harbour.Space University). BigData Team company is the edu

Big Data Applications: Machine Learning at Scale
3.5 (17 Reviews)

- Provider: Coursera
- Time: 76h

Free

All courses by Alexey A. Dral

More Hadoop courses

Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)

- Provider: Udemy
- Time: 22.4h

$11.99

Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)

- Provider: Udemy
- Time: 4h

$12.99

Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)

- Provider: Udemy
- Time: 4.8h

$14.99

Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)

- Provider: Udemy
- Time: 4.5h

$94.99

Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)

- Provider: Udemy
- Time: 11h

$10.99

Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)

- Provider: Udemy
- Time: 7.3h

$39.99

All Hadoop courses

Reviews

3.5

29 reviews in total

Select a bar to show only those reviews.Select the bar again to show every rating.

Write a review

By Григорьева on 4-Nov-19

Didn't like the course for several reasons:1. Mentors seem to leave the course. Do not expect any feedback from them.2. Notebooks are broken for months so you can't perform assignments without docker.3. Weeks are not consistent, the material quality differs enormally from week to week.

By Minh T on 29-Sep-19

Great!!!!

By Дюкарев В В on 16-Sep-19

This is 2nd course of specialization and its better than 1st, but big big problems with outer grader system is still there :(Another minus is that there is too much theory (graph algorithms especially) and too less practice, i think 1/10. You know theory is forgotten very fast. Nevertheless its good, valuable course for review of technologies

By ANNAMALAI A on 26-Aug-19

Few Environment not supporting frequently.

By Li W on 14-Aug-19

The biggest problem is the English speaking of lecturers, except week 6. It brings lots of difficulties to catch up with the notes and understand the ideas, auto subtitles even failed to translate in lots of places.However, content is really good since week 4.It will be great if the lecturers could illustrate or demonstrate the ideas instead of just reading the notes, as we all can read the notes.

By Aldrin on 30-Jul-19