Apache Spark with Scala - Hands On with Big Data! (Udemy.com)
Apache Spark tutorial with 20+ hands-on examples of analyzing large data sets, on your desktop or on Hadoop with Scala!
Created by: Sundog Education by Frank Kane
Last updated July 2026
Our take
Based on the ratings of 18,945 students, a sample of their written reviews and the syllabus, as the course stood in July 2026. No course pays to be reviewed.
Frank Kane's Spark course is about nine hours of hands-on examples in Scala, aimed at working programmers who want to run Spark on their own machine and then on a Hadoop cluster. The syllabus moves from RDDs to DataFrames and DataSets, then into cluster deployment on Amazon EMR, Spark ML, streaming, and GraphX. A short Scala crash course is included, but the requirements are clear that you need to already know how to program. Total beginners should start elsewhere.
Reviewers like Kane's pragmatic, no-nonsense teaching and say the examples are short enough to follow along and actually run. One reviewer went from zero Scala to using it at work. The complaints are consistent, though. A few students say the code is read out rather than explained, and that basics like how reduce works get glossed over. One reviewer found the advanced examples rushed compared with the early sections. One recent one-star review reports that the installation videos and the downloadable project files no longer match, so expect some fiddling during setup. Support from teaching assistants also draws the odd grumble.
With around 105,000 students and 19,000 reviews at 4.3 stars, this is a well-established course, and it was refreshed in July 2026, so the Spark 3 material is current. It is paid, and Kane's Python version covers much of the same ground if Scala isn't a requirement for you. For engineers who need Spark in Scala specifically, it is the sensible first pick.
Pros
- Over 20 runnable examples, from movie ratings to superhero degrees of separation, that reviewers say all work
- Covers the full stack: RDDs, DataFrames and DataSets, EMR clusters, Spark ML, streaming, and GraphX in nine hours
- Refreshed in July 2026 for Spark 3, IntelliJ, and Structured Streaming
- Kane's pragmatic ex-Amazon teaching style gets consistent praise for clarity and realism
Cons
- Some code is demonstrated rather than explained; beginners say functions like reduce are never properly unpacked
- A recent review says the installation videos and downloadable project files are out of sync
- Advanced examples feel rushed, and the only cloud covered is AWS
Frank is a very engaging teacher. I loved his pragmatic approach dosed with realism.
Listed as all levels, but it needs prior programming experience; the Scala crash course is a primer, not a first language.
What you will learn
- Develop distributed code using the Scala programming language
- Transform structured data using SparkSQL, DataSets, and DataFrames
- Frame big data analysis problems as Apache Spark scripts
- Optimize Spark jobs through partitioning, caching, and other techniques
- Build, deploy, and run Spark scripts on Hadoop clusters
- Process continual streams of data with Spark Streaming
- Traverse and analyze graph structures using GraphX
- Analyze massive data set with Machine Learning on Spark
Course content
10 sections · 69 lectures · 8.9 hours of video 6 quizzes, 4 articles
- 1Getting Started 2 free previews6 lectures · 1 quiz · 30 min
- 2Scala Crash Course [Optional]4 lectures · 1.1 hours
- 3Using Resilient Distributed Datasets (RDDs) 2 free previews13 lectures · 1 quiz · 1.5 hours
- 4SparkSQL, DataFrames, and DataSets9 lectures · 1 quiz · 1.1 hours
- 5Advanced Examples of Spark Programs 1 free preview11 lectures · 1.6 hours
- 6Running Spark on a Cluster 1 free preview9 lectures · 1 quiz · 1.2 hours
- 7Machine Learning with Spark ML 1 free preview6 lectures · 1 quiz · 48 min
- 8Intro to Spark Streaming6 lectures · 1 quiz · 42 min
- 9Intro to GraphX 1 free preview3 lectures · 18 min
- 10You Made It! Where to Go from Here.2 lectures · 6 min
Who it is for
The instructor says it suits
- Software engineers who want to expand their skills into the world of big data processing on a cluster
- If you have no previous programming or scripting experience, you'll want to take an introductory programming course first.
What you need before you start
- Some prior programming or scripting experience is required. A crash course in Scala is included, but you need to know the fundamentals of programming in order to pick it up.
- You will need a desktop PC and an Internet connection. The course is created with Windows in mind, but users comfortable with MacOS or Linux can use the same tools.
- The software needed for this course is freely available, and I'll walk you through downloading and installing it.
How it compares
Against the other 150 rated Udemy courses in Hadoop on CourseDuck:
- Rating4.3 out of 5higher than 43% of them
- Reviews18,945#2 of 151 by number of reviews
- Length8.9 hourslonger than 68% of them
- Last updatedJuly 2026more recently than 88% of them
Course Description
Completely updated and re-recorded for Spark 3, IntelliJ, Structured Streaming, and a stronger focus on the DataSet API.
“Big data" analysis is a hot and highly valuable skill – and this course will teach you the hottest technology in big data: Apache Spark. Employers including Amazon, EBay, NASA JPL, and Yahoo all use Spark to quickly extract meaning from massive data sets across a fault-tolerant Hadoop cluster. You'll learn those same techniques, using your own Windows system right at home. It's easier than you might think, and you'll be learning from an ex-engineer and senior manager from Amazon and IMDb.
Spark works best when using the Scala programming language, and this course includes a crash-course in Scala to get you up to speed quickly. For those more familiar with Python however, a Python version of this class is also available: "Taming Big Data with Apache Spark and Python - Hands On".
Learn and master the art of framing data analysis problems as Spark problems through over 20 hands-on examples, and then scale them up to run on cloud computing services in this course.
Learn the concepts of Spark's Resilient Distributed Datasets, DataFrames, and Datasets.
Get a crash course in the Scala programming language
Develop and run Spark jobs quickly using Scala, IntelliJ, and SBT
Translate complex analysis problems into iterative or multi-stage Spark scripts
Scale up to larger data sets using Amazon's Elastic MapReduce service
Understand how Hadoop YARN distributes Spark across computing clusters
Practice using other Spark technologies, like Spark SQL, DataFrames, DataSets, Spark Streaming, Machine Learning, and GraphX
By the end of this course, you'll be running code that analyzes gigabytes worth of information – in the cloud – in a matter of minutes.
We'll have some fun along the way. You'll get warmed up with some simple examples of using Spark to analyze movie ratings data and text in a book. Once you've got the basics under your belt, we'll move to some more complex and interesting tasks. We'll use a million movie ratings to find movies that are similar to each other, and you might even discover some new movies you might like in the process! We'll analyze a social graph of superheroes, and learn who the most “popular" superhero is – and develop a system to find “degrees of separation" between superheroes. Are all Marvel superheroes within a few degrees of being connected to SpiderMan? You'll find the answer.
This course is very hands-on; you'll spend most of your time following along with the instructor as we write, analyze, and run real code together – both on your own system, and in the cloud using Amazon's Elastic MapReduce service. over 8 hours of video content is included, with over 20 real examples of increasing complexity you can build, run and study yourself. Move through them at your own pace, on your own schedule. The course wraps up with an overview of other Spark-based technologies, including Spark SQL, Spark Streaming, and GraphX.
Enroll now, and enjoy the course!
"I studied Spark for the first time using Frank's course "Apache Spark with Scala - Hands On with Big Data!". It was a great starting point for me, gaining knowledge in Scala and most importantly practical examples of Spark applications. It gave me an understanding of all the relevant Spark core concepts, RDDs, Dataframes & Datasets, Spark Streaming, AWS EMR. Within a few months of completion, I used the knowledge gained from the course to propose in my current company to work primarily on Spark applications. Since then I have continued to work with Spark. I would highly recommend any of Franks courses as he simplifies concepts well and his teaching manner is easy to follow and continue with! " - Joey Faherty
Instructor Details
- 4.3 Rating
18,945 Reviews
Sundog Education by Frank Kane
Sundog Education's mission is to make highly valuable career skills in data engineering, data science, generative AI, AWS, and machine learning accessible to everyone in the world. Our consortium of expert instructors shares our knowledge in these emerging fields with you, at prices anyone can afford.
As a senior manager at Amazon during its early years, Frank Kane led large technical teams, managed multi-year projects, and served as a "bar-raiser" - interviewing thousands and hiring hundreds across the company.
Frank holds 26 issued patents in machine learning and personalization. After 9 years at Amazon and IMDb, he founded Sundog Education and has since taught over 1.1 million people in AI, ML, AWS, system design, and tech leadership. Frank has been teaching full-time for over 10 years - but is always building projects on the side with the latest emerging technologies, to better explain them to you!
Our teaching style is to simplify complex concepts - once you cut through all the notation and jargon, most of AI and machine learning is pretty easy to understand. We make these advanced topics accessible to anyone with a modest technical background, always using plain English and examples to drive it home. We make learning easy, hands-on, and fun.
More courses by Sundog Education by Frank Kane
Machine Learning, Data Science & AI Engineering with Python (2026)
4.6 (36,937 Reviews)
Provider: Udemy
Time: 20.2h
$139.99
The Ultimate Hands-On Hadoop: Tame your Big Data! (2026)
4.5 (31,163 Reviews)
Provider: Udemy
Time: 14.5h
$159.99
Taming Big Data with Apache Spark 4 and Python - Hands On! (2026)
4.5 (18,297 Reviews)
Provider: Udemy
Time: 8.8h
$139.99
Mastering the System Design Interview (2026)
4.6 (15,450 Reviews)
Provider: Udemy
Time: 5.2h
$109.99
AWS Certified Data Engineer Associate 2026 - Hands On!
4.7 (13,819 Reviews)
Provider: Udemy
Time: 24.2h
$109.99
Claude Code: Building Faster with AI, from Prototype to Prod (2026)
4.4 (10,073 Reviews)
Provider: Udemy
Time: 4.4h
$19.99
More Hadoop courses
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)
Provider: Udemy
Time: 4h
$12.99
Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)
Provider: Udemy
Time: 4.8h
$14.99
Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)
Provider: Udemy
Time: 11h
$10.99
Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)
Provider: Udemy
Time: 7.3h
$39.99
Reviews
By Ronald Ruben Hualpa Ocas on 9/24/2025
This was a really good experience. I had zero experience in Scala before follow this course but now I'm not afraid of it and with the hands-on examples, I understood everything. I'm able to use it in my job now. Thank you mr Kane, you are the best teacher !
By Anonymized User on 8/7/2021
As a new learner of Spark Scala, I don't get much insight and explanations from the course. This course is like brush up for persons who are already familiar with Spark Scala. Course should have much explanations on the codes, like why using particular function, what does the function will do, what happens if we omit udf function , like these explanations are needed for beginners, but course lacks those detailed level of explanations.
By Jose Eduardo Thurler Tecles on 2/8/2020
This was one of the best courses I've taken in my life; it is very clear, with lots of examples and practical exercises. You star programming right away. I have learned a lot with this course and I have since been programming in Scala and Spark in my daily work. Excellent content!
By Eduardo Vinhas Mouta on 1/27/2020
Frank Kane is such great instructor!! The course is so instructive, and you can get a nice initial contact to Apache Spark and Scala programming language. There are several exercices to be done, so you can learn by doing. I recommended the course to anyone needs to get a knowledge about Apache Spark.
By Ieva Kazaka on 11/17/2019
Great Lector! Thanks! As an intro to spark, it's a good course. Otherwise, I would benefit from more info about DataFrames, importing Hive tables, data cleaning. More general structure about Spark and how to think about different use cases would be helpful, not only 1-2 examples, which seemed random to me. But really good teaching style, positive, energetic, interesting, inspiring - I appreciate that a lot! Thanks! :)
By Rishabh Khanna on 6/19/2018
Experience was quite good. It is a very good course for beginners and absolute fun. The exercises are easy and real time synchronized. It does not focus on theory stuff of Spark but more on practical stuff which is a plus point but at times when one does not know about how a specific command functions or what is the logic behind the implementation of a particular function, theory about the tool comes in handy which is quite less in this course.
By Pal on 1/5/2018
I liked Frank Kane's teaching style. I feel confident to gather and explore more in SPARK after after listening to these lectures. Thank you Frank !! Also kindly include section on analysis using Spark Web UI, Debugging both standalone and cluster applications. Including debugging using scala ide would be helpful.
By Gabriele Rossi on 10/15/2017
A Spark and Scala hands-on course for developers, straightforward and pragmatic, with useful deeper insights from time to time. I appreciated Frank teaching style, the step-by-step configuration with Q&A and (few) fixes, well balanced exercises/theory and completeness (Scala crash course and sbt tool I found very useful). I suppose this course is targeted to a general Spark "user", but I'd suggest to spend a few more minutes on Spark architecture, to explain what happens behind the scenes in core features, such as clustering (how master manages resources, or how distribute code dynamically, for example) or what exactly is or not is an RDD or how DAG/Stage/Task work. That would be more value added to presented use cases which seem to me nonetheless very interesting and reasonably complex. Thanks Frank for the good course and updates! See you on real projects!
By Abhishek Tiwari on 4/17/2017
It was a real good learning opportunities. Below are the few goods things which I write. 1. Very to the point content 2.Perfect delivery of the content 3.Good coverage of the course with real time examples. 4.A clear and loud voice with great sentence punctuation along with great knowledge of emphasis excites Below are the points what can be added. 1. It is good to have a complete theoretical session on Spark Functions with the real understanding of flow. 2.Scala functions are the one that covers most of the things here broadening lectures on them would help. Thanks a lot Frank and Emad for educating us.
By Dinesh Balaji on 10/6/2016
Frank is a uber cool instructor, makes the code look darn simple. The best part is the structuring of the course-scala basics, spark basics, advanced spark, other spark packages... with example code for each section makes learning conducive. Advice to Frank:- You could add slides as pdf for quick revision by students.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 86 / 100












