Scala and Spark for Big Data and Machine Learning (Udemy.com)
Learn the latest Big Data technology - Spark and Scala, including Spark 2.0 DataFrames!
Created by: Jose Portilla
Last updated September 2019
Our take
Based on the ratings of 5,625 students, a sample of their written reviews and the syllabus, as the course stood in September 2019. No course pays to be reviewed.
This is a Spark course first and a Scala course second. Jose Portilla spends about two hours on a Scala crash course, then moves on to Spark 2.0 DataFrames, MLlib regression, classification, clustering and PCA, and closes with a section on Databricks. It runs about 10 hours across 80 lectures, with 12 articles and no quizzes or coding exercises. The audience list says it plainly: people who already program in some language and want to see how big data tooling works. Complete beginners to programming will struggle, and experienced Scala developers will find the language sections thin.
With roughly 5,600 reviews at 4.4 stars, most students land on four or five. They praise how gradually the examples build, the clear walkthroughs of the example scripts, and the feeling that they could put Scala and Spark to use straight away. The complaints are consistent. Several reviewers say the course is too basic, that topics promised for later never arrive, and that the instructor points to the documentation instead of explaining Spark commands. The clustering section gets called out for not tying results back to the code. Mac setup videos are reported as outdated, and one reviewer sent two tech support requests, waited 11 days on the first, and never got a reply to either.
The last update was September 2019, so expect to debug version differences on modern Scala, which one five-star reviewer did without much trouble. The DataFrames and machine learning sections fill more than half the runtime, so it leans harder on MLlib than on Spark architecture, which a few students wished for. As a paid first pass at Spark for someone who already codes, it earns its place. Anyone wanting depth in either Scala or Spark should treat it as a starting point, not the destination.
Pros
- Examples build gradually from Scala basics to full MLlib regression, classification and clustering projects
- Spark DataFrames and MLlib fill more than half the runtime, so it is genuinely a Spark course, not a language course
- Setup walkthroughs for Windows, Mac and Linux, plus a section on running Spark on Databricks
- Nearly nine in ten of the 5,600 reviews are four or five stars
Cons
- Not updated since September 2019; the Mac setup videos in particular are reported as out of date
- Reviewers say topics promised for later are never covered and Scala stays at crash-course depth
- Spark commands often get a pointer to the docs rather than an explanation, and ML results are lightly interpreted
It's a good course to expose yourself to Scala and Spark. It provides a good kick start so you have a general idea on what to do, where to go to get the information you need to complete the task.
Listed as all levels, but it assumes prior programming in some language; it is a beginner course for Spark, not for programming.
What you will learn
- Use Scala for Programming
- Use Spark 2.0 DataFrames to read and manipulate data
- Use Spark to Process Large Datasets
- Understand hot to use Spark on AWS and DataBricks
Course content
17 sections · 80 lectures · 10 hours of video 12 articles
- 1Course Introduction 2 free previews3 lectures · 13 min
- 2Scala IDE Options and Overview 1 free preview2 lectures · 3 min
- 3Windows Scala and Spark Set-up and Installation5 lectures · 23 min
- 4Mac OS Setup and Installation1 lecture · 10 min
- 5Linux (Ubuntu) Setup and Installation 1 free preview1 lecture · 13 min
- 6Scala Programming: Level One8 lectures · 39 min
- 7Collections8 lectures · 34 min
- 8Scala Programming: Level Two6 lectures · 51 min
- 9Spark DataFrames with Scala 1 free preview10 lectures · 1.6 hours
- 10Introduction to Machine Learning3 lectures · 30 min
- 11Regression with Spark8 lectures · 1 hour
- 12Classification with Spark6 lectures · 1.3 hours
- 13Model Evaluation3 lectures · 55 min
- 14Clustering with Spark6 lectures · 28 min
- 15PCA with Spark4 lectures · 23 min
- 16DataBricks and Spark5 lectures · 56 min
- 17BONUS SECTION: THANK YOU!1 lecture
Who it is for
The instructor says it suits
- Someone who already knows how to program and is interested in learning Big Data Technologies
- Interested in using Spark with Scala for Machine Learning with Large Data Sets
What you need before you start
- Basic Programming Knowledge in some language
- Basic Math Skills
- English Language
How it compares
Against the other 155 rated Udemy courses in Machine Learning on CourseDuck:
- Rating4.4 out of 5higher than 49% of them
- Reviews5,625#17 of 156 by number of reviews
- Length10.2 hourslonger than 61% of them
- Last updatedSeptember 2019earlier than 74% of them
Course Description
Learn how to utilize some of the most valuable tech skills on the market today, Scala and Spark! In this course we will show you how to use Scala and Spark to analyze Big Data.
Scala and Spark are two of the most in demand skills right now, and with this course you can learn them quickly and easily! This course comes packed with content:
- Crash Course in Scala Programming
- Spark and Big Data Ecosystem Overview
- Using Spark's MLlib for Machine Learning
- Scale up Spark jobs using Amazon Web Services
- Learn how to use Databrick's Big Data Platform
- and much more!
This course comes with full projects for you including topics such as analyzing financial data or using machine learning to classify Ecommerce customer behavior! We teach the latest methodologies of Spark 2.0 so you can learn how to use SparkSQL, Spark DataFrames, and Spark's MLlib!
After completing this course you will feel comfortable putting Scala and Spark on your resume!
Thanks and I will see you inside the course!
Instructor Details
- 4.4 Rating
5,625 Reviews
Jose Portilla
Jose Marcial Portilla has a BS and MS in Mechanical Engineering from Santa Clara University and years of experience as a professional instructor and trainer for Data Science, Machine Learning and Python Programming. He has publications and patents in various fields such as microfluidics, materials science, and data science. Over the course of his career he has developed a skill set in analyzing data and he hopes to use his experience in teaching and data science to help other people learn the power of programming, the ability to analyze data, and the skills needed to present the data in clear and beautiful visualizations. Currently he works as the Head of Data Science for Pierian Training and provides in-person data science and python programming training courses to employees working at top companies, including General Electric, Cigna, SalesForce, Starbucks, McKinsey and many more. Feel free to check out the website link to find out more information about training offerings.
More courses by Jose Portilla
The Complete Python Bootcamp From Zero to Hero in Python (2025)
4.6 (566,376 Reviews)
Provider: Udemy
Time: 22.4h
$199.99
The Complete SQL Bootcamp: Go from Zero to Hero (2022)
4.7 (258,007 Reviews)
Provider: Udemy
Time: 8.9h
$159.99
Python for Data Science and Machine Learning Bootcamp (2020)
4.5 (160,681 Reviews)
Provider: Udemy
Time: 24.9h
$124.99
Python and Django Full Stack Web Developer Bootcamp (2019)
4.4 (52,248 Reviews)
Provider: Udemy
Time: 31.9h
$159.99
Spark and Python for Big Data with PySpark (2020)
4.6 (26,667 Reviews)
Provider: Udemy
Time: 10.6h
$27.99
Learning Python for Data Analysis and Visualization Ver 1 (2022)
4.5 (20,266 Reviews)
Provider: Udemy
Time: 21.1h
$27.99
Reviews
By Ashwin Yoogi Ganesan on 9/26/2020
Overall a nice experience. Maybe some of the videos related to installation and setup using Mac computer needs to be updated, since i had a tough time surfing other internet resource to complete my installation.On the contents, it was easy to understand & also provided links & resources incase you need a wider depth of knowledge. Maybe the project exercise courses could be dealt more effectively explaining on the dataset, its mission or problem statement & then a walkthrough on the codes. Nevertheless, worth a course to gain some basic knowledge.
By N S on 8/10/2020
It's a good course to expose yourself to Scala and Spark. It provides a good kick start so you have a general idea on what to do, where to go to get the information you need to complete the task. I just wish there was more about Big Data, at least demonstrate a *full cycle* example to show how it's like sending data to the cluster, running the machine learning model on the cluster, and retrieving the result. Overall, good course. Recommended.
By Jennifer Opal on 11/21/2019
It was good and well explained. I'm really new to all of these topics but I do feel much more knowledgeable on the subject. I will definitely be repeating the course to further enhance my understanding. What would be great is some suggestions for some independent projects we can do after the course for beginners so that we can practise what we have learnt otherwise the course was great and I would highly recommend.
By Darel Johnson on 7/17/2018
Thanks again Jose, I really loved the course. I've learned a lot about Big Data and using Spark and the Scala programming language to create Machine Learning models. But more over, I've learned how to setup a multi-node ML cluster environment on Databricks and AWS.
By Eduardo Contreras on 2/21/2018
This is only my third or fourth programming language and he was among the best instructors; I took VB, taught myself php; took SQL and Bi as well previously. There are probably details about the format of the course and content that as a non-expert I cannot gauge as to how comprehensive the course is or how to grade the course. However, I would say it is a four and a half to five star class - perhaps it is perfectly taught though!
By Barrasa8 on 12/6/2017
The course is well structured and targeted to give you the base knowledge on how to use scala and spark to solve Big Data and ML problems. I feel like I will need to do another course in algebra and calculus to get a more in depth knowledge on the different ML algorithms that exist and when and how to use them.
By Siqing Cheng on 11/22/2017
This course gives a good overview of spark for Big data, basic scala script coding , spark UI in zeppelin and databricks notebooks, and machine learning. Wish there were more sessions explained on using the different MLlib machine learning algorithms in terms of model prediction and evaluation. Recommend to people who wants to get a basic understanding of spark in big data and machine learning fields.
By John Ohle on 7/20/2017
Very good content, well presented and explained. For the Machine Learning parts though, the output generated and Why-and-When to use the output is not very well explained. It would be great if after you explained the exercise solutions that you could help your students understand what the data generated actually means in a real world situation. Generating a "-1.112121" is all well and good, but what is it telling me with relation to my data? THAT is what is missing from this course IMHO. Otherwise its a very very good course. Thanks Jose
By Andy Menon on 7/6/2017
I really liked the course from the point of view of learning core Apache Spark concepts without having to dive too deep into statistical learning (although that is very much encouraged). Before this course, I did manage to learn some of the core Spark concepts. However, the effort was too fragmented given that most of the books available on the topic discussed concepts in isolation without following it up with a real-world- like example. This course begins with the theoretical concept of walking through Spark documentation, followed by working with sample data sets to demonstrate the concept discussed. This helped complete the picture for me as far as Spark as a "technology" is concerned. However, the course stops at the edge of technology-business border, although there are several mentions of real world business scenarios throughout this course. This is great for technologists to grasp. But if I've to translate this into terms in order to explain this to the business, that still remains a challenge. Imagine explaining Root Mean Squared Error to my manager! But being business-savvy isn't the intention of this course. That is one reason, I've signed up for a Data Visualization classes (also instructed by Jose) with the intention of taking what I've learned in this course and make it more practical. Overall, this is an awesome course! I give it 4 stars because I'm yet to understand the full implications of topics such as Model Evaluations.
By Pandu Boyapally on 4/28/2017
This is THE BEST COURSE I have taken on UDEMY in Spark and Big Data Analytics. I would recommend this for anyone interested in learning Spark, Scala and using them for Machine Learning. Jose Portilla did an excellent job of teaching this class and by pointing to the right resources on apache website and pointing to the chapters to refer to in the other external resources. I greatly enjoyed the teaching style of Jose. I am looking forward to enroll in other courses offered by him in future. Thanks.
Quality Score
Overall Score : 88 / 100









