Skip to content
#3 in ScalaUdemyMachine LearningPaid courseAll LevelsCertificate

Scala and Spark for Big Data and Machine Learning (Udemy.com)

Learn the latest Big Data technology - Spark and Scala, including Spark 2.0 DataFrames!

Created by: Jose Portilla

Last updated September 2019

Our take

Based on the ratings of 5,625 students, a sample of their written reviews and the syllabus, as the course stood in September 2019. No course pays to be reviewed.

This is a Spark course first and a Scala course second. Jose Portilla spends about two hours on a Scala crash course, then moves on to Spark 2.0 DataFrames, MLlib regression, classification, clustering and PCA, and closes with a section on Databricks. It runs about 10 hours across 80 lectures, with 12 articles and no quizzes or coding exercises. The audience list says it plainly: people who already program in some language and want to see how big data tooling works. Complete beginners to programming will struggle, and experienced Scala developers will find the language sections thin.

With roughly 5,600 reviews at 4.4 stars, most students land on four or five. They praise how gradually the examples build, the clear walkthroughs of the example scripts, and the feeling that they could put Scala and Spark to use straight away. The complaints are consistent. Several reviewers say the course is too basic, that topics promised for later never arrive, and that the instructor points to the documentation instead of explaining Spark commands. The clustering section gets called out for not tying results back to the code. Mac setup videos are reported as outdated, and one reviewer sent two tech support requests, waited 11 days on the first, and never got a reply to either.

The last update was September 2019, so expect to debug version differences on modern Scala, which one five-star reviewer did without much trouble. The DataFrames and machine learning sections fill more than half the runtime, so it leans harder on MLlib than on Spark architecture, which a few students wished for. As a paid first pass at Spark for someone who already codes, it earns its place. Anyone wanting depth in either Scala or Spark should treat it as a starting point, not the destination.

Best forProgrammers who already know some language and want a fast, example-driven first look at Spark DataFrames and MLlib in Scala.
Skip it ifYou want deep Scala, Spark internals or cluster architecture; the Scala part is a crash course and nothing has been updated since 2019.

Pros

  • Examples build gradually from Scala basics to full MLlib regression, classification and clustering projects
  • Spark DataFrames and MLlib fill more than half the runtime, so it is genuinely a Spark course, not a language course
  • Setup walkthroughs for Windows, Mac and Linux, plus a section on running Spark on Databricks
  • Nearly nine in ten of the 5,600 reviews are four or five stars

Cons

  • Not updated since September 2019; the Mac setup videos in particular are reported as out of date
  • Reviewers say topics promised for later are never covered and Scala stays at crash-course depth
  • Spark commands often get a pointer to the docs rather than an explanation, and ML results are lightly interpreted
It's a good course to expose yourself to Scala and Spark. It provides a good kick start so you have a general idea on what to do, where to go to get the information you need to complete the task.
N S, a student

Listed as all levels, but it assumes prior programming in some language; it is a beginner course for Spark, not for programming.

icon
What you will learn

  • Use Scala for Programming
  • Use Spark 2.0 DataFrames to read and manipulate data
  • Use Spark to Process Large Datasets
  • Understand hot to use Spark on AWS and DataBricks

Course content

17 sections · 80 lectures · 10 hours of video 12 articles

  1. 1Course Introduction 2 free previews3 lectures · 13 min
  2. 2Scala IDE Options and Overview 1 free preview2 lectures · 3 min
  3. 3Windows Scala and Spark Set-up and Installation5 lectures · 23 min
  4. 4Mac OS Setup and Installation1 lecture · 10 min
  5. 5Linux (Ubuntu) Setup and Installation 1 free preview1 lecture · 13 min
  6. 6Scala Programming: Level One8 lectures · 39 min
  7. 7Collections8 lectures · 34 min
  8. 8Scala Programming: Level Two6 lectures · 51 min
  9. 9Spark DataFrames with Scala 1 free preview10 lectures · 1.6 hours
  10. 10Introduction to Machine Learning3 lectures · 30 min

Who it is for

The instructor says it suits

  • Someone who already knows how to program and is interested in learning Big Data Technologies
  • Interested in using Spark with Scala for Machine Learning with Large Data Sets

What you need before you start

  • Basic Programming Knowledge in some language
  • Basic Math Skills
  • English Language

How it compares

Against the other 155 rated Udemy courses in Machine Learning on CourseDuck:

  • Rating4.4 out of 5higher than 49% of them
  • Reviews5,625#17 of 156 by number of reviews
  • Length10.2 hourslonger than 61% of them
  • Last updatedSeptember 2019earlier than 74% of them

icon
Course Description

Learn how to utilize some of the most valuable tech skills on the market today, Scala and Spark! In this course we will show you how to use Scala and Spark to analyze Big Data.

Scala and Spark are two of the most in demand skills right now, and with this course you can learn them quickly and easily! This course comes packed with content:

  • Crash Course in Scala Programming
  • Spark and Big Data Ecosystem Overview
  • Using Spark's MLlib for Machine Learning 
  • Scale up Spark jobs using Amazon Web Services
  • Learn how to use Databrick's Big Data Platform
  • and much more!

This course comes with full projects for you including topics such as analyzing financial data or using machine learning to classify Ecommerce customer behavior! We teach the latest methodologies of Spark 2.0 so you can learn how to use SparkSQL, Spark DataFrames, and Spark's MLlib!

After completing this course you will feel comfortable putting Scala and Spark on your resume!

Thanks and I will see you inside the course!

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Jose Portilla

Jose Marcial Portilla has a BS and MS in Mechanical Engineering from Santa Clara University and years of experience as a professional instructor and trainer for Data Science, Machine Learning and Python Programming. He has publications and patents in various fields such as microfluidics, materials science, and data science. Over the course of his career he has developed a skill set in analyzing data and he hopes to use his experience in teaching and data science to help other people learn the power of programming, the ability to analyze data, and the skills needed to present the data in clear and beautiful visualizations. Currently he works as the Head of Data Science for Pierian Training and provides in-person data science and python programming training courses to employees working at top companies, including General Electric, Cigna, SalesForce, Starbucks, McKinsey and many more. Feel free to check out the website link to find out more information about training offerings.

icon
More courses by Jose Portilla

$199.99

$159.99

$124.99

$159.99

$27.99

$27.99

icon
Reviews

4.4

5,625 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Ashwin Yoogi Ganesan on 9/26/2020

Overall a nice experience. Maybe some of the videos related to installation and setup using Mac computer needs to be updated, since i had a tough time surfing other internet resource to complete my installation.On the contents, it was easy to understand & also provided links & resources incase you need a wider depth of knowledge. Maybe the project exercise courses could be dealt more effectively explaining on the dataset, its mission or problem statement & then a walkthrough on the codes. Nevertheless, worth a course to gain some basic knowledge.

By N S on 8/10/2020

It's a good course to expose yourself to Scala and Spark. It provides a good kick start so you have a general idea on what to do, where to go to get the information you need to complete the task. I just wish there was more about Big Data, at least demonstrate a *full cycle* example to show how it's like sending data to the cluster, running the machine learning model on the cluster, and retrieving the result. Overall, good course. Recommended.

By Jennifer Opal on 11/21/2019

It was good and well explained. I'm really new to all of these topics but I do feel much more knowledgeable on the subject. I will definitely be repeating the course to further enhance my understanding. What would be great is some suggestions for some independent projects we can do after the course for beginners so that we can practise what we have learnt otherwise the course was great and I would highly recommend.

By Darel Johnson on 7/17/2018

Thanks again Jose, I really loved the course. I've learned a lot about Big Data and using Spark and the Scala programming language to create Machine Learning models. But more over, I've learned how to setup a multi-node ML cluster environment on Databricks and AWS.

By Eduardo Contreras on 2/21/2018

This is only my third or fourth programming language and he was among the best instructors; I took VB, taught myself php; took SQL and Bi as well previously. There are probably details about the format of the course and content that as a non-expert I cannot gauge as to how comprehensive the course is or how to grade the course. However, I would say it is a four and a half to five star class - perhaps it is perfectly taught though!

By Barrasa8 on 12/6/2017

The course is well structured and targeted to give you the base knowledge on how to use scala and spark to solve Big Data and ML problems. I feel like I will need to do another course in algebra and calculus to get a more in depth knowledge on the different ML algorithms that exist and when and how to use them.

By Siqing Cheng on 11/22/2017

This course gives a good overview of spark for Big data, basic scala script coding , spark UI in zeppelin and databricks notebooks, and machine learning. Wish there were more sessions explained on using the different MLlib machine learning algorithms in terms of model prediction and evaluation. Recommend to people who wants to get a basic understanding of spark in big data and machine learning fields.

By John Ohle on 7/20/2017

Very good content, well presented and explained. For the Machine Learning parts though, the output generated and Why-and-When to use the output is not very well explained. It would be great if after you explained the exercise solutions that you could help your students understand what the data generated actually means in a real world situation. Generating a "-1.112121" is all well and good, but what is it telling me with relation to my data? THAT is what is missing from this course IMHO. Otherwise its a very very good course. Thanks Jose

By Andy Menon on 7/6/2017

I really liked the course from the point of view of learning core Apache Spark concepts without having to dive too deep into statistical learning (although that is very much encouraged). Before this course, I did manage to learn some of the core Spark concepts. However, the effort was too fragmented given that most of the books available on the topic discussed concepts in isolation without following it up with a real-world- like example. This course begins with the theoretical concept of walking through Spark documentation, followed by working with sample data sets to demonstrate the concept discussed. This helped complete the picture for me as far as Spark as a "technology" is concerned. However, the course stops at the edge of technology-business border, although there are several mentions of real world business scenarios throughout this course. This is great for technologists to grasp. But if I've to translate this into terms in order to explain this to the business, that still remains a challenge. Imagine explaining Root Mean Squared Error to my manager! But being business-savvy isn't the intention of this course. That is one reason, I've signed up for a Data Visualization classes (also instructed by Jose) with the intention of taking what I've learned in this course and make it more practical. Overall, this is an awesome course! I give it 4 stars because I'm yet to understand the full implications of topics such as Model Evaluations.

By Pandu Boyapally on 4/28/2017

This is THE BEST COURSE I have taken on UDEMY in Spark and Big Data Analytics. I would recommend this for anyone interested in learning Spark, Scala and using them for Machine Learning. Jose Portilla did an excellent job of teaching this class and by pointing to the right resources on apache website and pointing to the chapters to refer to in the other external resources. I greatly enjoyed the teaching style of Jose. I am looking forward to enroll in other courses offered by him in future. Thanks.

Showing all 10 reviews on CourseDuck

Read all 5,625 reviews on Udemy

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 88 / 100