Databricks Fundamentals & Apache Spark Core (Udemy.com)
Learn how to process big-data using Databricks & Apache Spark 2.4 and 3.0.0 - DataFrame API and Spark SQL
Created by: Wadson Guimatsa
Last updated September 2023
What you will learn
- Databricks
- Apache Spark Architecture
- Apache Spark DataFrame API
- Apache Spark SQL
- Selecting, and manipulating columns of a DataFrame
- Filtering, dropping, sorting rows of a DataFrame
- Joining, reading, writing and partitioning DataFrames
- Aggregating DataFrames rows
- Working with User Defined Functions
- Use the DataFrameWriter API
How it compares
Against the other 150 rated Udemy courses in Hadoop on CourseDuck:
- Rating4.4 out of 5higher than 54% of them
- Reviews3,172#22 of 151 by number of reviews
- Length12.2 hourslonger than 76% of them
- Last updatedSeptember 2023more recently than 52% of them
Course Description
Welcome to this course on Databricks and Apache Spark 2.4 and 3.0.0
Apache Spark is a Big Data Processing Framework that runs at scale.
In this course, we will learn how to write Spark Applications using Scala and SQL.
Databricks is a company founded by the creator of Apache Spark.
Databricks offers a managed and optimized version of Apache Spark that runs in the cloud.
The main focus of this course is to teach you how to use the DataFrame API & SQL to accomplish tasks such as:
Write and run Apache Spark code using Databricks
Read and Write Data from the Databricks File System - DBFS
Explain how Apache Spark runs on a cluster with multiple Nodes
Use the DataFrame API and SQL to perform data manipulation tasks such as
Selecting, renaming and manipulating columns
Filtering, dropping and aggregating rows
Joining DataFrames
Create UDFs and use them with DataFrame API or Spark SQL
Writing DataFrames to external storage systems
List and explain the element of Apache Spark execution hierarchy such as
Jobs
Stages
Tasks
Instructor Details
- 4.4 Rating
3,172 Reviews
Wadson Guimatsa
I'm a software developer specialized in building data-intensive applications.
I've been developing software for over 10 years.
I've worked for Industries that are very data-intensive such as the financials and industrial image processing.
Over the years, the volume of data produced by systems and humans outgrew the storage and compute capacity of the legacy RDBMS systems, and therefore I had to learn how to use the new tools and frameworks to process Big-Data
As a data engineer, I'm very motivated and passionate about building applications that can leverage the power and flexibility of cloud computing and big-data processing frameworks.
More courses by Wadson Guimatsa
Apache Spark 3 - Databricks Certified Associate Developer (2024)
4.3 (2,678 Reviews)
Provider: Udemy
Time: 4.5h
$74.99
Data Engineering on Microsoft Azure: The Definitive Guide (2022)
4.3 (619 Reviews)
Provider: Udemy
Time: 11.9h
$11.99
More Hadoop courses
Spark Streaming - Stream Processing in Lakehouse - PySpark (2024)
4.9 (2,251 Reviews)
Provider: Udemy
Time: 22.4h
$11.99
Apache Kafka Series - KSQL on ksqlDB for Stream Processing ! (2026)
4.9 (2,161 Reviews)
Provider: Udemy
Time: 4h
$12.99
Apache Kafka Series - Kafka Streams for Data Processing (2026)
4.8 (6,826 Reviews)
Provider: Udemy
Time: 4.8h
$14.99
Apache Kafka Series - Confluent Schema Registry & REST Proxy (2026)
4.8 (3,794 Reviews)
Provider: Udemy
Time: 4.5h
$94.99
Apache Kafka - Real-time Stream Processing (Master Class) (2023)
4.8 (2,925 Reviews)
Provider: Udemy
Time: 11h
$10.99
Apache Spark 3 & Big Data Essentials in Scala (2024)
4.8 (2,302 Reviews)
Provider: Udemy
Time: 7.3h
$39.99
Reviews
By Bharat Kothari on 6/15/2026
Overall good scope, contents and presentation. I found the speaker's voice a bit subdued and sometimes difficult to understand. Also, Scala was used and I was under impression this would be Python. Quite a bit was repeated.
By Raffaele Cocucci on 3/4/2026
The version of Databricks doesn't seem to be the same as in the video. The Free version looks different and I am unable to run Scala code. I can only convert the course examples into Python before they work.
By Noelia García Villalón on 9/5/2024
Curso muy completo que sirve para personas que parten de cero como para aquellas con algo de experiencia y que quieran repasar conceptos de como funciona todo el entorno de Databricks - Apache Spark. Lo recomiendo 100%, el profesor ha hecho un trabajo excelente.
By Melissa Watkins on 3/27/2023
As a Data Engineer who has worked with Databricks and Spark in college and throughout my career, this course served as a refresher and further developed my skills. I have gained a better understanding of the explained topics (such as knowledge and manipulation of data through Dataframe API, DBFS, Apache Spark SQL, and Scala) and will implement these new methods in my work. Wadson Guimatsa did a great job explaining each topic with patience and detail. I recommend taking this course as this information is extremely useful in data science, especially Data Engineering.
By PETER LOBACZ on 2/23/2023
It was a good introduction in Databricks & Spark. The reporting part of databricks was not touched. For me the lessons were too much dependent on what you did in previous lections, because you work with big notebooks
By JOACHIM KIENLE on 11/19/2022
The content of the course was very interesting and well structured. The only thing I would have liked was a few tasks where you can apply what you have learned. Practical examples were shown, but not in the form of tasks to solve independently.
By Anonymized User on 9/28/2021
Very thorough and clear. Although I had just completed a different course on Spark in Python I learned several new functions. My primary criticism is repetitive topics or demonstrations that I felt had already been adequately covered.
By Felipe Gonçalves de Andrade on 12/21/2020
Amazing course! It has an excellent instructor with clear accent. I've improved my knoledges not only Databricks or Apache Spark, but also Scala, SQL and Python. I really recommend this course for everyone!
By Elijah Adeoye on 10/27/2020
Amazing! It was very much so the 'fundamentals' as Wadson puts in the title. I needed that foundation! And these weren't just simple operations but good, solid complex day-to-day ones! Thanks for helping us learn how to set up Spark jobs in the Databricks environment! I needed this for my position and it was right on the money! Thanks sir!
By Oyanna Kelvin on 7/10/2020
Lectures are very detailed and concepts well explained. Every module comes with practical and hands-on resource to equip students with expertise in either Spark DataFrame, SparkSQL and other core Spark concepts. The time spent on each module was worth it. Thank you Instructor.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 88 / 100








