The Complete Hands-On Introduction to Apache Airflow (Udemy.com)

Learn to author, schedule and monitor data pipelines through practical examples using Apache Airflow

Created by: Marc Lamberti

Produced in 2022

icon
What you will learn

  • Create plugins to add functionalities to Apache Airflow.
  • Using Docker with Airflow and different executors
  • Master core functionalities such as DAGs, Operators, Tasks, Workflows, etc
  • Understand and apply advanced concepts of Apache Airflow such as XCOMs, Branching and SubDAGs.
  • The difference between Sequential, Local and Celery Executors, how do they work and how can you use them.
  • Use Apache Airflow in a Big Data ecosystem with Hive, PostgreSQL, Elasticsearch etc.
  • Install and configure Apache Airflow
  • Think, answer and implement solutions using Airflow to real data processing problems

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 84 / 100

icon
Live Chat with CourseDuck's Co-Founder for Help

Need help deciding on a elastic search course? Or looking for more detail on Marc Lamberti's The Complete Hands-On Introduction to Apache Airflow? Feel free to chat below.
Join CourseDuck's Online Learning Discord Community

icon
Course Description

Apache Airflow is an open-source platform to programmatically author, schedule and monitor workflows. If you have many ETL(s) to manage, Airflow is a must-have.
In this course you are going to learn how to master Apache Airflow through theory and pratical video courses. Starting from very basic notions such as, what is Airflow and how it works, we will dive into advanced concepts such as, how to create plugins and make real dynamic pipelines.
Who this course is for:
  • People being curious about data engineering.
  • People who want to learn basic and advanced concepts about Apache Airflow.
  • People who like hands-on approach.

*Some courses are excluded from this sale. Coupon not working? If the link above doesn't drop prices, clear the cookies in your browser and then click this link here.
Also, you may need to apply the coupon code directly on the cart page to get the discount.

Coupon Code

icon
Instructor Details

Marc Lamberti

Hi there!
My name is Marc Lamberti, I'm 27 years old and I'm very happy to arouse your curiosity! I'm currently working as Big Data Engineer in full-time for the biggest online bank in France, dealing with more than 1 500 000 clients. For more than 3 years now, I created different ETLs in order to address the problems that a bank encounters everyday such as, a platform to monitor the information system in real time to detect anomalies and reduce the number of client's calls, a tool detecting in real time any suspicious transaction or potential fraudster, an ETL to valorize massive amount of data into Cassandra and so on.
The biggest issue when you are a Big Data Engineer is to deal with the growing number of available open source tools. You have to know how to use them, when to use them and how they connect to each other in order to build robust, secure and performing systems solving your underlying business needs.
I strongly believe that the best way to learn and understand a new skill is by taking a hands-on approach with just enough theory to explain the concepts and a big dose of practice to be ready in a production environment. That's why in each of my courses you will always find practical examples associated with theoric explanations.
Have a great learning time!

icon
Reviews

4.2

50 total reviews

5 star 4 star 3 star 2 star 1 star
% Complete
% Complete
% Complete
% Complete
% Complete

I can't believe! This is very in-depth course on Airflow. I recommend it to everyone since traditional scheduling tools like oozie, control-m were need to define xml files but airflow is really amazing distributed scheduler with very rich cli & it's in Python. I'm Very Very Thankful to creator of this course! He studied very well & made this available to everyone!

It is an awesome course on airflow, It could have been better if there are lectures on macros, Kubernetes executor and airflow on kubernetes

Good content to quickly go over airflow. It helped me to learn a lot. Provided VM was good and barring few errors between actual actions and shown video content everything else was nice. Once recommendation (and it may be my perspective) is not to narrate each and every word/line written on presentation. It will be more helpful not to have big sentences on presentation but only the main points and then cover those points using practical examples. Overall, happy with this course.

Course is good, but speakers english is too bad, even sub titles does not help many a times. ~Study flow broken many times due to hard accents of speaker

This course was pretty much complete. With the information in the course I was able to build a complete real testing environment with airflow. The methodology used is excellent. On point that need to improve is font used for the command lines and also most of them should be highlighted on the below screen as it is done for the connection string. This is a very valuable course for data peoples (data warehouse or scientist)

Course is packed for a lot of good info. each cmd could pause for a couple seconds before continuing so that I could easily pause the video... This course took me ~ 5hrs x 2 days to complete. I encountered a couple issues. One I found the solution from the Q/A session. For another one, I posted it to the group, and Marc replied with solution right away.

The content of the course is very good and Marc has touch based on all important aspects and complex scenarios with predefined examples that he uses. However, sometimes the video speed & the speaking speed is very fast that you tend to miss out the importance of commands and their significance. Just the speaking speed in general is too quick, can be improvised there. But overall it is good course to learn and know enough to get started-definitely recommend taking it.

Very nice course, I learned a lot.But some of the ressources are not directly accessible.I had to look into the Q&R to get the VM and the slides are only availabe in videos.Other wise very nice course.

Excellent lessons. I learnt a lot. Materials prepared in very detailed way.Just on the end, I had a feeling, that Marc want to share too much information at once. I had a feeling of being in really hurry, not stopping even for a moment as it should be all totally obvious for me. I had to pause and go back few times to catch this single moment. Possible, but tiring.Anyway, thanks for this course!

Content from the Appendix is actually super useful for production deployment and development of Airflow applications, therefore it would be great if it could be treated in more detail within the course.

Erg leerzaam, een uitgebreide basis in de functionaliteiten met handige concrete voorbeelden. Goed dat ook Docker behandeld wordt.

This is a good course, but i dont speak english, i understand concepts but have help me with google traslate. For contents and explications, examples, and general the teacher is very good!!!