Web Development
Python
SQL
JavaScript
Data Science
Artificial Intelligence
IT & Software
IT Certifications
Hacking
Arduino
AWS
3D Modeling
Graphic Design
Photoshop
Drawing
Digital Painting
UX Design
Business
Data Analysis
Communication Skills
Project Management
Leadership & Management
E-Commerce
Digital Marketing
Social Media Marketing
Marketing
SEO
Google Analytics
Branding
Office Productivity
Excel
Finance & Accounting
Bitcoin
Video Editing & Animation
Photography
Adobe Premier Pro
Adobe Lightroom
Personal Development
Health & Fitness
Music
Guitar
Teaching & Academics
Language Learning
Engineering
LifestyleData Engineering for Beginner using Google Cloud & Python (Udemy.com)
Basic data engineering : python, pandas, google cloud platform (GCP) bigquery, spark on dataproc, gcs, data warehouse
Created by: Timotius P
Last updated November 2024
What you will learn
- Basic data engineering, what is data engineering, why needed, how to do it from zero
- Relational database model, database modelling for normalization design & hands-on using postgresql & python / pandas
- NoSQL database model, denormalization design & hands-on using elasticsearch & python / pandas
- Introduction to spark & spark cluster using google cloud platform
Course Description
"Data is the new oil".
You might have heard the quote before. Data in digital era is as valuable as oil in industrial era. However, just like oil, raw data itself is not usable. Rather, the value is created when it is gathered completely and accurately, connected to other relevant data, and done so in a timely manner.
Data engineers design and build pipelines that transform and transport data into a usable format. A different role, like data scientist or machine learning engineer then able to use the data into valuable business insight. Just like raw oil transformed into petrol to be used through complex process.
To be a data engineer requires a lot of data literacy and practice. This course is the first step for you who want to know about data engineering. In this course, we will see theories and hands-on to introduce you to data engineering. As data field is very wide, this course will show you the basic, entry level knowledge about data engineering process and tools.
This course is very suitable to build foundation for you to go to data field. In this course, we will learn about:
Introduction to data engineering
Relational & non relational database
Relational & non relational data model
Table normalization
Fact & dimension tables
Table denormalization for data warehouse
ETL (Extract Transform Load) & data staging using pyhton pandas
Elasticsearch basic
Data warehouse
Numbers every engineers should know & how it is related to big data
Hadoop
Spark cluster on google cloud dataproc
Data lake
Important Notes
Data field is HUGE! This course will be continuously updated, but for time being, this contains introduction to concept, and sample hands-on for data engineering.
For now, this course is intended for beginner on data engineering.
If you have some experience on programming and wonder about data engineering, this course is for you.
If you have experience in data engineering field, this course might be too basic for you (although I'm very happy if you still purchase the course)
If you never write python or SQL before, this course is not for you. To understand the course, you must have basic knowledge on SQL and pyhton.
Udemy Discount
The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.
Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.
Instructor Details
- 4.5 Rating
329 Reviews
Timotius P
Timotius came from small Indonesian city but now working on it's capital : Jakarta. He's been in software engineering job for years. His first job was in the large consumer finance in Indonesia. Then he took a role as Engineering Manager on Indonesian unicorn. Few moments after, he moved back to another large Indonesian consumer finance and take a role on Engineering & Architect Head.
Taking the role as Head, he get more time to coach his team members about software engineering practice.
With more than 5 years experience as Java developer, and for the last few years handle enterprise complexity as Engineering Manager & Enterprise Architect, he will be glad to deliver high quality courses containing information of various technologies and software architecture design skills that he has acquired through his professional experience.
His goal is to deliver courses that not only good in theory, but also applicable in real-life use cases. His courses give the concept, and the hand-coding experience. He will also provide various resources, including source code to hands-on coding.
More courses by Timotius P
Reimagine Software Development Life Cycle (SDLC) with AI (2026)
4.4 (2,889 Reviews)
Provider: Udemy
Time: 3h
$10.99
Java Spring Boot 3, Apache Kafka Bootcamp-With AI Assistant (2026)
4.4 (1,073 Reviews)
- Provider: Udemy
- Time: 21.9h
$99.99
REST API Management, Monitoring & Analytics using Kong 3 (2024)
4.4 (1,065 Reviews)
- Provider: Udemy
- Time: 4.8h
$69.99
Practical Java : Spring Boot 3 REST API with Elasticsearch 8 (2024)
4.0 (481 Reviews)
- Provider: Udemy
- Time: 6.9h
$69.99
Code GraphQL Application : Java Spring Boot 3 & Netflix DGS (2026)
4.5 (422 Reviews)
- Provider: Udemy
- Time: 12h
$84.99
Hands-On Go : Microservices With Protocol Buffers & gRPC (2026)
4.4 (131 Reviews)
- Provider: Udemy
- Time: 9.4h
$69.99
More Data Science courses
Master statistics & machine learning: intuition, math, code (2026)
4.9 (3,077 Reviews)
- Provider: Udemy
- Time: 38.3h
$124.99
Reviews
By Kumar Kunal on 5/1/2025
Great course on Data Engineering Using Google Cloud & Python. The course has a detailed explanation of Data Engineering concepts and examples.
By IT Training on 12/8/2024
The slides are colorful and the theory is excellent. Haven't got much on the coding part, but I like the way the course structured. Instead of blindly go to code, the course teaches about why an item is required through its theory. Then it sync with the hands coding part
By Jonathan Oloruntoba on 6/12/2024
This course is not structured to cater to a beginner. Even with a background in SQL and Python I struggled to stay up to speed with the course. This is mainly because the examples used are too complex and their entity relationships too broad, such that you will get lost while following the lessons on the ETL process. For example, one of the datasets in the example used has over 200 000 rows! I think this level of complexity is not necessary for 'introducing' data engineering. There is no effort to explain the syntax of the scripts used e.g. for raw connections to DB and for loading, a beginner will obviously be seeing these scripts for the first time. This course is good at describing the landscape and the concepts involved in data engineering (theory) but not ideal for learning the practicals. This is not a course for beginners and should not be advertised as such.
By gaziz t on 10/10/2023
This guys is simply amazing. He put a lot of thought and even more hard work into his courses. I like how pedagogically he approaches the material and gradually explains critical parts with excellent analogies and excellent pictures.
By Valerian Mahdi Pratama on 1/2/2023
The overall course is nice, providing the necessary basic for what to expect as a data engineer and data modelling with several demo using GCP solution. The course is clear with easy to follow pronounciation. However, it would be better if each section have a sanity-check quiz too to ensure understanding of the material.
By Angel Bernardo Santiago Antonino on 12/27/2022
Excellent, I was watching a little part of the course, but with this I can said that is an very complete course like other courses of Timotius
By Alejandro Tirado on 11/7/2022
it is a good course to getting started in this difficult work of data engineering
By Andri on 10/21/2022
Spent my weekend learning this course. It is a GOOD investment. The slides are interesting, and the instructor explains in easy-to-understand manner. Will buy another course from this instructor when I finish this one
By julio Moreno on 10/2/2022
I'm just moving from one role as DBA to another role as a Data Arquitect and this would be nice to know , due are the basis for my next step.
By Anonymized User on 8/17/2022
The instructor has very good ditatic skills, explaning everything for the beginning, so it makes more sense
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 90 / 100
- Video Duration:
8.1h - Price: $74.99
- Provider: Udemy
- Updated:
November 2024 - Level:
Beginner - Language:
English - Certificate:
Yes
30-day money-back guarantee on most paid courses
Udemy Coupon Price Tracker
