Decision Trees, Random Forests, AdaBoost & XGBoost in Python (Udemy.com)
Decision Trees and Ensembling techniques in Python. How to run Bagging, Random Forest, GBM, AdaBoost & XGBoost in Python
Created by: Start-Tech Academy
Last updated April 2026
What you will learn
- Get a solid understanding of decision tree
- Understand the business scenarios where decision tree is applicable
- Tune a machine learning model's hyperparameters and evaluate its performance.
- Use Pandas DataFrames to manipulate data and make statistical computations.
- Use decision trees to make predictions
- Learn the advantage and disadvantages of the different algorithms
How it compares
Against the other 371 rated Udemy courses in Data Analysis on CourseDuck:
- Rating4.6 out of 5higher than 73% of them
- Reviews1,077#136 of 372 by number of reviews
- Length7.3 hourslonger than 64% of them
- Last updatedApril 2026more recently than 67% of them
Course Description
You're looking for a complete Decision tree course that teaches you everything you need to create a Decision tree/ Random Forest/ XGBoost model in Python, right?
You've found the right Decision Trees and tree based advanced techniques course!
After completing this course you will be able to:
Identify the business problem which can be solved using Decision tree/ Random Forest/ XGBoost of Machine Learning.
Have a clear understanding of Advanced Decision tree based algorithms such as Random Forest, Bagging, AdaBoost and XGBoost
Create a tree based (Decision tree, Random Forest, Bagging, AdaBoost and XGBoost) model in Python and analyze its result.
Confidently practice, discuss and understand Machine Learning concepts
How this course will help you?
A Verifiable Certificate of Completion is presented to all students who undertake this Machine learning advanced course.
If you are a business manager or an executive, or a student who wants to learn and apply machine learning in Real world problems of business, this course will give you a solid base for that by teaching you some of the advanced technique of machine learning, which are Decision tree, Random Forest, Bagging, AdaBoost and XGBoost.
Why should you choose this course?
This course covers all the steps that one should take while solving a business problem through Decision tree.
Most courses only focus on teaching how to run the analysis but we believe that what happens before and after running analysis is even more important i.e. before running analysis it is very important that you have the right data and do some pre-processing on it. And after running analysis, you should be able to judge how good your model is and interpret the results to actually be able to help your business.
What makes us qualified to teach you?
The course is taught by Abhishek and Pukhraj. As managers in Global Analytics Consulting firm, we have helped businesses solve their business problem using machine learning techniques and we have used our experience to include the practical aspects of data analysis in this course
We are also the creators of some of the most popular online courses - with over 150,000 enrollments and thousands of 5-star reviews like these ones:
This is very good, i love the fact the all explanation given can be understood by a layman - Joshua
Thank you Author for this wonderful course. You are the best and this course is worth any price. - Daisy
Our Promise
Teaching our students is our job and we are committed to it. If you have any questions about the course content, practice sheet or anything related to any topic, you can always post a question in the course or send us a direct message.
Download Practice files, take Quizzes, and complete Assignments
With each lecture, there are class notes attached for you to follow along. You can also take quizzes to check your understanding of concepts. Each section contains a practice assignment for you to practically implement your learning.
What is covered in this course?
This course teaches you all the steps of creating a decision tree based model, which are some of the most popular Machine Learning model, to solve business problems.
Below are the course contents of this course on Linear Regression:
Section 1 - Introduction to Machine Learning
In this section we will learn - What does Machine Learning mean. What are the meanings or different terms associated with machine learning? You will see some examples so that you understand what machine learning actually is. It also contains steps involved in building a machine learning model, not just linear models, any machine learning model.
Section 2 - Python basic
This section gets you started with Python.
This section will help you set up the python and Jupyter environment on your system and it'll teach you how to perform some basic operations in Python. We will understand the importance of different libraries such as Numpy, Pandas & Seaborn.
Section 3 - Pre-processing and Simple Decision trees
In this section you will learn what actions you need to take to prepare it for the analysis, these steps are very important for creating a meaningful.
In this section, we will start with the basic theory of decision tree then we cover data pre-processing topics like missing value imputation, variable transformation and Test-Train split. In the end we will create and plot a simple Regression decision tree.
Section 4 - Simple Classification Tree
This section we will expand our knowledge of regression Decision tree to classification trees, we will also learn how to create a classification tree in Python
Section 5, 6 and 7 - Ensemble technique
In this section we will start our discussion about advanced ensemble techniques for Decision trees. Ensembles techniques are used to improve the stability and accuracy of machine learning algorithms. In this course we will discuss Random Forest, Baggind, Gradient Boosting, AdaBoost and XGBoost.
By the end of this course, your confidence in creating a Decision tree model in Python will soar. You'll have a thorough understanding of how to use Decision tree modelling to create predictive models and solve business problems.
Go ahead and click the enroll button, and I'll see you in lesson 1!
Cheers
Start-Tech Academy
------------
Below is a list of popular FAQs of students who want to start their Machine learning journey-
What is Machine Learning?
Machine Learning is a field of computer science which gives the computer the ability to learn without being explicitly programmed. It is a branch of artificial intelligence based on the idea that systems can learn from data, identify patterns and make decisions with minimal human intervention.
What are the steps I should follow to be able to build a Machine Learning model?
You can divide your learning process into 4 parts:
Statistics and Probability - Implementing Machine learning techniques require basic knowledge of Statistics and probability concepts. Second section of the course covers this part.
Understanding of Machine learning - Fourth section helps you understand the terms and concepts associated with Machine learning and gives you the steps to be followed to build a machine learning model
Instructor Details
- 4.6 Rating
1,077 Reviews
Start-Tech Academy
Start-Tech Academy is a technology-based Analytics Education Company and aims at Bringing Together the analytics companies and interested Learners.
Our top quality training content along with internships and project opportunities helps students in launching their Analytics journey.
Founded by Abhishek Bansal and Pukhraj Parikh.
Working as a Project manager in an Analytics consulting firm, Pukhraj has multiple years of experience working on analytics tools and software. He is competent in MS office suites, Cloud computing, SQL, Tableau, SAS, Google analytics and Python.
Abhishek worked as an Acquisition Process owner in a leading telecom company before moving on to learning and teaching technologies like Machine Learning and Artificial Intelligence.
More courses by Start-Tech Academy
Zero to Hero in Microsoft Excel: Complete Excel with Copilot (2026)
4.5 (46,660 Reviews)
Provider: Udemy
Time: 10.6h
$109.99
Zero to Hero in SQL: SQL for Data Analytics (2026)
4.6 (14,123 Reviews)
Provider: Udemy
Time: 10.4h
$129.99
Prompt Engineering Frameworks & Methodologies (2026)
4.5 (12,643 Reviews)
Provider: Udemy
Time: 3.2h
$19.99
HR Analytics using MS Excel for Human Resource Management (2026)
4.4 (11,556 Reviews)
Provider: Udemy
Time: 9.7h
$84.99
Data Analyst Skillpath: Zero to Hero in Excel, SQL & Python (2026)
4.5 (8,059 Reviews)
Provider: Udemy
Time: 24.4h
$109.99
More Data Analysis courses
Complete neural signal processing and analysis: Zero to hero (2026)
4.8 (2,013 Reviews)
Provider: Udemy
Time: 46.9h
$12.99
Excel for Business Analysts Online Course (2023)
4.8 (636 Reviews)
Provider: Udemy
Time: 9.3h
$74.99
Alteryx Designer Advanced Certification Mega Bundle (2023)
4.8 (468 Reviews)
Provider: Udemy
Time: 16.9h
$69.99
Reviews
By Marek Oleś on 2/5/2026
A particularly good and interesting course. Nicely covers DT, RF, GB. Not an easy task as this course is addressed to levels. Section on data preparation well thought consice and nicely presented. If I allow myself to put a slight question mark on one comment, as it seems to be especially inappropriate: course is not devoted to imbalanced data sets. This is a separate, sometimes complex and (can be) controversial issue – many courses are entirely focused on this section of data science. Thanks to authors, great job.
By Roberto Viegas Dutra on 3/10/2025
The course fails to address the challenge of imbalanced classes in classification problems, a scenario commonly encountered in real-world applications. It relies solely on accuracy as a metric, which can be misleading for imbalanced datasets when used in isolation. Metrics such as precision, recall, F1-score, and AUC-ROC should have been explained.
By Giannis Kazakos on 9/16/2024
The course is very good and you can get a good intuition of Decision Tress based algorithms as well as many hands on examples. I think it would be good if there were even more graded coding exercises especially regarding the running and evaluation of the ML models.
By Doru Bodea on 10/31/2023
The course helped me understand the tuning process and the boosting process for a decision tree model. I found it very well done, with good examples. Fitting what I needed. Thank you!
By Julio César Martínez Sánchez on 6/9/2022
A very good course. I think it would be excellent with a more detailed explanation on the topic of decision trees and ensemble models. and ensemble models. About code and explanation in python was excellent. I highly recommend it.
By Siddhant Singh on 5/3/2022
the speed at which the course is taught is excellent.. Description of concepts is very good and the explanation helps in immediate application i=of the concepts
By Paweł Błaszczyk on 11/1/2021
It's very good course to introduce you into ML in Python. The course is focused on practice. I'd add more theory but probably it is better as it is for majority of students :)
By Hitesh Kapade on 10/19/2020
This is a very good course on DT and RF. As mentioned in the feedback for Linear Regression course, please consider adding more questions/tests in regular interval between the topics. Thank you for such a wonderful course.
By Simone Carolini on 9/5/2020
There is also some materials regarding the preprocessing phase that a lot of other higher rated courses don't touch upon. Interesting part also on how to treat seasonality. Plus good explanation of all the techniques defined by the course's title.
By Rodolfo_Rivas on 5/3/2020
Step by step walk through of a quasi real life analysis. Very straight forward to learn how to code different tools. Some concepts are only introduced. For example it would help a slide to explain confusion matrix or how ensemble techniques get to a final score.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 92 / 100












