Skip to content
UdemyData AnalysisPaid courseAll LevelsCertificate

Decision Trees, Random Forests, AdaBoost & XGBoost in Python (Udemy.com)

Decision Trees and Ensembling techniques in Python. How to run Bagging, Random Forest, GBM, AdaBoost & XGBoost in Python

Created by: Start-Tech Academy

Last updated April 2026

icon
What you will learn

  • Get a solid understanding of decision tree
  • Understand the business scenarios where decision tree is applicable
  • Tune a machine learning model's hyperparameters and evaluate its performance.
  • Use Pandas DataFrames to manipulate data and make statistical computations.
  • Use decision trees to make predictions
  • Learn the advantage and disadvantages of the different algorithms

How it compares

Against the other 371 rated Udemy courses in Data Analysis on CourseDuck:

  • Rating4.6 out of 5higher than 73% of them
  • Reviews1,077#136 of 372 by number of reviews
  • Length7.3 hourslonger than 64% of them
  • Last updatedApril 2026more recently than 67% of them

icon
Course Description

You're looking for a complete Decision tree course that teaches you everything you need to create a Decision tree/ Random Forest/ XGBoost model in Python, right?

You've found the right Decision Trees and tree based advanced techniques course!

After completing this course you will be able to:

  • Identify the business problem which can be solved using Decision tree/ Random Forest/ XGBoost  of Machine Learning.

  • Have a clear understanding of Advanced Decision tree based algorithms such as Random Forest, Bagging, AdaBoost and XGBoost

  • Create a tree based (Decision tree, Random Forest, Bagging, AdaBoost and XGBoost) model in Python and analyze its result.

  • Confidently practice, discuss and understand Machine Learning concepts

How this course will help you?

A Verifiable Certificate of Completion is presented to all students who undertake this Machine learning advanced course.

If you are a business manager or an executive, or a student who wants to learn and apply machine learning in Real world problems of business, this course will give you a solid base for that by teaching you some of the advanced technique of machine learning, which are Decision tree, Random Forest, Bagging, AdaBoost and XGBoost.

Why should you choose this course?

This course covers all the steps that one should take while solving a business problem through Decision tree.

Most courses only focus on teaching how to run the analysis but we believe that what happens before and after running analysis is even more important i.e. before running analysis it is very important that you have the right data and do some pre-processing on it. And after running analysis, you should be able to judge how good your model is and interpret the results to actually be able to help your business.

What makes us qualified to teach you?

The course is taught by Abhishek and Pukhraj. As managers in Global Analytics Consulting firm, we have helped businesses solve their business problem using machine learning techniques and we have used our experience to include the practical aspects of data analysis in this course

We are also the creators of some of the most popular online courses - with over 150,000 enrollments and thousands of 5-star reviews like these ones:

This is very good, i love the fact the all explanation given can be understood by a layman - Joshua

Thank you Author for this wonderful course. You are the best and this course is worth any price. - Daisy

Our Promise

Teaching our students is our job and we are committed to it. If you have any questions about the course content, practice sheet or anything related to any topic, you can always post a question in the course or send us a direct message.

Download Practice files, take Quizzes, and complete Assignments

With each lecture, there are class notes attached for you to follow along. You can also take quizzes to check your understanding of concepts. Each section contains a practice assignment for you to practically implement your learning.

What is covered in this course?

This course teaches you all the steps of creating a decision tree based model, which are some of the most popular Machine Learning model, to solve business problems.

Below are the course contents of this course on Linear Regression:

  • Section 1 - Introduction to Machine Learning

    In this section we will learn - What does Machine Learning mean. What are the meanings or different terms associated with machine learning? You will see some examples so that you understand what machine learning actually is. It also contains steps involved in building a machine learning model, not just linear models, any machine learning model.

  • Section 2 - Python basic

    This section gets you started with Python.

    This section will help you set up the python and Jupyter environment on your system and it'll teach you how to perform some basic operations in Python. We will understand the importance of different libraries such as Numpy, Pandas & Seaborn.

  • Section 3 - Pre-processing and Simple Decision trees

    In this section you will learn what actions you need to take to prepare it for the analysis, these steps are very important for creating a meaningful.

    In this section, we will start with the basic theory of decision tree then we cover data pre-processing topics like  missing value imputation, variable transformation and Test-Train split. In the end we will create and plot a simple Regression decision tree.

  • Section 4 - Simple Classification Tree

    This section we will expand our knowledge of regression Decision tree to classification trees, we will also learn how to create a classification tree in Python

  • Section 5, 6 and 7 - Ensemble technique
    In this section we will start our discussion about advanced ensemble techniques for Decision trees. Ensembles techniques are used to improve the stability and accuracy of machine learning algorithms. In this course we will discuss Random Forest, Baggind, Gradient Boosting, AdaBoost and XGBoost.

By the end of this course, your confidence in creating a Decision tree model in Python will soar. You'll have a thorough understanding of how to use Decision tree  modelling to create predictive models and solve business problems.


Go ahead and click the enroll button, and I'll see you in lesson 1!


Cheers

Start-Tech Academy


------------

Below is a list of popular FAQs of students who want to start their Machine learning journey-

What is Machine Learning?

Machine Learning is a field of computer science which gives the computer the ability to learn without being explicitly programmed. It is a branch of artificial intelligence based on the idea that systems can learn from data, identify patterns and make decisions with minimal human intervention.

What are the steps I should follow to be able to build a Machine Learning model?

You can divide your learning process into 4 parts:

Statistics and Probability - Implementing Machine learning techniques require basic knowledge of Statistics and probability concepts. Second section of the course covers this part.

Understanding of Machine learning - Fourth section helps you understand the terms and concepts associated with Machine learning and gives you the steps to be followed to build a machine learning model

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Start-Tech Academy

Start-Tech Academy is a technology-based Analytics Education Company and aims at Bringing Together the analytics companies and interested Learners. 
Our top quality training content along with internships and project opportunities helps students in launching their Analytics journey. 

Founded by Abhishek Bansal and Pukhraj Parikh.

Working as a Project manager in an Analytics consulting firm, Pukhraj has multiple years of experience working on analytics tools and software. He is competent in  MS office suites, Cloud computing, SQL, Tableau, SAS, Google analytics and Python.

Abhishek worked as an Acquisition Process owner in a leading telecom company before moving on to learning and teaching technologies like Machine Learning and Artificial Intelligence.


icon
More courses by Start-Tech Academy

$109.99

$129.99

$19.99

$84.99

$14.99

$109.99

icon
More Data Analysis courses

Free

$79.99

$12.99

$74.99

$69.99

Free

icon
Reviews

4.6

1,077 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Marek Oleś on 2/5/2026

A particularly good and interesting course. Nicely covers DT, RF, GB. Not an easy task as this course is addressed to levels. Section on data preparation well thought consice and nicely presented. If I allow myself to put a slight question mark on one comment, as it seems to be especially inappropriate: course is not devoted to imbalanced data sets. This is a separate, sometimes complex and (can be) controversial issue – many courses are entirely focused on this section of data science. Thanks to authors, great job.

By Roberto Viegas Dutra on 3/10/2025

The course fails to address the challenge of imbalanced classes in classification problems, a scenario commonly encountered in real-world applications. It relies solely on accuracy as a metric, which can be misleading for imbalanced datasets when used in isolation. Metrics such as precision, recall, F1-score, and AUC-ROC should have been explained.

By Giannis Kazakos on 9/16/2024

The course is very good and you can get a good intuition of Decision Tress based algorithms as well as many hands on examples. I think it would be good if there were even more graded coding exercises especially regarding the running and evaluation of the ML models.

By Doru Bodea on 10/31/2023

The course helped me understand the tuning process and the boosting process for a decision tree model. I found it very well done, with good examples. Fitting what I needed. Thank you!

By Julio César Martínez Sánchez on 6/9/2022

A very good course. I think it would be excellent with a more detailed explanation on the topic of decision trees and ensemble models. and ensemble models. About code and explanation in python was excellent. I highly recommend it.

By Siddhant Singh on 5/3/2022

the speed at which the course is taught is excellent.. Description of concepts is very good and the explanation helps in immediate application i=of the concepts

By Paweł Błaszczyk on 11/1/2021

It's very good course to introduce you into ML in Python. The course is focused on practice. I'd add more theory but probably it is better as it is for majority of students :)

By Hitesh Kapade on 10/19/2020

This is a very good course on DT and RF. As mentioned in the feedback for Linear Regression course, please consider adding more questions/tests in regular interval between the topics. Thank you for such a wonderful course.

By Simone Carolini on 9/5/2020

There is also some materials regarding the preprocessing phase that a lot of other higher rated courses don't touch upon. Interesting part also on how to treat seasonality. Plus good explanation of all the techniques defined by the course's title.

By Rodolfo_Rivas on 5/3/2020

Step by step walk through of a quasi real life analysis. Very straight forward to learn how to code different tools. Some concepts are only introduced. For example it would help a slide to explain confusion matrix or how ensemble techniques get to a final score.

Showing all 10 reviews on CourseDuck

Read all 1,077 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 92 / 100