Artificial Intelligence 2.0: AI, Python, Deep RL + LLM Prize (Udemy.com)
Build an AI powerful enough to train an ant / spider and half-humanoid to walk and run across a field with the TD3 model
Created by: Hadelin de Ponteves
Last updated June 2026
What you will learn
- Q-Learning
- Deep Q-Learning
- Policy Gradient
- Actor Critic
- Deep Deterministic Policy Gradient (DDPG)
- Twin-Delayed DDPG (TD3)
- The Foundation Techniques of Deep Reinforcement Learning
- How to implement a state of the art AI model that is over performing the most challenging virtual applications
How it compares
Against the other 205 rated Udemy courses in Artificial Intelligence on CourseDuck:
- Rating4.8 out of 5higher than 97% of them
- Reviews1,378#71 of 206 by number of reviews
- Length9.6 hourslonger than 70% of them
- Last updatedJune 2026more recently than 80% of them
Course Description
Welcome to Artificial Intelligence 2.0!
In this course, we will learn and implement a new incredibly smart AI model, called the Twin-Delayed DDPG or TD3, which combines state of the art techniques in Artificial Intelligence including continuous Double Deep Q-Learning, Policy Gradient, and Actor Critic. The model is so strong that for the first time in our courses, we are able to solve the most challenging virtual AI applications (training an ant/spider and a half humanoid to walk and run across a field).
To approach this model the right way, we structured the course in three parts:
Part 1: Fundamentals
In this part we will study all the fundamentals of Artificial Intelligence which will allow you to understand and master the AI of this course. These include Q-Learning, Deep Q-Learning, Policy Gradient, Actor-Critic and more.Part 2: The Twin-Delayed DDPG Theory
We will study in depth the whole theory behind the model. You will clearly see the whole construction and training process of the AI through a series of clear visualization slides. Not only will you learn the theory in details, but also you will shape up a strong intuition of how the AI learns and works. The fundamentals in Part 1, combined to the very detailed theory of Part 2, will make this highly advanced model accessible to you, and you will eventually be one of the very few people who can master this model.Part 3: The Twin-Delayed DDPG Implementation
We will implement the model from scratch, step by step, and through interactive sessions, a new feature of this course which will have you practice on many coding exercises while we implement the model. By doing them you will not follow passively the course but very actively, therefore allowing you to effectively improve your skills. And last but not least, we will do the whole implementation on Colaboratory, or Google Colab, which is a totally free and open source AI platform allowing you to code and train some AIs without having any packages to install on your machine. In other words, you can be 100% confident that you press the execute button, the AI will start to train and you will get the videos of the spider and humanoid running in the end.
So are you ready to embrace AI at full power?
Come join us, never stop learning, and enjoy AI!
Instructor Details
- 4.8 Rating
1,378 Reviews
Hadelin de Ponteves
Hadelin is one of Udemy’s top instructors and a recognized leader in AI education. He has taught AI to over 2.6 million learners worldwide and is a frequent guest speaker at prominent industry events. Hadelin has created more than 30 top-rated courses on topics such as AI, Machine Learning, Deep Learning, Blockchain, and Cloud Computing, empowering learners around the globe to upskill in cutting-edge technologies.
In addition to his partnership with Udemy, Hadelin is the co-founder of CloudWolf and SuperDataScience. He is passionate about education and is on a mission to make complex technologies simple, practical, and widely accessible to all.
As a side activity, he is also an actor who acted in seven films, and a movie producer of two films (Indian and French).
More courses by Hadelin de Ponteves
AI A-Z [2026]: Agentic AI, Gen AI, Prompt Engineering and RL
4.3 (50,744 Reviews)
Provider: Udemy
Time: 17.4h
$199.99
Blockchain A-Z: Build a Blockchain, Crypto, & Smart Contract (2026)
4.6 (23,497 Reviews)
Provider: Udemy
Time: 14.6h
$22.99
Deep Learning and Computer Vision A-Z + LLM Prizes (2026)
4.5 (9,101 Reviews)
Provider: Udemy
Time: 11.1h
$14.99
Artificial Intelligence for Business + LLM Prize [2026]
4.4 (5,082 Reviews)
Provider: Udemy
Time: 15.1h
$18.99
More Artificial Intelligence courses
Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization
5.0 (526 Reviews)
Provider: Coursera
Time: 15h
Free
Artificial Intelligence: Reinforcement Learning in Python (2026)
4.9 (10,817 Reviews)
Provider: Udemy
Time: 14.7h
$79.99
Reviews
By David Kovář on 1/6/2024
Personally, I can say that the course was very beneficial for me. Hadelin is a very likeable person who can explain things simply and puts into the content a great passion that he obviously has for education and the field of artificial intelligence. The course was well structured, the content was nicely explained and there were additional materials (ANNEXES) attached that one could learn from. What I liked a lot, however, was that Hadelin always gave the option here before each assignment along with a hint for performing the assignment first by myself. The content itself was very interesting and was given in an understandable way. I might have just appreciated if the presentation that Hadelin used was available in an appendix for possible viewing. Some parts (especially the formulas) were harder to read on the video. Additionally, it meant that I had to take pictures of some of the slides on my phone in order to view them in an effort to solve the assignment. Anyway, these are just small things and I can really recommend the course highly!
By Viktor Banai on 12/12/2021
Until now it is an easy topic, but it is hard to understand listening the speaker as he is just showing formulas, it would be much better to explain the topic via concrete example. I had to find a video on youtube to fully understand Q, policy rewared etc. I don't like when a speaker tries to explain sg through formulas
By Nida on 8/12/2021
I highly appreciate the tutor's efforts. His explanation was on point, easy to understand. The course is designed in a way that it is extremely interesting, very informative yet simple to comprehend. Loved the course and the tutor's teaching style. I had an amazing experience learning AI through this course. Thanks!
By Alfredo Reis on 1/29/2021
It is a great course with a very passionate teacher. This very complex task is divided in many simple steps, each with an in-depth explanation. But it's worth mentioning that the main focus of the course is the implementation of the TD3 algorithm, and not a general view of Deep Reinforcement Learning, so Q-Learning and Deep Q-Learning are only explained in theory.
By Francesco "Fuma" Fumagalli on 12/8/2020
This course was amazing, it truly delivered what it promised. I love Hadelin's teaching method: the lessons are very clear, he uses colorful pictures and graphs to explain difficult concepts and he isn't afraid of repeating the most important parts, making it very easy to follow along and understand what's going on. Both theory and code were very well done and even the Annexes were an enjoyable refresher of more basic notions. Leaving the challenge of coding for yourself the following step before showing how it's done, with a couple of hints here and there, really helped me in not just listening passively but trying by myself and doing, making it so that I now understand how this code works much more intimately. I can't praise this course enough as it's truly helped me understand and implement one of my goals in AI, an algorithm able to walk the Ant. 10/10, I'll definitely get more courses from Hadelin.
By Ahmad Shiddiq Nurrahman on 6/1/2020
Sejauh ini saya mengerti dengan yg diterangkan. Tapi saya lbh banyak belajar di annex saat di awal2 karena saya belum mengambil course AI A-Z dan DL A-Z yg mana harus saya ambil krn saya yakin itu akan lbh memperkuat dasar dari AI. Overall, I understand what the instructor taught. Though I spent more time on the annex because I haven't taken the AI A-Z and DL A-Z courses which I should by the way to reinforce my basic of the AI.
By Paedru Fernando on 5/30/2020
The Treasure Trove of Reinforcement Learnings..This is the bomb.. Take it or leave it.... Kirill is the Evangelist for millions of students. He is the Thought leader out there to make AI just another skill in every aspirant's skill book. Wow !! Simply amazed .. It was my long time efforts for about 2 years in a row to master AI nowafter being though Kirills courses I believe I am about to achieve it.. Thank you Kirill
By Daniel Levine on 5/11/2020
Good Experience! I like that we are diving into a state of the art model. It helps that I have quite a bit of background from Phil Tabor's classes and my own expertise. If I didn't I may not be able to make as much sense.
By Ajitkumar Poolathodiyil on 5/3/2020
I learnt new Deep Q learning concepts in Deep Reinforcement Learning 2.0. Hadelin takes on the complex and breaks it down to pieces. Bravo!! That half humanoid AI trains and learns very well. Its exciting to see how TD3 works. Kirill explains the concepts very well and makes it easy. Also I enjoyed Kirill's references to many research papers. Merci bien. Thank You :) Ajit
By Patrick Klingler on 4/22/2020
I really appreciated the course. I liked most your clear and very tangible explanations of the theory and code. I have 2 ideas for you to think about: 1.: The coding part was quite difficult as it was the first time for me working with Pytorch. Instead of writing the entire code as exercise, you could think about to provide the code and make the learners to fill gaps in the code. 2.: I mounted Google Drive to prevent data loss when CoLab runs in timeout. Maybe this could be a hint for other learners.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 96 / 100
![AI A-Z [2026]: Agentic AI, Gen AI, Prompt Engineering and RL](/programming/artificial-intelligence/images/1219332_bdd7_2.jpg?v=1789268137)




![Artificial Intelligence for Business + LLM Prize [2026]](/programming/artificial-intelligence/images/1990136_15e0_10.jpg?v=1789298349)






