Web Scraping in Python Selenium, Scrapy + ChatGPT Prize (Udemy.com)
4 projects with Beautiful Soup, Selenium and Scrapy | ChatGPT for web scraping
Created by: Frank Andrade
Last updated November 2025
What you will learn
- Learn to scrape website from scratch with Beautiful Soup
- Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)
- How to use ChatGPT for web scraping
- 4 web scraping projects (from beginner to advanced projects)
- Handle pagination with any scraping tool
- Learn to scrape JavaScript website with Selenium and Scrapy-Splash
- Store the extracted Data in MongoDb & SQLite3
- Scrape infinite scroll websites
- Login to websites using Selenium & Scrapy
How it compares
Against the other 815 rated Udemy courses in Web Development on CourseDuck:
- Rating4.4 out of 5higher than 33% of them
- Reviews2,277#89 of 816 by number of reviews
- Length10.8 hourslonger than 61% of them
- Last updatedNovember 2025more recently than 67% of them
Course Description
Have you ever thought about how important is data in our everyday life?
It doesn't matter if you're a data scientist, data analyst, or programmer, getting access to the data you need is important! This is why some of the top Fortune 500 companies such as Walmart, Target, and CNN use web scraping to stay ahead with data. We can say this is one of their best secret weapons.
Welcome to Web Scraping in Python with BeautiuflSoup, Selenium, and Scrapy!
The most complete and project-oriented course. In this course, we're going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. To name a few:
Amazon Audible
Twitter
Google
Football Stats
Worldometers
Movie pages
This is the most complete web scraping course in Python and is split into 3 parts: BeautiuflSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.
Why I built the course this way?
Beautiful Soup has a lot of limitations, but it's still useful for a gentle introduction to web scraping. In contrast, if you learn Selenium you will be able to scrape any website. and if you add Scrapy to your toolkit you will be able to scrape any website faster than with any other web scraping library. Throughout this course, you will see the power of web scraping with each Python library.
What makes this course different from the others, and why you should enroll?
This is the most updated and complete web scraping course in Python. You will be using Python 3.7, Scrapy 2.4, Selenium 3.141.0 and BS4
This is the most project-based course you will find. We will scrape many of the most well-known websites
You will have an in-depth step by step guide on how to become a professional web scraper.
You will learn how to use Selenium, Scrapy, and Splash to scrape JavaScript-driven websites. You won't find any tutorials out there that teach how to use these web scraping tools the way I do in this course.
You will learn how to use ChatGPT for web scraping
30 days money back guarantee by Udemy
At the end of the course, you'll know how to build your own web scraper to obtain new data, learn the best techniques for web scraping and more.
Join me now and let's start scraping the web together!
Instructor Details
- 4.4 Rating
2,277 Reviews
Frank Andrade
I'm a data scientist and my passion is teaching. I have done it for many years. I have taught the fundamentals of programming and web scraping to hundreds of people including undergraduates and professionals. Also, I share my knowledge on YouTube and Medium to thousands of people every day.
I'm looking forward to seeing you in my course. I'll be there for you on every step you make and answer any questions you have!
More courses by Frank Andrade
ChatGPT Unleashed: The Complete ChatGPT Course (2025)
4.6 (4,172 Reviews)
Provider: Udemy
Time: 9.1h
$19.99
More Web Development courses
Python Fullstack Mastery: Build Modern Web Apps with Django (2025)
5.0 (165 Reviews)
Provider: Udemy
Time: 35h
$19.99
NgRx Signal store for Angular - The missing guide (2026)
4.9 (436 Reviews)
Provider: Udemy
Time: 11.3h
$89.99
Vue 3: Create a Mobile & Desktop App (with Quasar 2 & Pinia) (2024)
4.9 (177 Reviews)
Provider: Udemy
Time: 7.6h
$79.99
Build a URL Shortener App with ASP.NET: Step by Step (2026)
4.9 (100 Reviews)
Provider: Udemy
Time: 9.6h
$10.99
The Complete Elixir and Phoenix Bootcamp (2021)
4.8 (7,773 Reviews)
Provider: Udemy
Time: 17.4h
$84.99
Reviews
By Zandile Ntshuca on 6/15/2026
Course gives a lot of basic knowledge but your use cases are outdated, so I had to find alternatives. Not sure if it counts as a course, luckily I have dev experience so the concepts weren't new. I am unfortunately left confused as to whether I would recommend it or not, also you rushed through everything not sure if that was to compress the material, but nonetheless it feels like working with someone with more experience than you and they tend to get irritated easily but the solution is only working for them.
By Arpan Kumar Das on 11/27/2025
I’m enjoying your course, but many parts of the Selenium section use older methods like find_element_by_xpath, which no longer work in the latest Selenium versions. Modern Selenium (2025–2026) uses the By class instead, such as driver.find_element(By.XPATH, ...). It would be very helpful if you could update the Selenium lessons with the new syntax, the current WebDriver setup, and the latest best practices. This will make the course more accurate and valuable for learners in 2025 and 2026. Thank you for your hard work, and I hope the updated content can be added soon!
By Milton R. Valle Lora on 5/23/2025
633 / 5,000 This is a very good web scraping course. It covers three libraries that guide you through successful web scraping, and it also allows you to perform the same task by taking advantage of the versatility and unique features of each library. On the other hand, the instructor's approach to the lessons is quite long and easy to understand. However, this course is outdated, and if you're going to take it, you'll need to dedicate some extra time to successfully complete it. This may be a plus for some and a minus for others.
By Jieting Lian on 8/2/2024
Overall, it's a really great class since I learn how to crawl data from different websites using different tools, The cases are real-life, and it's useful and all-sided. The class content teaches you in a logical way that you can learn tools from the simplest to the most difficult, and every step is logical, and you can simply learn how to crawl data and type the code by watching and practicing by following the video's path. However, some class content is outdated and needs time to figure out how it will run well in the latest version. And Section 17 is the only section I don't like at all, and that's the reason why I gave it four stars instead of five. It's really confusing and makes it feel like bed since I feel like I lose my mind and path after learning the scrapy and then turn around to learn the selenium unfinished content again. And section 17's example is weird since it's not consistent. After I learned how to log in, I should learn how to crawl infinite pages content after logging in instead of learning from a new page that how I can crawl infinite pages. If you follow the lesson's path in Section 17, you can't run well since it didn't tell you what you should do to scrape infinite pages after logging in.
By Dr Pietro Di Modica on 5/16/2023
The content is clear, at the right pace and useful. The only reason is not a full 5 stars, is that the PyCharm version available now is slightly different than the one used in the teaching material and it may take a little longer to find the button to click. A brief introduction to the PyCharm IDE could help, for those who are used to other IDE such as Jupyter notebook or Spider.
By Mauricio Solis Cipriano on 2/3/2023
Frank is a good Teacher, he explained these topics very well because he covered the time needed for each topic depending on its usefulness, and the last section gave the necessary info on how to represent the already scraped data in a useful way.
By Hector Sanchez on 7/6/2022
Incredible course. I must confess that initially when I saw this course was 9 hours, I thought I would finish it in 2 days, but it took me over a week. But I'm glad I stuck until the end as I learned a LOT!. This course didn't go deep into XPath, so I had to buy another short course that focused only on Xpath and I practiced a lot until I had a better understanding. Once you understand how selecting elements with Xpath works, the rest of the course goes very smoothly.
By Jonathan Liu on 5/25/2022
Before taking this course, I did not have a lot of knowledge of web Scraping. This course covers many materials and methodologies how to scrap data/information from the web. One thing I really appreciate instructor Frank for that he helped me with some coding how to scrap some things like the number counts of Like, Reply and Retweet from users in Twitter. Thank you, Frank.
By David Cini on 5/16/2022
I've completed the course in about a week. This course is great if you want to learn the basics of web scraping, but it doesn't teach you how to get around proving that you are not a robot and redirects. Example: trying to scrape zillow.com using scrapy/splash doesn't work with just the knowledge form this course. It would also be nice to know the best practices when web scraping. Like what freelance web scrapers do to avoid getting blocked form a website and more. Overall this course is good if you are scraping websites that you don't have to bypass any checkpoints.
By Boelo Niemeijer on 2/6/2022
This was the third course on scraping I tried and the best one. I especially liked your guided explanations with regards xpaths and lua script, which was kind of not clear in other courses I tried. In fact your presentation was clear in every lesson and the course was well-structured, and because of that I did not run into any frustrations. I only thought you could've spoken up a little more.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 88 / 100







