The Ultimate Web Scraping With Python Bootcamp 2024 (Udemy.com)
Learn to extract data from the web with python with just one course, covering selectolax, playwright, scrapy and more
Created by: Andy Bek
Last updated July 2026
What you will learn
- Understand the fundamentals of web scraping in python from absolute scratch
- Scrape information from static and dynamic websites and extract it to a variety of formats
- Intercept and emulate hidden APIs to identify highly productive alternatives to getting your data
- Master the requests library for working with HTTP
- Parse and extract content from HTML using beautifulsoup, selectolax, and Microsoft Playwright
- Master complex CSS selectors including descendant, child, sibling combinators
- Understand how the web works, including HTTP, HTML, CSS, and JavaScript
- Create scrapy crawlers and practice items, itemloaders and custom pipelines
- Integrate scrapy with playwright for highly performant, fine-tuned dynamic website crawling
- Practice processing and extracting data to a variety of formats including csv, json, xml, and SQL
How it compares
Against the other 815 rated Udemy courses in Web Development on CourseDuck:
- Rating4.1 out of 5higher than 7% of them
- Reviews399#324 of 816 by number of reviews
- Length17.5 hourslonger than 75% of them
- Last updatedJuly 2026more recently than 89% of them
Course Description
Welcome to the Ultimate Web Scraping With Python Bootcamp, the only course you need to go from a complete beginner in python to a very competent web scraper.
Web scraping is the process of programmatically extracting data from the web. Scraping agents visit a web resource, extract content from it, and then process the resulting data in order to parse some specific information of interest.
Scraping is the kind of programming skill that offers immediate feedback, and can be used to automate a wide variety of data collection and processing tasks.
Over the next 17+ hours, we will methodically cover everything you need to know to write web scraping agents in python.
This bootcamp is organized in three parts of increasing difficulty designed to help you progressively build your skill.
Part I - Begin
We'll start by understanding how the web works by taking a closer look at HTTP, the key application layer communication protocol of the modern web. Next, we'll explore HTML, CSS, and JavaScript from first principles to get a deeper understanding of how website are built. Finally, we'll learn how to use python to send HTTP requests and parse the resulting HTML, CSS, and JavaScript to extract the data we need. Our goal in the first part of the course is to build a solid foundation in both web scraping and python, and put those skills to practice by building functional web scrapers from scratch. Selected topics include:
a detailed overview the request-response cycle
understanding user-agents, HTTP verbs, headers and statuses
understanding why custom headers can often be used to bypass paywalls
mastering the requests library to work with HTTP in python
what stateless means and how cookies work
exploring the role of proxies in modern web architectures
mastering beautifulsoup for parsing and data extraction
Part II - Refine
In the second part of the course, we'll build on the foundation we've already laid to explore more advanced topics in web scraping. We'll learn how to scrape dynamic websites that use JavaScript to render their content, by setting up Microsoft Playwright as a headless browser to automate this process. We'll also learn how to identify and emulate API calls to scrape data from websites that don't have formally public APIs. Our projects in this section will include an image scraper that can download a set number of high-resolution images given some keyword, as well as another scraping agent that extracts price and content of discounted video games from a dynamically rendered website. Topics include:
identifying and using hidden APIs and understanding the benefits they offer
emulating headers, cookies, and body content with ease
automatically generating python code from intercepted API requests using postman and httpie
working with the highly performant selectolax parsing library
mastering CSS selectors
introducing Microsoft Playwright for headless browsing and dynamic rendering
Part III - Master
In the final part of the course, we'll introduce scrapy. This will give us an excellent, time-tested framework for building more complex and robust web scrapers. We'll learn how to set up scrapy within a virtual environment and how to create spiders and pipelines to extract data from websites in a variety of formats. Having learned how to use scrapy, we'll then explore how to integrate it with Playwright so that we tackle the challenge of scraping dynamic websites from right within scrapy. We'll conclude this section by building a scraping agent that executes custom JavaScript code before returning the resulting HTML to scrapy. Some topics from this section:
learning how to set up scrapy and explore its command line interface ("the scrapy tool")
dynamically explore response objects using scrapy shell
understand and define item schemas and load data using itemloaders and input/output processors
integrate Playwright into scrapy to tackle dynamically rendered JavaScript sites
write PageMethods to specify highly specific instructions to the headless browser from right within scrapy
define custom pipelines for saving into SQL databases and highly customized output formats
In this bootcamp, I will take you step-by-step through engaging video lectures and teach you everything you need to know to get started with web scraping in python.
By the end of this course, you will have a complete toolset to conceptualize and implement scraping agents for any website you can imagine.
See you inside!
Instructor Details
- 4.1 Rating
399 Reviews
Andy Bek
Hi! I'm Andy, a freelance software developer and capital markets consultant based in Toronto, Ontario. I've spent close to a decade working with data, using code to automate business workflows, and consulting financial institutions on data-intensive applications.
Although I'm comfortable in a number of programming languages, nothing beats python on a ROIE (return on invested effort) basis. It is my go-to language and also my focus here on Udemy.
Aside from teaching, I specialize in consulting financial institutions in post-trade services technology.
More courses by Andy Bek
The Ultimate Pandas Bootcamp: Advanced Python Data Analysis (2026)
4.5 (2,747 Reviews)
Provider: Udemy
Time: 32.1h
$99.99
Python Object Oriented Programming (OOP): Beginner to Pro (2026)
4.5 (808 Reviews)
Provider: Udemy
Time: 26.8h
$79.99
Building GraphQL APIs with Python: Beginner To Pro (2026)
4.5 (339 Reviews)
Provider: Udemy
Time: 12.2h
$79.99
Learning Pydantic: Advanced Data Validation In Python (2026)
4.5 (163 Reviews)
Provider: Udemy
Time: 11.3h
$84.99
Practical SQL With Python In 3 Days: Beginner to Pro (2026)
4.4 (97 Reviews)
Provider: Udemy
Time: 17.1h
$74.99
More Web Development courses
Python Fullstack Mastery: Build Modern Web Apps with Django (2025)
5.0 (165 Reviews)
Provider: Udemy
Time: 35h
$19.99
NgRx Signal store for Angular - The missing guide (2026)
4.9 (436 Reviews)
Provider: Udemy
Time: 11.3h
$89.99
Vue 3: Create a Mobile & Desktop App (with Quasar 2 & Pinia) (2024)
4.9 (177 Reviews)
Provider: Udemy
Time: 7.6h
$79.99
Build a URL Shortener App with ASP.NET: Step by Step (2026)
4.9 (100 Reviews)
Provider: Udemy
Time: 9.6h
$10.99
The Complete Elixir and Phoenix Bootcamp (2021)
4.8 (7,773 Reviews)
Provider: Udemy
Time: 17.4h
$84.99
Reviews
By Cakka on 8/31/2025
Bad voice quality (his pronunciation). I also can’t hear his voice clearly if my speaker volume is below 75%. No response to my questions. No complete source code. You have to type everything manually to follow the tutorials. It wastes more time to type all the code just to check if it still works or is already deprecated. Some code from the video tutorials also doesn’t work, and I had to fix it myself. Looks like this course isn’t managed anymore by the tutor.
By Chern Hwee Low on 6/4/2025
Sections 9 onwards (currently at Section 12) do not work at all. Section 9 requires a proxy to work Section 10 - 11, I rather suggest you to use Python Selenium instead Even if not working, should have suggestions via comments but not working and stale. Video sound is getting lower, suggesting that there is no editing of the videos.
By Michal Salvet on 5/17/2025
Well I think the course is good and Andy gives a lot of extra knowledge which is probably a problem for some people who has no prior python knowledge and just use included crash course. Python is getting sometimes kind of heavy for beginners. But I liked this part since it gives me window into a mind of professional programmer and it is also good challenge. As other reviews stated some videos are outdated but it is good opportunity to actually use your head and adjust the code accordingly. I went over the course twice and I'll do third run. On the negative side I agree there is no feedback at the moment. Also I would like more advanced and deep look in scrappy. It feels that just only surface was scratched on scrappy subject. Maybe Andy can do another course where he will focus only on scrappy and playwright in depth. Overall I recommend the course. Amount of knowledge is very good compare to other courses. I do not understand how anybody can buy 2-4 hour course where you only learn requests and beautifulsoup. Such a course is waste of money.
By Mathew Bushell on 9/7/2024
I think this is very thorough and is giving me confidence that this course will provide me with a strong foundation to the concepts covered. 0.5 star deduction because the descriptions/explanations so far could be a little bit more clear and concise, but still great over all. *NOTE I was prompted for this review by udemy after lesson 5 which is still very early on in the course, so this is not a final review and not indicative of my satisfaction with the course over all. So far I'm really enjoying it!
By Salsabeel Salah on 9/2/2024
This course is great. It covers lots of web scraping practices like BeautifulSoup, requests, playwright and scrapy. It also has multiple good project to add to your portfolio. It is a great course to start with. It helped me put my feet on the ground so I can start doing my own web scraping projects. Thanks a lot :)
By Krittaprot Tangkittikun on 7/22/2024
I was a bit unsure whether I should take this course, after reading reviews, I decided to do it. So far, I am happy with the content and how concise the videos are, I hope that this will continue till the end too and hopefully the material is still relevant to today's web scraping practice!
By Bob Andrews on 3/7/2024
I don't generally leave feedback but this course is awesome! I have been using Python for quite some time and am 'functional' at getting the job done but still often frustrated by the holes in my self taught approach. This course not only covered the material in a very easy to follow sequence but it did so thoroughly while also covering several areas I have struggled with and some I hadn't had time to explore on my own yet! This is one of the alltime best courses I have taken. The instructor is methodical, extremely knowledgeable, and presents the material at a comfortable pace! This course impressed me enough to investigate other courses from this instructor!
By Chintamani Modak on 10/23/2023
So far i am enjoying this course very much. Instructor's training delivery is top notch and is covering important foundation for web scraping . i am gaining more confidence with his each lecture to become more experienced web scraper in future.
By Pieter ten Have on 10/3/2023
This is a very useful course for me. It contains a lot of relevant information. Occasionally however, something doesn't work exactly like Andy's code and then it takes a lot of time to figure it out. I recommend this course to everyone how wants to learn webscraping, and has willpower and time to solve little issues on the way.
By Mahmoud Osman on 8/14/2023
Great course, from zero to hero. Instructor is not assuming any prior knowledge, explaining the concepts in clear and concise manner and then diving into the technical depth. My only setback was lack of instruction on how to setup the Python environment but other than this the course is flawless.
Quality Score
No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.
Overall Score : 82 / 100












