Skip to content
UdemyWeb DevelopmentPaid courseBeginner levelCertificate

Modern Web Scraping Fundamentals with Python (Udemy.com)

Harness the power of Scrapy, BeautifulSoup and Selenium to boost your webscraping game!

Created by: Jordan Sauchuk

Last updated June 2024

icon
What you will learn

  • Understand the most important components for web scraping
  • Build their own web scraping projects
  • Learn core components of two of the most powerful scraping libraries: Scrapy and BeautifulSoup
  • Build multiple hands-on projects

icon
Course Description

Getting access to the data you need can make or break you.

This is why Fortune 500 companies like Walmart, CNN, Target, and HSBC use web scraping to get ahead and stay ahead with data.

It’s the original growth tool and one of their best-kept secrets


…And it can easily be yours too.


From data spoofing to legalities, crawling libraries, maintenance, monitoring, more, building a safe and effective web scraper is risky business but it’s a skill every data scientist needs in their toolkit.


Today, we’re building one from scratch.


Hi, my name is Jordan Sauchuk. I’m an AI & Cybersecurity Engineer and a SuperDataScience instructor. I’m here to guide you step-by-step in building custom web scrapers in Python using Selenium, Scrapy and BeautifulSoup.


Welcome to Modern Web Scraping in Python.


At the end of this course, you will understand the most important components of web scraping and be able to build your own web scrapers to obtain new data, optimize internal processes and more.


Plus, familiarize yourself with some of the most common scraping techniques and sharpen your Python programming skills while you’re at it!


  1. First, learn the essentials of web scraping, explore the framework of a website and get your local environment ready to take on scraping challenges with Scrapy, BeautifulSoup, and Selenium.

  2. Next, set up a Scrapy crawler and cover the core details that can be applied to building datasets or mining.

  3. Next, cover the basics of BeautifulSoup, utilize the requests library and LXML parser, and scale up to deploy a new scraping algorithm to scrape top product information from Amazon

  4. Fourth, set up Selenium, and deploy it to solve a practical, real-world challenge. Plus, submit your solution to obtain useful feedback from me.

  5. Finally, test your newfound skills on a cybersecurity project that involves you finding highly-sensitive data.


We’l bel coding in Python, and using the automated testing suite Selenium, the Python framework Scrapy, and library BeautifulSoup to build web scrapers that can be customized to your specific needs.


But a thorough walk-through isn’t all you’re getting.


Access our student forum where you can interact with me and your fellow students. Ask me questions, receive input from other students and be inspired by the clever scraping solutions from your classmates.


Whether you’re a data scientist, machine learning or AI engineer who wants to access more data sources; a web developer looking to automate tasks, or a data buff with a general interested in data science and web scraping…


This course delivers an in-depth presentation of web scraping basics, methodologies and approaches that you can easily apply to your own personal projects, or out there in the real world of business.


Join me now and let’s start scraping the web together. Enroll today.


icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Jordan Sauchuk

I'm a Senior AI Advisor, AI & Cybersecurity Engineer, and also the founder of Global Pioneers & the Threat Intelligence Group. My goal is to help provide my experiences and expertise that have been obtained through extensive research, many late nights, and cups of coffee.

I have been fortunate enough to work on a range of challenging projects worldwide and I have extensive experience specializing in technologies such as Python, Docker, Kubernetes, AWS, Azure, R, JavaScript, C++, PHP, Tensorflow, Pytorch, Scikit-Learn, Keras, ReactJS, NodeJS, SQL, Plotly, Tesseract, Seaborn, and much more.

Recently, I have launched the Threat Intelligence Group as a means of providing cybersecurity awareness, integrating AI into the security domain, and also providing consulting services.

For more information please feel free to reach out to me on LinkedIn and Twitter.

icon
More Web Development courses

$59.99

$19.99

$19.99

$19.99

$74.99

$89.99

icon
Reviews

4.2

870 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Olaf Dedig on 2/5/2025

It is a good course and the instructor is well spoken and a great communicator, however there are several code section and module installs that are no longer current and pages that you test your scraping against no longer exist. It is a great course to get you going though

By Aflah Tazakka on 8/29/2021

what I like the most here and make this course so much better than other courses is the instructors who are passionate to teach this can be seen from the frequent responses to QnA and the many challenges that are given so that it gives many opportunities to apply what is taught

By Gaurang Mehra on 7/8/2021

Jumps all over the place. Key explanations are missing. More for programmers than data analysts/scientists. Analysts and data scientists are more concerned with data frames, SQL and are less trained in objects and classes etc. Scrapy was covered too fast, key concepts were glossed over. Looking for something more practical

By Gabriele Cerioli on 6/2/2021

Good course on foundamentals of web scraping through Python with Selenium, BeautifulSoup and Scrapy. Very well explained with a step-by-step approach. I wish there had been more examples with dinamic web pages and search buttons/ filters, multiple pages and so on. Selenium is a very new and fantastic tool form my pesonal experiece! Very powerful!

By Ahmed Khalaf on 5/7/2021

I swear I have never known the real power of Python programming, machine, and deep learning until I took this course. It might be nothing but a swift introduction of Web scrapping but it is also very informative. Thanks a lot for this course.

By Natacha Sofia Mouco Morais on 4/21/2021

I think the instructor should give more context about the libraries before jump in to them. For Beautifull Soup and Selenium I already had some familarity with it, so it was easy to follow, but for Scrapy it was a bit hard to follow up. Nevertheless it has some good info.

By Anonymized User on 4/7/2021

Clearly a accessible introduction to webscraping if you have already taken a 5h-10h of Python class. You will be able to be more autonomous with the new concepts learnt during this lesson and do something more complex for each challenge (and you clearly can). I really didn't get a good grasp of Scrapy. I wouldn't be able to interface a python script and Scrapy. However BeautifulSoup and Selenium, were well explained and was able to use them quickly for my own script. Readability could have been better making it hard some time to find errors and differences in the code.

By Sanjuro Kietlinski on 2/26/2021

Very good course. Learned webscraping literally from scratch. I'd recommend adding more depth and context, especially as it relates to Scrapy, given that it's a bit more complex that bs4 or selenium

By Animesh Tripathi on 1/30/2021

At the time of doing this course I made an Automated facebook login bot which will google search facebook and login with typing userId and Password and logged in on facebook ... Thats amazing Experience Loved the course

By Frank Morrell on 10/26/2020

Excellent experience. His voice is easy to understand. Very well laid out course with great examples of exactly how to do things.When you have a problem, he quickly gets right back to you with help. Outstanding in all respects.

Showing all 10 reviews on CourseDuck

Read all 870 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 84 / 100