Skip to content
Write a review
UdemyWeb DevelopmentPaid courseBeginner levelCertificate

Web Scraping 101 with Python3 using REQUESTS, LXML & SPLASH (Udemy.com)

Web Scraping for absolute beginners with Python using Requests, the powerful LXML and Splash for JavaScript websites

4.4
404 reviews

Created by: Ahmed Rafik

Last updated March 2020

icon
What you will learn

  • LXML core fundamentals
  • XPath & CSS selectors
  • How send HTTP requests with Python
  • Scraping HTML web pages
  • Scraping multiple pages using recursion
  • Scraping APIs
  • Splash HTTP API
  • Scraping JavaScript websites using Splash
  • Authentication and Login to websites using Requests
  • Web scraping best practices
  • Building datasets

How it compares

Against the other 815 rated Udemy courses in Web Development on CourseDuck:

  • Rating4.4 out of 5higher than 33% of them
  • Reviews404#322 of 816 by number of reviews
  • Length4.5 hoursshorter than 66% of them
  • Last updatedMarch 2020earlier than 85% of them

icon
Course Description

What is web scraping ?

Let's say your boss at work gave you a task where he wants you to extract about 1000 product from a website, structure the data and save it to a database, would you copy paste manually all the product details from the product name, url and price ? I can imagine you would work days and nights and you wont finish the task, so this is where web scraping shines. So web scraping, or web harvesting or web data extraction is like writing a script that will automate data extraction from websites in a matter of minutes !.

Why learn Web Scraping ?

Whether you're a data analyst, a web developer or even someone who wants to work as a freelancer you should learn web scraping. 

For a data analyst building a dataset is extremely important, so without web scraping you simply can't generate it in addition to that adding web scraping in your resume is a plus for you.

Web scraping can be used in a variety of fields, so let me give you some examples on what you can do with it:

  1. Generate leads,

  2. Drop shipping where basically you gonna constantly scrape products from different online stores and show case them on your website to make money,

  3. Monitor products prices to get the best deals,

  4. automation,

  5. Machine learning,

  6. Web scraping freelancer

Of course there are tons and tons and variety of fields where web scraping can be extremely beneficial.

Is this course the right one for you ?

I've carefully planned and designed this course to be beginner friendly, from my experience I know those who do web scraping are mostly data analyst with no background knowledge on how the web works, how requests are made, how to locate and parse the data from the web and much much more, in addition to that this the most updated course regarding the material included and the tools used, so in this course

  1. I'll introduce to you the most used web scraping tools/frameworks

  2. We will setup the development environment from scratch

  3. You will learn and understand LXML core fundamentals

  4. How to use XPath & CSS selectors to select the data from a web page

  5. How the web works (Request/Response)

  6. How to scrape simple HTML web pages

  7. How to scrape multiple web pages

  8. Extract data from APIs

  9. You will learn Splash(crash course) so you can use it to scrape JavaScript websites

  10. Authentication/Login

  11. Store the extracted data whether to JSON/CSV files or MongoDb/SQLite3

  12. Exclusive tips and tricks regarding web scraping

Finally this course is project based, each section starting from the 2nd one we will experiment with a different website, each project has a certain degree of difficulty  and each one is completely independent from other projects. 

Is there is any assignments/exercises included in this course ? 

Yes, each section has an assignment included to it, this will help to get your hands dirty and by the end of each section after doing the assignment included you will feel more confident and comfortable with web scraping.

Why LXML and not BeautifulSoup ?

LXML is a lightweight HTML parser even the most popular web scraping framework (Scrapy) is built on the top of LXML, BeautifulSoup is a little bit overloaded with the number of functions exposed to us, it has more functions to use, yes that's right ! however in Web Scraping most of the time we use XPath and CSS Selectors to navigate and select what to scrape from the HTML web page (tree) so there is no need to learn about new functions and wasting all that time to familiarize yourself with the BeautifulSoup API and the internal architecture, in addition to all of that LXML in terms of performance is way better than BeautifulSoup.

Who is your instructor ? 

Hi! I'm Ahmed nice to meet you, my students prefer to call me web scraping Ninja and currently I have taught more than 2000 students around the world how to do web scraping. I personally do web scraping on daily basis whether for fun, for personal projects or as a freelancer and guess what ? I even have a master degree in computer science.

Should I enroll to this course ?

Honestly, by enrolling to this course you have nothing to lose, because if this course didn't meet your requirements, you can always ask for a refund in less than 30 days from the day you enrolled to the course guaranteed by Udemy with NO QUESTION TO ASK !

SO IF YOU DON'T KNOW ANYTHING ABOUT WEB SCRAPING & YOU DON'T KNOW WHERE TO START  ENROLL NOW ! :)

Read More Beginner Beginner Level product length iconTime: 4.5h

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Get the Udemy discount

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Ahmed Rafik

Who I am?

I’m Ahmed Rafik, I'm a self-taught developer & an online teacher on Udemy. I've helped thousands of people learning web scraping with Python using different tools such as Scrapy, Splash & Selenium.

As a self-taught developer, I found myself jumping between different tutorials and (e-)books trying to understand how things can work out together, I was literally wasting so much time trying to connect the dots rather than learning how to code and over time this has become so overwhelming with lots of things to learn and to connect.

I believe coding should be easy for everyone but this also requires you to choose the right instructor with the right knowledge.

In my courses, I'm gonna teach you the skills you need to start your web scraping career from the get-go with no fluff. I try as much as possible to avoid the boring theoretical explanations unless it's necessary, I always keep my courses up to date and that's what helped me to have the highest-rated and the best selling web scraping courses on Udemy.

I can't wait to see you enrolled in one of my courses, I'll make sure to be there for you on every step you make and answer any questions you have.

Read More

icon
More courses by Ahmed Rafik

$79.99

$10.99

All courses by Ahmed Rafik

icon
More Web Development courses

$19.99

$89.99

$89.99

$79.99

$10.99

$84.99

All Web Development courses

icon
Reviews

4.4

404 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

Write a review

By Linda F on 12/5/2022

Bought this course 2 years ago, and now I have time to really learn this with all my concentration, and AMAZING, this course exceeds my expectation, even if it's outdated, the knowledge and the tricks are still working, he is really a NINJA in web scraping world and he is not holding his knowledges, THANK YOU SO MUCH, I bought all of your courses, please make more and more, also, can you please include the new PLAYWRIGHT course as an alternative to Selenium?

By Carlos Campos on 11/16/2022

Great for learning how to work with CSS selectors & Xpath's.

By Ting Wei Chang on 4/17/2022

very good course for people who want to start learning the concept of web scraping, however if you've already bought Ahmed Rafk's Modern Web Scraping , I won't recommend this one since there're 1/3 of the content are the same (if you're very sure that only want to learn splash, then you could skip this one). But still a great course for begginner ！

By Nisith on 11/17/2021

no response in Q&A (in product details he claim he will answer question within 24 hrs)

By Dr David J Buchanan on 4/30/2021

This is well explained. I think a good understanding of html, css and python is required to understand the content. The examples are appropriate and bite size. After completing the intro sections I am confident I will understand the rest of the course. So I am now on section 6 and things are going well. Some of the sites Ahmed scrapes have been updated so you just have to follow along and do your best to tweek the code to work with the updated webpages.

By Benjamin Singh on 8/20/2020

Very good introduction to web scraping in Python. I got everything I expected! Basic experience in Python and web development are required imho. Otherwise you won't understand everything. I liked the project based approach and the real world assignments. This is how every course should be structured. I already bought his other 2 courses which I plan to complete as well.

By Jennie Taylor on 4/30/2020

I have learned webscraping in many ways and this one actually answers some of the questions that I had been unable to get answers to previously. I am provided with key shortcuts that help eliminate a lot of clicking, as well as various angles to obtain an element. This class has been greatly informative and helps me feel more comfortable with webscraping. Thanks!

By Kadir Keles on 3/29/2020

The course felt somehow challenging at the beginning. Then I spent some time gathering further basic knowledge, going through some other sources. Once I figured the concept, I came back to this course and I want to say a big THANK YOU for categorizing parser methods so well, precise and clearly. Start with Ahmed's examples in your practice but keep practicing with your favorite websites, other examples. This course is all you need to begin practicing, and in no time you will nail it!

By David Cheng on 7/25/2019

Amazing and Extremely useful lectures! With the only first 2 sections, I was able to build my first code to check the lowest price for online shopping flawlessly! 5 stars are not enough to describe how great the instructor Ahmed Rafik is. I enrolled his another lesson in the second day. This is the quick lesson to build your first code in 30min for web scarping! Saving a lot of my time browsing between different website. The BEST one in Udemy!

By Eric on 7/16/2019

It is clear from the material and presentation that the instructor is an experienced working professional who is not only knowledgeable but also articulate with the material. One of the best instructors I have watched on Udemy. Kept me engaged for hours at a time. I was putting the lessons to practical use for my business immediately. I highly recommend the course and the instructor. Please teach more courses. Thank you!!!

Showing all 10 reviews on CourseDuck

Read all 404 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 88 / 100

Web Scraping 101 with Python3 using REQUESTS, LXML & SPLASH
Visit course on Udemy Write a review
  • Video Duration: icon 4.5h
  • Price: $12.99
  • Provider: icon Udemy
  • Updated: icon March 2020
  • Level: Beginner Beginner
  • Language: icon English
  • Certificate: icon Yes
30-day money-back guarantee on most paid courses

Udemy Coupon Price Tracker

Udemy price history

For any issues or feature requests please email CourseDuck's Co-Founder at mkuhlman12@gmail.com