Skip to content
UdemyPythonPaid courseIntermediate levelCertificate

Web Scraping with Python: BeautifulSoup, Requests & Selenium (Udemy.com)

Web Scraping and Crawling with Python: Beautiful Soup, Requests & Selenium

Created by: GoTrained Academy

Last updated December 2018

icon
What you will learn

  • Python Refresher: Review of Data Structures, Conditionals, File Handling
  • How Websites are Hosted on Servers; Basic Calls to Server (GET, POST Methods)
  • Web Scraping with Python Beautiful Soup and Requests
  • Using Selenium to handle JavaScript and AJAX
  • Diverse Web Scraping Exercises
  • Source codes (*.py files) for all Exercises can be downloaded
  • Q&A board to send your questions and get them answered quickly

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 86 / 100

icon
Course Description

Web Scraping (also termed Screen Scraping, Web Data Extraction, Web Harvesting, etc.) is a technique for extracting large amounts of data from websites  and save the the extracted data to a local file or to a database.

In this course, you will learn how to perform web scraping using Python 3 and the Beautiful Soup, a free open-source library written in Python for parsing HTML.

We will use lxml, which is an extensive library for parsing XML and HTML documents very quickly; it can even handle messed up tags. We will also be using the Requests module instead of the already built-in urllib2 module due to improvements in speed and readability.

Finally, we will use Selenium alongside Beautiful Soup to crawl AJAX & JavaScript driven pages.

The course cover the following topics: accessing web pages programmatically; scraping web pages to extract the required data using Beautiful Soup to parse web pages; interacting with web pages to do different things with them programmatically; and using Selenium for web scraping and when we need it.

By the end of this course, you will be able to understand how websites and servers function, diverse data extraction techniques, and methods of handling and organizing data.

This Web Scraping course covers the following topics:

  • Review of data structures (Lists, Dictionaries, Tuples, File Handling)
  • How websites are hosted on servers
  • Calls to the server (GET, POST methods)
  • Review of HTML and CSS
  • Requests Module and BeautifulSoup Module overview
  • Parsing HTML using BeautifulSoup
  • Filtering elements using BeautifulSoup and navigating the Parse Tree
  • JavaScript and AJAX overview
  • Selenium and the need for it
  • Selecting elements using Selenium 
  • CSS selectors 
  • XPath selectors 
  • Navigating pages using Selenium 
  • Practical Projects



icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

GoTrained Academy

GoTrained is an e-learning academy aiming at creating useful content in different languages and it concentrates on technology and management.

We adopt a special approach for selecting content we provide; we mainly focus on skills that are frequently requested by clients and jobs while there are only few videos that cover them. We also try to build video series to cover not only the basics, but also the advanced areas.

icon
More courses by GoTrained Academy

$11.99

icon
Reviews

4.3

927 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Hynek Kyvala on 11/23/2024

The course is well-structured and easy to follow, making it accessible even for beginners. However, the last update was in December 2018, and some websites used for scraping have since changed. This made completing the final project (scraping pictures from Instagram) impossible due to Instagram’s suspicious login alerts and the need for email confirmation codes. Despite this, I’m giving the course 4.5 out of 5 stars because the 8 hours of content provided a clear understanding of the concepts and allowed me to learn a lot.

By Juan Pablo Balut Repetto on 5/27/2020

Course is not updated. Libraries used and html structures of pages analyzed have changed.

By Manas Paul on 7/17/2019

This Tutorial really awesome. Really I have learnt web scrapping from this tutorial. Author is really good, quick replied. Great example with proper totpic. I will recommended that, if anybody are interested web scrapping first you need to read this tutorial. Thanks for this.

By Ignacio Soteras Gutiérrez on 2/24/2019

I liked a lot this course, I impressed me a lot what kind of things you can do with a bit of Python, BS and Selenium. I enjoyed a lot the first exercise and specially the final project. At the beggining the level is a bit high for students without prior knowledge in Python and could be intimidating for newbies. Due to this, I wouldn't recomend it for newbies in Python, which was not my case. Later the teacher makes an effort to explain a bit the IDE and some basic notions of Python which are useful to refresh concepts. All the excercises are explained step by step and even though at the beggining it can be slow, at the end, you will understand why and the reward will left you without words. The final project left me with amazed of what sort of things you can do, even though this is only the top of the iceberg. During this project, I had some problems due to the local languaje, but with the teacher help, I was able to understand why they were raised and how to solve them with practical examples. Thank you very much

By Life-Long Data Science Learner on 1/11/2019

I cannot say enough good things about this course. Waqar (the teacher) is an absolutely-fantastic instructor. At first, I felt that this course was a bit all over the place. But, once I started getting the hang of this, I realized that this course is actually really well organized, and does a nice job of teaching web scraping. I found this course to be fairly comprehensive, despite that it aims to be a beginners' course. I would like to strongly recommend this course.

By Michael Sweet on 1/7/2018

good review so far...I left this rating early in the course. I am now learning new things and think this is an excellent and very well taught course. Final Review - Excellent and well taught course. Instructor was very nice and easy to understand. I learned something useful. Would recommend.

By Rajiv Mehrotra on 1/6/2018

Great course - well explained concepts. I would advise playing the videos at twice the speed though :) One thing to remember is that Instagram keeps changing its parameters, so following everything in the lectures to the T wouldn't work - you will have to do some things yourself, which is a great way to learn.

By John Rodger on 12/12/2017

This is a great course. It it presented really well, step by step. Each step goes into a lot of detail, and is very well explained. Of course, after viewing the course you need to practise. I've really enjoyed doing this course. Great job. If you are interested in starting to learn web scraping with python, this one is for you.

By Zach Gollwitzer on 7/30/2017

Overall, the course is solid. I learned a good deal from it, and the instructor moved at the right pace for the level of skill required for this kind of course. I was a little disappointed in the format of the initial teaching. The projects were great, but the first several videos where the instructor is teaching Beautiful soup is slow. He is just reading through the documentation and using the examples from the documentation. Also, the instructor repeats himself a ton, which in some parts ruined the video watching experience and was distracting. All the bad set aside, the course does have some great parts to it and provides a fairly good learning experience.

By Aditya Verma on 1/9/2017

Very detailed and well explained tutorial. It explains everything from scratch to expect level. Specially projects are very good. I found this very useful because its simple and easy to follow, making it nice alternative for scrapy. Thank you, since there are many sources to learn.

thank you very much! Your explanation is very clear, step-by-step. Though sometimes a bit slow, and too much sleep, it's great in general :)

The instructor explains everything clearly and precisely,,,,,,... was looking for this type of course but couldn't find it anywhere except UDEMY..A big thanks to the instructor for making and keeping things so simple and straight.

Showing 12 of 97 reviews