Web Scraping with Python: BeautifulSoup, Requests & Selenium (Udemy.com)
Web Scraping and Crawling with Python: Beautiful Soup, Requests & Selenium
Created by: GoTrained Academy
Last updated December 2018
What you will learn
- Python Refresher: Review of Data Structures, Conditionals, File Handling
- How Websites are Hosted on Servers; Basic Calls to Server (GET, POST Methods)
- Web Scraping with Python Beautiful Soup and Requests
- Using Selenium to handle JavaScript and AJAX
- Diverse Web Scraping Exercises
- Source codes (*.py files) for all Exercises can be downloaded
- Q&A board to send your questions and get them answered quickly
Quality Score
Overall Score : 86 / 100
Course Description
Web Scraping (also termed Screen Scraping, Web Data Extraction, Web Harvesting, etc.) is a technique for extracting large amounts of data from websites and save the the extracted data to a local file or to a database.
In this course, you will learn how to perform web scraping using Python 3 and the Beautiful Soup, a free open-source library written in Python for parsing HTML.
We will use lxml, which is an extensive library for parsing XML and HTML documents very quickly; it can even handle messed up tags. We will also be using the Requests module instead of the already built-in urllib2 module due to improvements in speed and readability.
Finally, we will use Selenium alongside Beautiful Soup to crawl AJAX & JavaScript driven pages.
The course cover the following topics: accessing web pages programmatically; scraping web pages to extract the required data using Beautiful Soup to parse web pages; interacting with web pages to do different things with them programmatically; and using Selenium for web scraping and when we need it.
By the end of this course, you will be able to understand how websites and servers function, diverse data extraction techniques, and methods of handling and organizing data.
This Web Scraping course covers the following topics:
- Review of data structures (Lists, Dictionaries, Tuples, File Handling)
- How websites are hosted on servers
- Calls to the server (GET, POST methods)
- Review of HTML and CSS
- Requests Module and BeautifulSoup Module overview
- Parsing HTML using BeautifulSoup
- Filtering elements using BeautifulSoup and navigating the Parse Tree
- JavaScript and AJAX overview
- Selenium and the need for it
- Selecting elements using Selenium
- CSS selectors
- XPath selectors
- Navigating pages using Selenium
- Practical Projects
Instructor Details
- 4.3 Rating
927 Reviews
GoTrained Academy
GoTrained is an e-learning academy aiming at creating useful content in different languages and it concentrates on technology and management.
We adopt a special approach for selecting content we provide; we mainly focus on skills that are frequently requested by clients and jobs while there are only few videos that cover them. We also try to build video series to cover not only the basics, but also the advanced areas.
More courses by GoTrained Academy
Scrapy: Powerful Web Scraping & Crawling with Python (2020)
4.2 (2,791 Reviews)
Provider: Udemy
Time: 10.8h
$11.99
Reviews
By Hynek Kyvala on 11/23/2024
The course is well-structured and easy to follow, making it accessible even for beginners. However, the last update was in December 2018, and some websites used for scraping have since changed. This made completing the final project (scraping pictures from Instagram) impossible due to Instagram’s suspicious login alerts and the need for email confirmation codes. Despite this, I’m giving the course 4.5 out of 5 stars because the 8 hours of content provided a clear understanding of the concepts and allowed me to learn a lot.
By Juan Pablo Balut Repetto on 5/27/2020
Course is not updated. Libraries used and html structures of pages analyzed have changed.
By Manas Paul on 7/17/2019
This Tutorial really awesome. Really I have learnt web scrapping from this tutorial. Author is really good, quick replied. Great example with proper totpic. I will recommended that, if anybody are interested web scrapping first you need to read this tutorial. Thanks for this.
By Ignacio Soteras Gutiérrez on 2/24/2019
I liked a lot this course, I impressed me a lot what kind of things you can do with a bit of Python, BS and Selenium. I enjoyed a lot the first exercise and specially the final project. At the beggining the level is a bit high for students without prior knowledge in Python and could be intimidating for newbies. Due to this, I wouldn't recomend it for newbies in Python, which was not my case. Later the teacher makes an effort to explain a bit the IDE and some basic notions of Python which are useful to refresh concepts. All the excercises are explained step by step and even though at the beggining it can be slow, at the end, you will understand why and the reward will left you without words. The final project left me with amazed of what sort of things you can do, even though this is only the top of the iceberg. During this project, I had some problems due to the local languaje, but with the teacher help, I was able to understand why they were raised and how to solve them with practical examples. Thank you very much
By Life-Long Data Science Learner on 1/11/2019
I cannot say enough good things about this course. Waqar (the teacher) is an absolutely-fantastic instructor. At first, I felt that this course was a bit all over the place. But, once I started getting the hang of this, I realized that this course is actually really well organized, and does a nice job of teaching web scraping. I found this course to be fairly comprehensive, despite that it aims to be a beginners' course. I would like to strongly recommend this course.
By Michael Sweet on 1/7/2018
good review so far...I left this rating early in the course. I am now learning new things and think this is an excellent and very well taught course. Final Review - Excellent and well taught course. Instructor was very nice and easy to understand. I learned something useful. Would recommend.
By Rajiv Mehrotra on 1/6/2018
Great course - well explained concepts. I would advise playing the videos at twice the speed though :) One thing to remember is that Instagram keeps changing its parameters, so following everything in the lectures to the T wouldn't work - you will have to do some things yourself, which is a great way to learn.
By John Rodger on 12/12/2017
This is a great course. It it presented really well, step by step. Each step goes into a lot of detail, and is very well explained. Of course, after viewing the course you need to practise. I've really enjoyed doing this course. Great job. If you are interested in starting to learn web scraping with python, this one is for you.
By Zach Gollwitzer on 7/30/2017
Overall, the course is solid. I learned a good deal from it, and the instructor moved at the right pace for the level of skill required for this kind of course. I was a little disappointed in the format of the initial teaching. The projects were great, but the first several videos where the instructor is teaching Beautiful soup is slow. He is just reading through the documentation and using the examples from the documentation. Also, the instructor repeats himself a ton, which in some parts ruined the video watching experience and was distracting. All the bad set aside, the course does have some great parts to it and provides a fairly good learning experience.
By Aditya Verma on 1/9/2017
Very detailed and well explained tutorial. It explains everything from scratch to expect level. Specially projects are very good. I found this very useful because its simple and easy to follow, making it nice alternative for scrapy. Thank you, since there are many sources to learn.
thank you very much! Your explanation is very clear, step-by-step. Though sometimes a bit slow, and too much sleep, it's great in general :)
The instructor explains everything clearly and precisely,,,,,,... was looking for this type of course but couldn't find it anywhere except UDEMY..A big thanks to the instructor for making and keeping things so simple and straight.




