Skip to content
UdemySoftware DevelopmentPaid courseAll LevelsCertificate

Scrapy : Python Web Scraping & Crawling for Beginners (Udemy.com)

Master web scraping with Scrapy and Python 3. Includes databases, web crawling, creating spiders and scraping Amazon.

Created by: Attreya Bhatt

Last updated February 2019

icon
What you will learn

  • 3.5+ hours of Full HD video material divided into 28 downloadable lectures
  • Scraping single or multiple websites with Scrapy
  • Building powerful crawlers and spiders
  • Creating a web crawler for amazon from scratch
  • Bypass restrictions using User-Agents and Proxies
  • Logging into Websites with Scrapy
  • Storing data extracted by Scrapy into SQLite3, MySQL and MongoDB databases
  • Exporting data extracted by Scrapy into CSV, XML, or JSON files
  • Understand Xpath and CSS selectors to extract data
  • Access to our PRIVATE Facebook group available to only students of this Scrapy course

How it compares

Against the other 518 rated Udemy courses in Software Development on CourseDuck:

  • Rating4.3 out of 5higher than 17% of them
  • Reviews207#336 of 519 by number of reviews
  • Length3.8 hoursshorter than 71% of them
  • Last updatedFebruary 2019earlier than 93% of them

icon
Course Description

In early 2008, Scrapy was released into this world and it soon became the #1 Web Scraping tool for beginners. Why? It's because it's simple enough for beginners yet advanced enough for the pros. Here are some of the use cases -

Ecommerce ( Amazon ) - Scrape product names, pricing and reviews

Data - Get a huge collection of data/images for Machine Learning

Email Address - Big companies scrape it and use it for Lead Generation

Come learn with me and I'll show you how you can bend Scrapy to your will. This course is great for beginners in Python at any age and any level of computer literacy.

The goal is simple: learn Scrapy by working on real projects step-by-step while we explain every concept along the way. For the duration of this course we will take you on a journey and you're going to learn how to:

  • Scrape Data from nearly Any Website

  • Build your own Spiders from scratch for all types of Web Scraping purposes

  • Transfer the data that you have scraped into Json, CSV and XML

  • Store the data in databases - SQLite3, MySQL and MongoDatabase

  • Create Web Crawlers and follow links on any web page

  • Logging in into websites

  • Bypassing restrictions & bans by using User-Agents and Proxies

  • Internalize the concepts by completely scraping amazon and get ready to scrape more advance website.

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Attreya Bhatt

When I was a kid I saw this YouTube video on how to make a folder invisible on Windows. I have never looked back since then. My love for technology has only grown.

I started with security since that was one of the areas that fascinated me. Then i went on to win the award for designing using Photoshop at Cofas '2012. On the destructive side, I always made scripts that used to mess up the systems at my school. I was almost suspended. I learned my lesson and vowed to do only constructive things. To make people aware of security issues, along with 2 friends started a Facebook page and group called YAP

To make things more interesting Web development came into my life which helped me get into the most prestigious chapter at my college IEEE. This helped me master different things that got my attention


- Android Development
- Augmented Reality
- Machine learning
- Python Development
- Internet of things ( IOT )

I never really wanted to go to a college. Still against it but it made me realize that the joy of creating something with a team of people is unparalleled. I created a blog which helps people who are not so familiar with technology get familiar with it and benefit from it. It has more 5,00,000 views today.

Things I learned and am still learning from it are Writing,Wordpress CMS, SEO, Google Analytics and Adsense and how to market a product after creating it.

icon
More courses by Attreya Bhatt

$44.99

$44.99

$10.99

icon
More Software Development courses

$10.99

$109.99

$19.99

$19.99

$94.99

$94.99

icon
Reviews

4.3

207 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Todor Stoilov on 6/26/2025

Great course for beginner web crawling, scraping using Python and Scrapy. You can learn many things from this course that have not been covered in university lectures or courses coming from a computer science background to supplement knowledge gabs.

By Fry Farnsworth on 1/3/2023

The outline is good; however, replies from the instructor are not made in a timely manner. Additionally, the code does not work. Perhaps it is me or perhaps the course is not updated with the scrapy software.

By Robert Chestnutt on 4/24/2020

This is the best of the courses I have seen on web scraping. How the tutor explains xpath and css selector configuration and identification using selectorgadget is worth its weight in gold and advanced by capacity so much

By Chris Esperian on 4/3/2020

Good class. Brief, but covers most of the essentials. I wish he had covered the file scraping capabilities. Definitely enough to get up and running. The code is barely readable on some portions because of the IDE's dark theme.

By James Marks on 3/15/2020

Great overview of using scrapy to scrape websites. Nice bite sized videos and focus on just learning the basics enough to get your hands dirty. Could use more elaboration or at least point in the direction for finding more information on using scrapy in more elaborate ways since this is barely scratching the surface. But hey these are great tutorials and kudos to the developer for making such an easy to understand class on Crawling for beginners. P.s. would rather have had a short section on using beautifulSoup or other methods for getting info off the web than the bonus section on OOP and inheritance. That's just me.

By Kenny Jensen on 9/11/2019

This course is filled with good and useful information and it is delivered in bite sized tutorials. There is a strong weight on practical teaching, but there is more than enough theory, to get you to where you want to go.

By Isabelle on 9/11/2019

Yes because I am a python beginner too and this showed me how to install IDE PyCharm and also talks about tools like GadgetSelector, MongoDB, SQLite not just scrapy like the scrapy tutorial would just do. Just sometimes doesn't go as far as I would like in the depth. Maybe some links / reference to more details would be great. By example I didn't use "sqliteonline.com" but instead installed DB Connector in PyCharm which seems to make more sense.

By Emmanuel Chioma on 4/23/2019

I had major issues getting Scrapy to install on my windows 10 machine. My investigations online led to me installing Microsoft visual C++ 14.0, then the problem changes to can not found io.h file. It was frustrating. I abandoned the windows environment and went to GoormIDE a cloud based ubuntu platform. So far I'm ok with the course. This is a good beginners' course for Web Scraping. I was able to complete this cause using GoormIDE environment. The Amazon scraping codes worked with little tweaks compared to PyCharm IDE environment the instructor used. This was my second course by this instructor, I like his style of teaching, he makes it easier for me to understand. Getting the Amazon project to work using GoormIDE Ubuntu environment was harder than I expected. I'll like for the instructor to make his notes available to the students so that we can use the notes to follow along. If his notes are available, how do we access them?

By Eugene Sheely on 3/21/2019

I picked this course over competition since it uses PyCharm and I I can easily download everything I need through this IDE, and not spend an hour or more downloading different software to my computer and lining it all up. The speaker has a great voice tone and inflection, he sounds happy about doing the course and won't put you to sleep, but I need to pay very close attention or I'll miss what he said due to his accent. This might actually be a plus to keep me from daydreaming, but he goes step-by-step on his screen and is easy to follow along. So far I like it a lot.

By veselin petrovic on 3/5/2019

Hi Bhatt, I would like to thank you for a great course. I rally like your practical approach. It could be out of scope, but I will have a suggestion for additional Scrapy application : As you know some Python modules have only online documentation. It will be nice to produce one pdf document for it. For example: https://bokeh.pydata.org/en/latest/docs/user_guide.html How to produce pdf document for Bokeh User Guide? Regards. Vesko

Showing all 10 reviews on CourseDuck

Read all 207 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 86 / 100