Skip to content
UdemyNode.jsPaid courseAll LevelsCertificate

Web Scraping in Nodejs & JavaScript (Udemy.com)

Learn web scraping in Nodejs & JavaScript by example projects with real websites! Craiglist, iMDB, AirBnB and more!

Created by: Stefan Hyltoft

Last updated February 2024

icon
What you will learn

  • Be able to scrape jobs from a page on Craigslist
  • Learn how to use Request
  • Learn how to use NightmareJS
  • Learn how to use Puppeteer
  • Learn how to scrape elements without any identifiable classes or id's
  • Learn how to save scraping data to CSV
  • Learn how to save scraping data to MongoDb
  • Learn how to scrape Facebook using only Request!
  • Learn how you can reverse engineer sites and find hidden API's!
  • Learn different technologies used for scraping, and when it's best to use them
  • Learn how to scrape sites using authentication
  • Learn how to scrape HTML tables using Request/Cheerio

How it compares

Against the other 118 rated Udemy courses in Node.js on CourseDuck:

  • Rating4.5 out of 5higher than 61% of them
  • Reviews856#39 of 119 by number of reviews
  • Length11.7 hourslonger than 65% of them
  • Last updatedFebruary 2024more recently than 59% of them

icon
Course Description

In this course you will learn how to scrape a websites, with practical examples on real websites using JavaScript Nodejs Request, Cheerio, NightmareJs and Puppeteer. You will be using the newest JavaScript ES7 syntax with async/await.

You will learn how to scrape a Craigslist website for software engineering jobs, using Nodejs Request and Cheerio. You will be using the newest JavaScript ES7 syntax with async/await.

You will then learn how to scrape more advanced websites that require JavaScript such as iMDB and AirBnB using NighmareJs and Puppeteer.


I'm gong to also show you with a practical real-life website, how you can even avoid wasting time on creating a web scraper in the first place, by reverse engineering websites and finding their hidden API's!


Learn how to avoid being blocked from websites when developing out your scraper, by building out the scraper in a test-driven way with mocked html, rather than hitting the website every time as you're debugging and developing it. You'll also learn what you can do if you're blocked and your alternatives to get your scraper up and running regardless!


You will also learn how to scrape on a server with a bad connection, or even if you have a bad connection.

You'll even learn how to save your results to a CSV file and MongoDB!


How do you build a scraper that scrapes every 1 hour (or other interval), and deploy it do a cloud host like Heroku or Google Cloud? Let me show you, quick and easy!


How do you scrape a site requiring passwords? I'm going to show you that too with a real website (Craigslist)!


How do you serve your scraping results in a REST API with Nodejs Express? And how can we build a React frontend that's showing the results? You'll learn that too, in the quickest and simplest way possible!


Plus, a section covering how to make a basic GraphQL API is included in the course.

As a last cherry on the top, I have a section containing a secret backdoor showing you how to scrape Facebook using only Request!


If you have issues regarding a site you're trying to scrape yourself, it's totally okay to reach out to me for some help. I'd be happy to point you in the right direction! Whatever issues my students are facing, I use that to expand on my course!

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Stefan Hyltoft

Stefan has been building software since elementary school starting out with Visual Basic 6.0. Since then he has been dabbling with Python(Pygame), PHP & MySQL, and Java during university. Since he discovered the JavaScript world he found an intense interest in web development especially using ReactJs/React Native and using NodeJs for the backend. 

icon
More courses by Stefan Hyltoft

$54.99

$11.99

$59.99

$49.99

icon
More Node.js courses

$119.99

$159.99

$19.99

$89.99

$94.99

$14.99

icon
Reviews

4.5

856 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Emmanuel Fulo on 3/14/2024

Great course today even in 2024, the instructor Stefan has taken the time to answer questions and also update any outdated sections. I have learnt life long lessons that will stick with me on my journey as a developer. Thank you for your efforts and the time you put in Stefan :)

By Ricardo Osorio on 3/26/2023

I love this course, even in spite of some examples are now deprecated (web scraping with request / request-promise examples)... The same stragegies can be easily applied with puppeteer with minor changes, which also gives the opportunity to be creative, and not just copy and paste all of these examples as the show on screen. I'm looking forward to buy more courses from the Stefan catalog.

By Kobiva on 12/15/2022

This coarse is done by someone who actually makes web scrapers for work. Not a bunch of flashy programs, just what will work and by reliable. I have been learning JavaScript for 2 months now and wanted my first project to be a web scraper for my real estate business and this course is just what I needed for real world application.

By Khush Kaushik on 7/20/2022

Good course. Instructor is very funny when he spells the words like function as fucntion and function writeToDisk spell twoDicks.. Hahaha Very nice enjoyed it. Best quality about Stephan is the pace (speed in speaking , learning) he teaches not other instructor which are in hurry to finish the tutorial. I will not take the names of them. Thanks Stephan

By Carl Meyrick C. Cheng on 11/12/2020

It was a really good course to learn web-scraping though I can't replicate some the things that the instructor taught. Some of the websites he scraped are already updated so don't expect to replicate his code 1:1. Also the 'request' and 'request-promise' library he used are already deprecated at this time which made me use Axios instead.

By Karolis Kerpys on 6/29/2020

The author has a decent understanding of crawling and it's practices. The course was interesting. 4 stars are for not explaining or not going into detail in some cases, which looks unprofessional. For example the author talks about react and says "I don't know why we use super in the constructor but I just write it like that". I liked the course, just you have to step up and be more professional.

By Lonely Pineapple AI Studios | Nidia Sukh on 5/11/2020

Stefan is not only a great instructor, he also teaches at a good pace and explains what he is doing along the way. The content is a lot more in-depth that lots of other scraping courses out there; he teaches from the basics of scraping simple sites then gradually gets into the more fun stuff that you will need in the real world. I am working on an NLP based publication as part of my doctoral studies - I am very grateful for Stefan's guidance

By Emma L. on 2/3/2020

This course was very interesting and it helped me practice. I like the fact that Stefan introduces several different tools and uses most of them several times in the course. There are some repetitions though throughout the course, because Stefan is obviously updating his course regularly and some content end up overlaping. The only real downside is that the website used for most of the sections, Craigslits, bans you after your 1st request so you have to spend time finding a way to get around that issue (fortunately, Stefan made a section dedicated to going around that issue).

By BernabéGarcía on 8/31/2019

Even though the Request-Promise has some problems with Craigslist website, I recommend this course. There are not too many scrapper courses. And with this course I am growing up with NodeJS, re-learning Jquery selectors, even starting a bit of Graph QL. Also he taught us Puppeteer and NightmareJs. Thank you Stefan

By Daniel Kroon on 5/14/2019

Stefan is a great teacher. He explains things well and explains his whole approach and way of debugging really nice. He is also super supportive if you got stuck or are struggling with your own project that is based on this course. Thanks for everything Stefan!

By Elias Katsaniotis

Learn web scraping in Nodejs by example projects!

By Shawn Foster

Pretty straightford.

Showing 12 of 44 reviews

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 90 / 100