Hello, everyone.
In this section, I'm going to teach you how to use puppeteer to scrape websites.
Specifically, we're going to scrape the software developer jobs from Craigslist in the San Francisco
Bay area.
We're going to go through each jobs job listings, as you can see.
Puppeteer is doing right now and scrape the content from the job description and the compensation also.
So right now you can see Puppeteer is controlling the chromium browser.
I'm also going to show you how to put a limit on how often it should scrape a site so that you don't
risk getting blocked when you're scraping websites.
And after we have been scraping all of the data using puppeteer and cheerio.
I'm going to show you as well how to save our data onto a MongoDB database and how to easily and fast
set up a MongoDB database using Mlab.
So M-lab is free of charge to use.
It's really fast and easy, so don't worry about any cost or anything like that.
And I'm going to show you step by step how to do this project, and I hope you will have lots of fun
and learn lots of things when doing it.