So a lot of my students were banned or blocked by Craigslist when they were trying to follow my older
request tutorial using Node JS request.
So it seems that Craigslist has kind of gotten too many requests maybe from my students, and they are
now actively trying to block any sort of scraping attempt using Node JS request.
But don't worry, if you got blocked, you can still access the site using just a regular browser such
as Chrome or Firefox.
So that's what we're going to do now.
We're going to scrape Craigslist using an automated browser.
Instead, we're going to control the browser by using a tool called Puppeteer.
So this is a great example of when you want to switch over to puppeteer instead of using request.
Maybe the site doesn't allow you to use request to scrape it and you need to make a switch over to puppeteer.
It's going to use more resources compared to requests, but it still gets the job done and you get the
data that you need.
I'm also going to be showing you how to limit your requests so you avoid Craigslist banning you or blocking
your IP.
If you make too many requests, even in the chromium browser.
So I hope you have fun doing this project with me and I will be seeing you in the next section.