Greetings, everyone.
Recently I had a question about how to scrape a page with authentication.
So that's what I'm going to look at in this section.
We're going to look at two methods to scrape a page with authentication.
One is with request first and the other one is going to be with Puppeteer.
So let's take a look first at the page that we're going to access with authentication and scrape.
So it's going to be our good old Faithful Craigslist that we all know now.
And we're going to log in to Craigslist on this, my account over here.
And if you don't have an account already, just go ahead and create one.
It's really fast and easy to do.
So once we log in, well, we get to this ball page when we are logged in where we can access our postings
that we made.
And our objective in this section is basically going to be to log in and then access the billing page,
the tab we have over here.
So that's going to be our objective and well, it's going to be similar, similar to other scraping
projects that you might do in the future where you need to log in first and then access some other page
when you are logged in.
So now first I'm going to talk about how Craigslist is authenticating us, and then we're going to look
at how to do this inside of request.