In this rerecorded video, I'm going to go over wget and Httrack.
I'm recording this video for a couple of reasons.
One is the audio quality was not consistent with the new equipment I've been using for this course,
and also the old one did have Trace Labs Linux, whereas the course now is using CSI Linux.
So let's take a look.
So Httrack and wget are two great ways if you need to clone a website.
And the reason why you might need to clone a website is say we're doing an investigation on a website
and we want to do more research on it.
Well, having a offline copy can come in really handy.
Of course, we could do things like use the Internet Archive to archive it, but also having the offline
copy comes in really handy.
So let's take a look.
Both are going to be terminal systems here.
So I'm just going to open a terminal here.
Open this up here and let me see if I could.
Make this a little bit larger.
Actually let's just go ahead and get into this.
So first command I'm going to do is w get.
Okay.
And this is to clone a website.
Well actually before I do wget let's do this.
Let's create a folder I'm going to do say we want to clone Google for for investigation.
I'm going to do I'm going to make a directory for it first so it's easier to find.
So I could do mkdir space.
And then you can name the folder whatever you want.
In this case I'm going to name it Google okay.
And hit enter.
And now we have a folder called Google.
So now I'm going to change directory I'm going to do CD space Google.
And that's going to take me into the Google folder.
So from here I could do wget wget space.
And I want to do dash m because I'm going to mirror the website, I'm going to do w w w dot google.com
okay.
And we can see it actually going through the process here of cloning that site.
So while that's running, I'm actually just going to jump in there and we're going to take a look at
it.
So let me click on the File Explorer here.
Wrong one.
Let me close that out here.
Okay.
And I'm actually just going to stop that because I'm that should be enough information there.
Let me minimize that.
I'm going to go to home here.
And then we're going to go to Google and we can see this.
It created a folder in here w w w google.com.
So the site that I actually cloned.
So if I go in here I can see all the different things that it started indexing off of that site here.
And somewhere in here is going to be the index page index.html.
If I click on here, we can see that it actually Did in fact clone Google along with a lot of other
stuff off of that page.
So if I left this running, it eventually would have cloned the entire page.
But again, for this demonstration, I didn't really need to actually do that.
So that's wget.
Now the other program we could use is called Httrack.
And it essentially does the same thing.
It clones websites.
So let me expand this out.
I'm going to create a new folder here.
Again I'm going to name it Google two.
So mkdir to make the directory make directory Google two.
Okay.
And let's change directory CD.
Google two.
And now we're in the Google two folder.
So for httrack I'm going to type in Httrack.
And then I'm going to do dash dash sorry dash dash help.
And this gives us the all the different commands we could run for Httrack.
Okay.
And we can see there's a lot of different options that we could do to to clone these sites here.
So we could use proxy.
We could do w to mirror website or dash dash mirror.
And it gives us examples here.
So H track is another really useful program here.
So let's take a look at this.
So I'm going to do.
H track
w and let's try w w w dot google.com.
Okay.
And we can see it's actually cloning that website here.
And we can see the different uh URLs within google.com that it's actually cloning.
So again I'm going to minimize this.
We're going to go to home here.
And we're going to go to the Google two folder.
And we can see it actually starting to index everything here.
So just like a track.
So in this case a track is doing a full clone.
So I can actually see the images there.
I could probably see the images with wget also if I let it run long enough.
But as you see, if I go back into the terminal here, we should see it still kind of going through.
There we go.
And it finished.
So H track again gives us a clone of that site.
And if we're doing an investigation we can kind of go through the index.
We could take a look at all the different, different files and everything else about that.
We could basically deconstruct that website HTML page.
And again, the two useful programs for that is both h track and wget.
And you run those through the terminal on your CSI Linux machine.
Thank you so much for watching.
I'll see you in the next video.