Another tool for crawling websites and emails and whatnot is Spider Foot.
Now Spider Foot has a web site that you could use.
Also, it used to have a free version, however they took it away.
However, the GitHub page is still available and still free.
So depending on how much.
You need in terms of scanning, you may want to go with the paid version.
However, the free version I found to be to be really useful.
So essentially spider Foot does it.
It crawls here and it for different things.
You could do email addresses.
You could do websites which is what we're going to demonstrate in this video.
And it does really great.
Reconnaissance by spidering the internet for that information.
So we could find over github.com forward slash s m I c a l l f for slash spider foot.
Or you can type in spider foot git and it should take you to this page.
Now it's pretty simple.
This is a Python program.
If we scroll down in here, we can see the web interface that that we that it has.
And if we go down in here, we can see the stable build package release.
The easiest thing to do is just click this little box here that'll copy all of this here.
And then what you want to do is you want to open a terminal, paste it and run it.
And what that's going to do is it's going to w git is going to download the spider program.
Then tar the tar file is going to.
Uh, converted CD goes to the spire foot directory.
Pip3 install is going to install the requirements for spire foot, and then it's finally going to run
it in the command to run it one when you want to run it again later is going to the spider foot folder
CD Spider foot.
You can just tab to auto complete once you're in there.
Python three space period four slash sf dot p y dash l and then the address there.
And what this is going to do is it's going to open up a.
Your local page here.
So on the browser it's going to open this 127.0.0.1 port 5001.
And this is going to be the spider foot page.
Now I'm running a scan here to give a demonstration because it can take a while.
However, if I go to new scan here, we can type in a scan name.
I could do test two for example.
And then what you want to scan, do you want to scan a domain IP address?
IPv4 IPv6 hostname.
Subdomain subnet.
Bitcoin address.
Email address.
Phone number.
Human name, username.
Network ASN.
So we see there's a lot of different ways that we can scan for information.
Once you put your target scan in any of these criterias then we could go down in here.
We could see these different scans.
All you could scan everything.
However, if this is if you're doing a pen test, I wouldn't recommend doing all because it it can be
a little noisy.
And this is also a very slow scan.
You could do footprinting, you could do investigating, you could do passive scanning.
If you're doing a pen test, you probably want to do a passive one first.
Kind of get an idea without sending off too many alerts.
So once you choose your criteria, you choose your target.
You click run Scan now and they will start the scan.
Now I'm going to go to my scans folder here.
And we're going to take a look at this one.
We can see this one is still running I'm scanning Yahoo.
Let me give you an idea of what it looks like though.
So if I click on test here we can see it pulling up.
Um a nice little graphical chart here of different information that it's finding.
And we could do correlation.
We could do we could browse so we could see affiliate email addresses.
We see it found 65 unique elements App store entries, domain who is etc. etc..
So uh, very cool program.
We can see all the graph settings.
We could take a look at the scan settings and log files.
So again.
This microphone makes things really easy.
Uh, what I like to do is run a spider foot scan for certain things.
Whether it's a name, an email address, a domain, whatnot.
And while that's running, since it is probably going to take a while, this has been running for a
couple of minutes already.
I like to go out and do my other checks.
Maybe it's a manual check using Metamucil or I'm sorry, not Metamucil, but, uh, Google dorks.
I might use some like Sherlock or other programs while this is running, uh, to see if I could find
additional information.
And once those checks and scans finish, I can compare notes on these different scans and see if there
see if it found the same information and verify my results.
So again this is spider Foot.
And you can find it over on the GitHub page github.com forward slash s m I c a l e f forward slash spider
foot.
And again this is a really cool tool for pretty much anything usernames, email addresses, domains,
bitcoin addresses, etc. so thank you for watching.
I'll see you in the next video.