laramies/theHarvester
1
1
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2024-11-10 17:13:07 +08:00
Code Issues Projects Releases Packages Wiki Activity
E-mails, subdomains and names Harvester - OSINT
87 commits 4 branches 26 tags 10 MiB
Python 99.9%
Dockerfile 0.1%
Find a file
Anton Bolshakov 214732a060
Update pgpsearch.py 
I'm running a test with the standard example:
$ python2 theHarvester.py  -d microsoft.com -b pgp
However, the ```pgp.rediris.es``` server is dead.

This pull simply prints an error message to show the problem instead of returning 0 results. However, you might want to change the server to pgp.mit.edu as well (currently commented out).
2018-10-25 10:49:06 +08:00
discovery Update pgpsearch.py 2018-10-25 10:49:06 +08:00
lib Release 3.0 2018-08-08 21:34:10 +02:00
tests Email parser 2016-04-19 00:00:45 +01:00
wordlists Release 3.0 2018-08-08 21:34:10 +02:00
.gitignore Merge branch 'master' of https://github.com/laramies/theHarvester 2018-04-16 09:51:05 +02:00
changelog.txt 2.6 2015-05-10 23:43:09 +01:00
COPYING Initial commit for version 2.0 2011-05-04 16:07:06 +01:00
LICENSES 2.5 2014-12-16 23:37:44 +00:00
myparser.py 2.7 2016-04-19 00:47:24 +01:00
README.md Md 2018-08-08 22:08:20 +02:00
requirements.txt added requirements.txt 2017-10-13 13:27:30 -04:00
stash.py Local db, output colors, threatcrowd 2018-03-22 23:32:50 +01:00
theHarvester.py fix for #88 which allows multiple search engines usage 2018-10-18 11:42:58 +01:00

README.md 

*******************************************************************
*                                                                 *
* | |_| |__   ___    /\  /\__ _ _ ____   _____  ___| |_ ___ _ __  *
* | __| '_ \ / _ \  / /_/ / _` | '__\ \ / / _ \/ __| __/ _ \ '__| *
* | |_| | | |  __/ / __  / (_| | |   \ V /  __/\__ \ ||  __/ |    *
*  \__|_| |_|\___| \/ /_/ \__,_|_|    \_/ \___||___/\__\___|_|    *
*                                                                 *
* TheHarvester Ver. 3.0.0                                         *
* Coded by Christian Martorella                                   *
* Edge-Security Research                                          *
* cmartorella@edge-security.com                                   *
*******************************************************************

What is this?

theHarvester is a tool for gathering subdomain names, e-mail addresses, virtual hosts, open ports/ banners, and employee names from different public sources (search engines, pgp key servers).

Is a really simple tool, but very effective for the early stages of a penetration test or just to know the visibility of your company in the Internet.

The sources are:

Passive:

  • threatcrowd: Open source threat intelligence - https://www.threatcrowd.org/

  • crtsh: Comodo Certificate search - www.crt.sh

  • google: google search engine - www.google.com

  • googleCSE: google custom search engine

  • google-profiles: google search engine, specific search for Google profiles

  • bing: microsoft search engine - www.bing.com

  • bingapi: microsoft search engine, through the API (you need to add your Key in the discovery/bingsearch.py file)

  • dogpile: Dogpile search engine - www.dogpile.com

  • pgp: pgp key server - mit.edu

  • linkedin: google search engine, specific search for Linkedin users

  • vhost: Bing virtual hosts search

  • twitter: twitter accounts related to an specific domain (uses google search)

  • googleplus: users that works in target company (uses google search)

  • yahoo: Yahoo search engine

  • baidu: Baidu search engine

  • shodan: Shodan Computer search engine, will search for ports and banner of the discovered hosts (http://www.shodanhq.com/)

Active:

  • DNS brute force: this plugin will run a dictionary brute force enumeration
  • DNS reverse lookup: reverse lookup of ip´s discovered in order to find hostnames
  • DNS TDL expansion: TLD dictionary brute force enumeration

Modules that need API keys to work:

  • googleCSE: You need to create a Google Custom Search engine(CSE), and add your Google API key and CSE ID in the plugin (discovery/googleCSE.py)
  • shodan: You need to provide your API key in discovery/shodansearch.py (one provided at the moment)

Dependencies:

Changelog in 3.0.0:

  • Subdomain takeover checks
  • Port scanning (basic)
  • Improved DNS dictionary
  • Shodan DB search fixed
  • Result storage in Sqlite

Comments? Bugs? Requests?

cmartorella@edge-security.com

Updates:

https://github.com/laramies/theHarvester

Thanks:

  • John Matherly - SHODAN project
  • Lee Baird for suggestions and bugs reporting
  • Ahmed Aboul Ela - subdomain names dictionary (big and small)