laramies/theHarvester
1
1
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2024-09-22 08:16:35 +08:00
Code Issues Packages Projects Releases Wiki Activity
E-mails, subdomains and names Harvester - OSINT
320 commits 6 branches 26 tags 9.9 MiB
Python 99.9%
Dockerfile 0.1%
Go to file
NotoriousRebel c4bb668eca Readding changes that were made with updated reporting from master.
2018-12-23 17:02:34 -05:00
discovery Added class to handle missing api key and CSE id inside constants.py, implemented in respectful classes and inside theHarvester when it catches an exception it continues the program instead of sys.exit() 2018-12-23 15:23:01 -05:00
lib New reporting module v0.4 2018-12-19 10:45:02 +00:00
tests Converted more code to python3 shodan works for the most part. 2018-11-20 12:04:57 -05:00
wordlists Converted more code to python3 shodan works for the most part. 2018-11-20 12:04:57 -05:00
.gitignore Vesion update 2018-12-11 22:10:08 +01:00
censysparser.py censysparser formatting 2018-12-23 20:38:36 +00:00
changelog.txt Randomization 2018-12-19 22:41:02 +01:00
COPYING Converted more code to python3 shodan works for the most part. 2018-11-20 12:04:57 -05:00
cymonparser.py Minor Lee fixes 2018-12-22 21:29:11 +01:00
Dockerfile Update dockerfile with beautifulsoup4 package 2018-12-11 21:23:18 +00:00
LICENSES Converted more code to python3 shodan works for the most part. 2018-11-20 12:04:57 -05:00
myparser.py Minor Lee fixes 2018-12-22 21:29:11 +01:00
README.md Syncing. 2018-12-23 15:23:21 -05:00
requirements.txt added plotly 2018-12-13 15:36:34 +00:00
securitytrailsparser.py Integrated security trails into all mode, and touched up minor cosmetics. 2018-12-21 17:47:15 -05:00
stash.py Minor Lee fixes 2018-12-22 21:29:11 +01:00
theHarvester.py Readding changes that were made with updated reporting from master. 2018-12-23 17:02:34 -05:00

README.md 

*******************************************************************
*                                                                 *
* | |_| |__   ___    /\  /\__ _ _ ____   _____  ___| |_ ___ _ __  *
* | __| '_ \ / _ \  / /_/ / _` | '__\ \ / / _ \/ __| __/ _ \ '__| *
* | |_| | | |  __/ / __  / (_| | |   \ V /  __/\__ \ ||  __/ |    *
*  \__|_| |_|\___| \/ /_/ \__,_|_|    \_/ \___||___/\__\___|_|    *
*                                                                 *
* TheHarvester Ver. 3.0.6                                         *
* Coded by Christian Martorella                                   *
* Edge-Security Research                                          *
* cmartorella@edge-security.com                                   *
*******************************************************************

What is this?

theHarvester is a tool used for gathering names, emails, subdomains, virtual hosts, open ports/banners, and employee names from different public sources (search engines, PGP key servers). A really simple, but very effective tool for the early stages of a penetration test or just to know the visibility of your company on the internet.

The data sources include:

Passive:

  • baidu: Baidu search engine

  • bing: Microsoft search engine - www.bing.com

  • bingapi: Microsoft search engine, through the API (Requires API key, see below.)

  • censys:

  • crtsh: Comodo Certificate search - www.crt.sh

  • cymon:

  • dogpile: Dogpile search engine - www.dogpile.com

  • google: Google search engine - www.google.com (Optional Google dorking.)

  • googleCSE: Google custom search engine

  • googleplus: Users that work in target company (Uses Google search.)

  • google-certificates: Google Certificate Transparency report

  • google-profiles: Google search engine, specific search for Google profiles

  • hunter: Hunter search engine (Requires API key, see below.) www.hunter.io

  • linkedin: Google search engine, specific search for Linkedin users

  • netcraft:

  • pgp: PGP key server - mit.edu

  • securitytrails: Security Trails search engine, the world's largest repository
    of historical DNS data (Requires API key, see below.) - www.securitytrails.com/

  • shodan: Shodan search engine, will search for ports and banners from discovered hosts - www.shodanhq.com

  • threatcrowd: Open source threat intelligence - www.threatcrowd.org

  • trello: Search trello boards (Uses Google search.)

  • twitter: Twitter accounts related to a specific domain (Uses Google search.)

  • vhost: Bing virtual hosts search

  • virustotal:

  • yahoo: Yahoo search engine

  • all:

Active:

  • DNS brute force: dictionary brute force enumeration
  • DNS reverse lookup: reverse lookup of IP´s discovered in order to find hostnames
  • DNS TDL expansion: TLD dictionary brute force enumeration

Modules that require an API key:

  • googleCSE: add your API key and CSE ID to discovery/googleCSE.py
  • hunter: add your API key to discovery/constants.py
  • securitytrails: add your API key to discovery/constants.py
  • shodan: add your API key to discovery/constants.py

Dependencies:

Changelog in 3.0.0:

  • Subdomain takeover checks
  • Port scanning (basic)
  • Improved DNS dictionary
  • Shodan DB search fixed
  • Result storage in Sqlite

Comments, bugs, or requests?

cmartorella@edge-security.com

Updates:

https://github.com/laramies/theHarvester

Thanks:

  • Matthew Brown @NotoriousRebel
  • Janos Zold @Jzold
  • John Matherly - Shodan project
  • Lee Baird @discoverscripts - suggestions and bugs reporting
  • Ahmed Aboul Ela - subdomain names dictionaries (big and small)