Commit graph

263 commits

Author SHA1 Message Date
L1ghtn1ng
cd678f2acf Refactor code for better readability and consistency
Improves the readability and consistency of the codebase by replacing double quotes with single quotes where applicable. Also refactors several `if` statements and list/set comprehensions for brevity. The update does not affect functionality or performance. Unnecessary module imports were also removed for optimization.
2024-03-02 22:36:01 +00:00
Branch Vincent
4d825aaf33
build: migrate to pep517 backend (#1505)
* build: migrate to pep517 backend

* test loading config files
2023-10-08 19:45:23 +01:00
yoonthegoon
c13843ec0d #1492 run black . and isort . 2023-07-27 01:34:21 +01:00
Matt
90082dbaa0
Added 4 new sources, Removed 2 Sources, Added custom DNS resolver, backported to python3.9, and other misc changes (#1381)
* Added call to api endpoint to explicitly gather subdomains from zoomeye, updated user agents, replaced orjson with ujson, and fixed substring not found error.

* Updated orjson to ujson.

* Fixed semantic error in html check in google workaround.

* Fixed flake8 errors.

* Fixed VT to use API.

* Fixed virustotal module.

* Fixed possible edge case that could possibly cause an infinite loop.

* Removed broken modules.

* Added 4 new sources: brave, criminalip, hunterhow, and subdomainfinderc99, added dnsresolve, and other misc changes.

* Added TODO comment.

* Fixed bin\theHarvester to allow python3.9

* Pep8 newline at end of file.

* Fixed error when passing in comma seperated resolvers and allow for user to pass in --dns-resolve flag with no arguments to use default resolvers that user has.
2023-04-10 18:51:04 +01:00
L1ghtn1ng
46760915c3 Bump theHavester required python version to be 3.10+ 2022-11-13 01:21:28 +00:00
J.Townsend
72d8dcad21
Flake8 fixes (#1181)
* Flake8 fixes

* Remove test due to bufferover run moving to api only
2022-08-14 01:23:56 +01:00
Matt
c801db6725
Fixed VirusTotal module (#1172)
* Added call to api endpoint to explicitly gather subdomains from zoomeye, updated user agents, replaced orjson with ujson, and fixed substring not found error.

* Updated orjson to ujson.

* Fixed semantic error in html check in google workaround.

* Fixed flake8 errors.

* Fixed VT to use API.

* Fixed virustotal module.

* Fixed possible edge case that could possibly cause an infinite loop.
2022-08-06 23:42:05 +01:00
L1ghtn1ng
86e54a611c Fix bug from stopping theHarvester.py from running and update the binary to matach the new theHarvester.py 2021-12-01 19:52:26 +00:00
Matt
ac03f200c4
Updated zoomeye module, updated user agents list, fixed substring not found, and replaced orjson in favor of ujson. (#923) 2021-11-22 09:26:49 +00:00
J.Townsend
35a9fae73d
Remove python checks in the run script as they are not needed anymore and add py3.10 support (#895)
* Add new fullhunt module

* Remove python checks in the run script as they are not needed anymore

* Remove netcraft from ci as it is not needed
2021-10-18 01:16:29 +01:00
L1ghtn1ng
f93ad83d04 temp fix for uvloop on py3.9 2020-12-15 22:09:18 +00:00
L1ghtn1ng
7545d1f5d1 Fix #401 2020-08-18 00:08:07 +01:00
NotoriousRebel
de1f8a3ada Reporting should be working on linux at least... 2020-07-04 15:38:11 -04:00
NotoriousRebel
d3def10167 Screnshot functionality is ready for takeoff 🚀 2020-06-30 18:47:06 -04:00
NotoriousRebel
75271e3ded Aiomultiprocess is working with proper chunking of list need to do a few tweakings before ready. 2020-06-29 00:11:55 -04:00
Steve Bate
bf8b7a49d1 Added code to support Windows 10 operation.
Manually tested with Python 3.8.3. Using SelectorEventLoop because
of issues with default ProactorEventLoop on Windows (e.g., missing
add_reader implementation needed by aiodns). Made the uvloop install
requirement conditional on the operating system (skipped on
Windows platforms). This change doesn't allow setup.py to run on
Windows (because of /etc/theHarvester reference), but supports running
theHarvester.py directly from a cloned workspace.
2020-06-27 08:11:17 -04:00
L1ghtn1ng
41f7497ae5 Remove 1 test and tidy up a few things and work on sypse module also add exalead to sources and update README.md about how to install theHarvester 2020-01-14 23:23:20 +00:00
NotoriousRebel
ec09dc0adf Removed wow.py as that was test moved queue implementation to main.py 2020-01-07 22:17:45 -05:00
NotoriousRebel
7038f8976c Implemented an asyncio.queue to create workers to handle each coroutine. 2020-01-07 10:36:27 -05:00
L1ghtn1ng
879739a323 Remove googlefile module as not needed and a few misc things 2019-12-26 05:31:14 +00:00
NotoriousRebel
60435c2658 Ported bing from grequests to aiohttp, seems to be working in generic use case, added aiohttp to requirements.txt 2019-12-20 22:12:55 -05:00
L1ghtn1ng
a6b215e40a API key fix plus a few other fixes 2019-10-19 22:11:07 +01:00
Alvaro Bird
741dc17363 Solve issue #259
Delay importing the main to avoid the SyntaxError.

$ ./theHarvester.py
Traceback (most recent call last):
  File "./theHarvester.py", line 5, in <module>
    from theHarvester import __main__
  File
"theHarvester/__main__.py",
line 96
    print(f'\033[94m[*] Target: {word} \n \033[0m')
                                                 ^
SyntaxError: invalid syntax
2019-07-03 12:44:22 +02:00
blshkv
a1cd503ac0 create a proper __main__ file, so we can use the original name 2019-03-24 16:07:45 +08:00
blshkv
70e42c3f91 rename the main script as it cannot be called the same as the module 2019-03-24 15:50:30 +08:00
blshkv
0711409468 fix new module path 2019-03-24 15:35:48 +08:00
blshkv
d666264c92 fix installatin of the main binary 2019-03-24 14:17:37 +08:00
Anton Bolshakov
04e6714d2e
Update theHarvester.py 2019-03-24 10:01:40 +08:00
NotoriousRebel
e37b1a3fd1 Change googledork list to be a tuple, also added dnsdumpster as new plugin 2019-03-14 15:43:28 -04:00
NotoriousRebel
ccb7f7edba Small misc. change to google dorking and wrapped dogpile when doing -b all in try except. 2019-03-12 10:32:27 -04:00
Amin
61e7a5d277
Fix typo 2019-03-09 17:56:40 +03:00
Amin
611b82f8d9
Updating PR 2019-03-04 08:13:03 +03:00
Amin Sami
68a32b881d Correcting for PR comments 2019-03-03 11:20:08 +03:00
Amin Sami
78efdd7555 Correcting for PR comments 2019-03-03 11:15:10 +03:00
Amin Sami
bb4c7653b7 adds exclude flag and remove googleCSE from __init__ 2019-02-28 23:41:19 +03:00
L1ghtn1ng
2f763f6ebc fix merge conflict 2019-02-27 22:42:51 +00:00
Lee Baird
cda364470b Removed googleCSE. 2019-02-25 21:02:08 -06:00
L1ghtn1ng
aba655f5b0 PEP8 fix shodan module 2019-02-24 23:44:02 +00:00
Yuriy
46c6dff728
Update theHarvester.py 2019-02-21 18:32:48 +02:00
L1ghtn1ng
243f3b50ea Pep8 Fixes and layout fix 2019-02-17 00:27:04 +00:00
Lee Baird
13c0f0b037 Cosmetic changes. 2019-02-14 23:45:47 -06:00
Lee Baird
a264ade32f Removed PGP source. 2019-02-14 15:35:30 -06:00
Lee Baird
d963ee9904 Removed google-profiles and clean up. 2019-02-13 23:05:52 -06:00
L1ghtn1ng
9cad6a5392 Pep8 Fix 2019-02-09 23:41:42 +00:00
Denis Kasak
acf9ed2f40 Normalize other whitespace.
Delete trailing spaces, add newline at end of file, etc.
2019-02-04 14:18:00 +01:00
Denis Kasak
5e2a684f5a Fix line endings.
Don't mix line endings. Always use LF for text files when committing.
Ensure your `core.eol` is set to `native` using `git config` to get
native line endings for your platform on checkout.
2019-02-04 13:48:29 +01:00
NotoriousRebel
17afbb1b8f Resynced and removed impromper api keys. 2019-01-31 14:55:22 -05:00
NotoriousRebel
a04f2b1306 Added intelx.io search and fixed misc. 2019-01-31 14:48:26 -05:00
Lee Baird
cc37a49c4c Removed additional google-profiles code. 2019-01-27 19:33:18 -06:00
Lee Baird
30fd1f2e69 Tweak help menu verbiage. 2019-01-26 22:42:56 -06:00