laramies/theHarvester
1
1
Fork 0
mirror of https://github.com/laramies/theHarvester.git synced 2024-09-20 15:26:31 +08:00
Code Issues Packages Projects Releases Wiki Activity
3427 commits 5 branches 26 tags 9.9 MiB
Commit graph

88 commits

Author SHA1 Message Date
yoonthegoon c13843ec0d #1492 run black . and isort . 2023-07-27 01:34:21 +01:00
éclairevoyant bbe3f02a07 Delete qwant tests (see #1390) 2023-05-04 08:52:04 +01:00
Matt 90082dbaa0
Added 4 new sources, Removed 2 Sources, Added custom DNS resolver, backported to python3.9, and other misc changes (#1381) 
* Added call to api endpoint to explicitly gather subdomains from zoomeye, updated user agents, replaced orjson with ujson, and fixed substring not found error.

* Updated orjson to ujson.

* Fixed semantic error in html check in google workaround.

* Fixed flake8 errors.

* Fixed VT to use API.

* Fixed virustotal module.

* Fixed possible edge case that could possibly cause an infinite loop.

* Removed broken modules.

* Added 4 new sources: brave, criminalip, hunterhow, and subdomainfinderc99, added dnsresolve, and other misc changes.

* Added TODO comment.

* Fixed bin\theHarvester to allow python3.9

* Pep8 newline at end of file.

* Fixed error when passing in comma seperated resolvers and allow for user to pass in --dns-resolve flag with no arguments to use default resolvers that user has.
 2023-04-10 18:51:04 +01:00
J.Townsend b50f2ad2c5
remove sublist3r test as the domain no longer works 2023-04-06 12:59:07 +01:00
L1ghtn1ng 3a2c180295 Remove missed omnisint ci removal and version import fix 2022-11-13 01:33:01 +00:00
L1ghtn1ng f175269941 add a boat load of static typing fixes 2022-10-31 00:51:59 +00:00
L1ghtn1ng 56fe724a1c sublist3r Skipping on Github CI due unstable site 2022-08-14 03:03:04 +01:00
J.Townsend 72d8dcad21
Flake8 fixes (#1181) 
* Flake8 fixes

* Remove test due to bufferover run moving to api only
 2022-08-14 01:23:56 +01:00
J.Townsend 22e1eb9bdb
A lot of changes and fixes (#1168) 
* add pytest.ini file and fix test warning in qwantsearch

* ignore unsed imports

* Remove n45ht as the api is down

* Remove modules that use google as google blocks you after one go

* Remove missed code from when removing modules that use google

* Remove missed code from when removing modules that use google

* Add new vt-py dep and update pytest

* WIP virustotal migration to api

* Remove test that fails due to how the api returns not found entries

* Remove entries from myparser re google

* update fastapi and starlette

* update version

* Update dockerfile to use dev ubuntu version

* remove spyse module

* remove spyse dep

* fix tests by removing un-needed tests and indentation fix

* fix some mypy errors

* remove spyse and remove color output and fix mypy error

* flake8 fixes

* bump version and set it a dev version
 2022-08-03 23:12:59 +01:00
J.Townsend 15fe11130c
Add new n45ht module, lots of results returned (#899) 
* Add new fullhunt module

* Remove python checks in the run script as they are not needed anymore

* Remove netcraft from ci as it is not needed

* Update Dockerfile to fix security issues

* Add new n45ht module, lots of results returned
 2021-10-24 04:10:37 +01:00
L1ghtn1ng 8f978821af Fix omnisint module 2021-10-04 00:57:57 +01:00
L1ghtn1ng 65baabbdcf debug info to see what github actions is doing 2021-08-22 04:35:40 +01:00
L1ghtn1ng 6c71979308 debug info to see what github actions is doing 2021-08-22 04:28:24 +01:00
L1ghtn1ng cca6652512 debug info to see what github actions is doing 2021-08-22 04:23:03 +01:00
L1ghtn1ng 448aa402c4 debug info to see what github actions is doing 2021-08-22 04:22:01 +01:00
L1ghtn1ng 59ac74e629 Found an even better way of checking if running on GH actions and to skip with pytest and tidyer as well 2021-08-22 03:59:34 +01:00
L1ghtn1ng f43854ef0f Adjust if statment for is_github_action() 2021-08-22 02:20:38 +01:00
L1ghtn1ng aa5760f419 Adjust unitests to be able to skip if run on github 2021-08-22 02:12:08 +01:00
L1ghtn1ng f3f62232a4 Add bufferover unit test 2021-06-30 01:15:30 +01:00
L1ghtn1ng f8e911ee17 flake8 test fix 2021-06-28 01:19:10 +01:00
L1ghtn1ng faf7b23af2 update threatminer unit test 2021-06-21 00:28:03 +01:00
L1ghtn1ng 3244fac0cf update sublist3r unit test 2021-06-21 00:19:52 +01:00
L1ghtn1ng d28393b9a2 Add new module anubis and unit test for it. Update shodan related things 2021-06-21 00:19:27 +01:00
L1ghtn1ng c0e2b38a51 fix omnisint unit test 2021-05-17 22:04:36 +01:00
L1ghtn1ng ae6216a4ef fix test 2020-12-14 22:18:30 +00:00
L1ghtn1ng 8032d3fdc9 update otx test 2020-09-21 18:36:36 +01:00
L1ghtn1ng 0efdf38bec Add new module Omnisint 2020-09-21 18:36:20 +01:00
mm 9a5784b129 add static typing and tests (qwant search engine discovery) 2020-08-17 13:31:15 +02:00
L1ghtn1ng 51e92b6eb5 Fix threatminer unittest 2020-06-05 15:39:11 +01:00
L1ghtn1ng 1a4328b4bb Add new threatminer module 2020-05-25 20:52:53 +01:00
L1ghtn1ng d9b4ed3b28 Add new sublist3r module and remove vhost from sources 2020-05-17 23:29:22 +01:00
NotoriousRebel d90f940668 Updated certspotter search and changed github code to start with test. 2020-02-13 18:45:52 -05:00
NotoriousRebel 7f8aea33ad flake8 fixes. 2020-02-13 17:32:17 -05:00
NotoriousRebel c1e9e0c9c1 removed unncessary tests. 2020-02-13 17:19:51 -05:00
NotoriousRebel f9317d15f2 Fixed conflict. 2020-02-13 17:08:25 -05:00
NotoriousRebel 19391b9d8f Updated github tests most are passing. 2020-02-13 16:03:02 -05:00
L1ghtn1ng 4d48dcbb34 misc fixes and working on new module 2020-02-11 19:10:35 +00:00
L1ghtn1ng fe3d6a332e Fix proxy in setup that was missed and disable github test 2020-02-11 16:24:38 +00:00
L1ghtn1ng 9cb1fcae61 Updated deps for the github test 2020-02-02 23:27:46 +00:00
L1ghtn1ng ff82dfbf68 Tidy up tests and remove duplicated code 2020-01-15 22:29:42 +00:00
Matt d9968ee1da
Merge branch 'dev' into master 2020-01-14 21:56:10 -05:00
Matt 1a50276c95
Merge branch 'master' into dev 2020-01-14 21:29:32 -05:00
NotoriousRebel 62f3bc6f93 Got spyse working and fixed linkedin test. 2020-01-14 21:25:58 -05:00
L1ghtn1ng df89e19984 tests WIP for linkedin links 2020-01-14 23:39:00 +00:00
L1ghtn1ng 41f7497ae5 Remove 1 test and tidy up a few things and work on sypse module also add exalead to sources and update README.md about how to install theHarvester 2020-01-14 23:23:20 +00:00
NotoriousRebel ad22b9a8c1 Updated searches made google workaround just return True right away atm. 2020-01-06 17:32:34 -05:00
L1ghtn1ng 026311fcdb More wip for getting tests working 2020-01-04 07:24:09 +00:00
L1ghtn1ng 789b3f8d3e certspotter test working linkedin links WIP due to module needing to be ported to async 2019-12-31 03:37:21 +00:00
L1ghtn1ng f472d95d2b add pytest-asyncio to deps and got otx test working 2019-12-31 03:17:41 +00:00
L1ghtn1ng 7dc1442151 Fix unit test due to the pep8 fix for stash lib 2019-10-21 01:15:24 +01:00