Commit graph

93 commits

Author SHA1 Message Date
L1ghtn1ng 467a33fd3a remove test that is not stable enough due to the site not always being up or is getting blocked intermittently 2023-12-16 13:46:38 +00:00
L1ghtn1ng cddcb5f383 Fix otx test 2023-11-12 22:24:45 +00:00
Branch Vincent 4d825aaf33
build: migrate to pep517 backend (#1505)
* build: migrate to pep517 backend

* test loading config files
2023-10-08 19:45:23 +01:00
J.Townsend 76ce3b3c6f
lint fix 2023-10-02 00:18:00 +01:00
J.Townsend c397275cac fix test 2023-09-24 16:15:35 +00:00
yoonthegoon c13843ec0d #1492 run black . and isort . 2023-07-27 01:34:21 +01:00
éclairevoyant bbe3f02a07 Delete qwant tests (see #1390) 2023-05-04 08:52:04 +01:00
Matt 90082dbaa0
Added 4 new sources, Removed 2 Sources, Added custom DNS resolver, backported to python3.9, and other misc changes (#1381)
* Added call to api endpoint to explicitly gather subdomains from zoomeye, updated user agents, replaced orjson with ujson, and fixed substring not found error.

* Updated orjson to ujson.

* Fixed semantic error in html check in google workaround.

* Fixed flake8 errors.

* Fixed VT to use API.

* Fixed virustotal module.

* Fixed possible edge case that could possibly cause an infinite loop.

* Removed broken modules.

* Added 4 new sources: brave, criminalip, hunterhow, and subdomainfinderc99, added dnsresolve, and other misc changes.

* Added TODO comment.

* Fixed bin\theHarvester to allow python3.9

* Pep8 newline at end of file.

* Fixed error when passing in comma seperated resolvers and allow for user to pass in --dns-resolve flag with no arguments to use default resolvers that user has.
2023-04-10 18:51:04 +01:00
J.Townsend b50f2ad2c5
remove sublist3r test as the domain no longer works 2023-04-06 12:59:07 +01:00
L1ghtn1ng 3a2c180295 Remove missed omnisint ci removal and version import fix 2022-11-13 01:33:01 +00:00
L1ghtn1ng f175269941 add a boat load of static typing fixes 2022-10-31 00:51:59 +00:00
L1ghtn1ng 56fe724a1c sublist3r Skipping on Github CI due unstable site 2022-08-14 03:03:04 +01:00
J.Townsend 72d8dcad21
Flake8 fixes (#1181)
* Flake8 fixes

* Remove test due to bufferover run moving to api only
2022-08-14 01:23:56 +01:00
J.Townsend 22e1eb9bdb
A lot of changes and fixes (#1168)
* add pytest.ini file and fix test warning in qwantsearch

* ignore unsed imports

* Remove n45ht as the api is down

* Remove modules that use google as google blocks you after one go

* Remove missed code from when removing modules that use google

* Remove missed code from when removing modules that use google

* Add new vt-py dep and update pytest

* WIP virustotal migration to api

* Remove test that fails due to how the api returns not found entries

* Remove entries from myparser re google

* update fastapi and starlette

* update version

* Update dockerfile to use dev ubuntu version

* remove spyse module

* remove spyse dep

* fix tests by removing un-needed tests and indentation fix

* fix some mypy errors

* remove spyse and remove color output and fix mypy error

* flake8 fixes

* bump version and set it a dev version
2022-08-03 23:12:59 +01:00
J.Townsend 15fe11130c
Add new n45ht module, lots of results returned (#899)
* Add new fullhunt module

* Remove python checks in the run script as they are not needed anymore

* Remove netcraft from ci as it is not needed

* Update Dockerfile to fix security issues

* Add new n45ht module, lots of results returned
2021-10-24 04:10:37 +01:00
L1ghtn1ng 8f978821af Fix omnisint module 2021-10-04 00:57:57 +01:00
L1ghtn1ng 65baabbdcf debug info to see what github actions is doing 2021-08-22 04:35:40 +01:00
L1ghtn1ng 6c71979308 debug info to see what github actions is doing 2021-08-22 04:28:24 +01:00
L1ghtn1ng cca6652512 debug info to see what github actions is doing 2021-08-22 04:23:03 +01:00
L1ghtn1ng 448aa402c4 debug info to see what github actions is doing 2021-08-22 04:22:01 +01:00
L1ghtn1ng 59ac74e629 Found an even better way of checking if running on GH actions and to skip with pytest and tidyer as well 2021-08-22 03:59:34 +01:00
L1ghtn1ng f43854ef0f Adjust if statment for is_github_action() 2021-08-22 02:20:38 +01:00
L1ghtn1ng aa5760f419 Adjust unitests to be able to skip if run on github 2021-08-22 02:12:08 +01:00
L1ghtn1ng f3f62232a4 Add bufferover unit test 2021-06-30 01:15:30 +01:00
L1ghtn1ng f8e911ee17 flake8 test fix 2021-06-28 01:19:10 +01:00
L1ghtn1ng faf7b23af2 update threatminer unit test 2021-06-21 00:28:03 +01:00
L1ghtn1ng 3244fac0cf update sublist3r unit test 2021-06-21 00:19:52 +01:00
L1ghtn1ng d28393b9a2 Add new module anubis and unit test for it. Update shodan related things 2021-06-21 00:19:27 +01:00
L1ghtn1ng c0e2b38a51 fix omnisint unit test 2021-05-17 22:04:36 +01:00
L1ghtn1ng ae6216a4ef fix test 2020-12-14 22:18:30 +00:00
L1ghtn1ng 8032d3fdc9 update otx test 2020-09-21 18:36:36 +01:00
L1ghtn1ng 0efdf38bec Add new module Omnisint 2020-09-21 18:36:20 +01:00
mm 9a5784b129 add static typing and tests (qwant search engine discovery) 2020-08-17 13:31:15 +02:00
L1ghtn1ng 51e92b6eb5 Fix threatminer unittest 2020-06-05 15:39:11 +01:00
L1ghtn1ng 1a4328b4bb Add new threatminer module 2020-05-25 20:52:53 +01:00
L1ghtn1ng d9b4ed3b28 Add new sublist3r module and remove vhost from sources 2020-05-17 23:29:22 +01:00
NotoriousRebel d90f940668 Updated certspotter search and changed github code to start with test. 2020-02-13 18:45:52 -05:00
NotoriousRebel 7f8aea33ad flake8 fixes. 2020-02-13 17:32:17 -05:00
NotoriousRebel c1e9e0c9c1 removed unncessary tests. 2020-02-13 17:19:51 -05:00
NotoriousRebel f9317d15f2 Fixed conflict. 2020-02-13 17:08:25 -05:00
NotoriousRebel 19391b9d8f Updated github tests most are passing. 2020-02-13 16:03:02 -05:00
L1ghtn1ng 4d48dcbb34 misc fixes and working on new module 2020-02-11 19:10:35 +00:00
L1ghtn1ng fe3d6a332e Fix proxy in setup that was missed and disable github test 2020-02-11 16:24:38 +00:00
L1ghtn1ng 9cb1fcae61 Updated deps for the github test 2020-02-02 23:27:46 +00:00
L1ghtn1ng ff82dfbf68 Tidy up tests and remove duplicated code 2020-01-15 22:29:42 +00:00
Matt d9968ee1da
Merge branch 'dev' into master 2020-01-14 21:56:10 -05:00
Matt 1a50276c95
Merge branch 'master' into dev 2020-01-14 21:29:32 -05:00
NotoriousRebel 62f3bc6f93 Got spyse working and fixed linkedin test. 2020-01-14 21:25:58 -05:00
L1ghtn1ng df89e19984 tests WIP for linkedin links 2020-01-14 23:39:00 +00:00
L1ghtn1ng 41f7497ae5 Remove 1 test and tidy up a few things and work on sypse module also add exalead to sources and update README.md about how to install theHarvester 2020-01-14 23:23:20 +00:00