Commit graph

95 commits

Author SHA1 Message Date
L1ghtn1ng
93966a4a24 fix mypy errors 2025-01-26 06:28:18 +00:00
L1ghtn1ng
13a0cdd62a Add async pagination helper and update pytest settings
Introduce the `next_page_or_end` method in `githubcode.py` to handle pagination. Additionally, modify the test case and upgrade pytest settings in `pyproject.toml` to the latest versions, ensuring compatibility and updated configurations.
2024-10-27 01:02:05 +01:00
L1ghtn1ng
467a33fd3a remove test that is not stable enough due to the site not always being up or is getting blocked intermittently 2023-12-16 13:46:38 +00:00
L1ghtn1ng
cddcb5f383 Fix otx test 2023-11-12 22:24:45 +00:00
Branch Vincent
4d825aaf33
build: migrate to pep517 backend (#1505)
* build: migrate to pep517 backend

* test loading config files
2023-10-08 19:45:23 +01:00
J.Townsend
76ce3b3c6f
lint fix 2023-10-02 00:18:00 +01:00
J.Townsend
c397275cac fix test 2023-09-24 16:15:35 +00:00
yoonthegoon
c13843ec0d #1492 run black . and isort . 2023-07-27 01:34:21 +01:00
éclairevoyant
bbe3f02a07 Delete qwant tests (see #1390) 2023-05-04 08:52:04 +01:00
Matt
90082dbaa0
Added 4 new sources, Removed 2 Sources, Added custom DNS resolver, backported to python3.9, and other misc changes (#1381)
* Added call to api endpoint to explicitly gather subdomains from zoomeye, updated user agents, replaced orjson with ujson, and fixed substring not found error.

* Updated orjson to ujson.

* Fixed semantic error in html check in google workaround.

* Fixed flake8 errors.

* Fixed VT to use API.

* Fixed virustotal module.

* Fixed possible edge case that could possibly cause an infinite loop.

* Removed broken modules.

* Added 4 new sources: brave, criminalip, hunterhow, and subdomainfinderc99, added dnsresolve, and other misc changes.

* Added TODO comment.

* Fixed bin\theHarvester to allow python3.9

* Pep8 newline at end of file.

* Fixed error when passing in comma seperated resolvers and allow for user to pass in --dns-resolve flag with no arguments to use default resolvers that user has.
2023-04-10 18:51:04 +01:00
J.Townsend
b50f2ad2c5
remove sublist3r test as the domain no longer works 2023-04-06 12:59:07 +01:00
L1ghtn1ng
3a2c180295 Remove missed omnisint ci removal and version import fix 2022-11-13 01:33:01 +00:00
L1ghtn1ng
f175269941 add a boat load of static typing fixes 2022-10-31 00:51:59 +00:00
L1ghtn1ng
56fe724a1c sublist3r Skipping on Github CI due unstable site 2022-08-14 03:03:04 +01:00
J.Townsend
72d8dcad21
Flake8 fixes (#1181)
* Flake8 fixes

* Remove test due to bufferover run moving to api only
2022-08-14 01:23:56 +01:00
J.Townsend
22e1eb9bdb
A lot of changes and fixes (#1168)
* add pytest.ini file and fix test warning in qwantsearch

* ignore unsed imports

* Remove n45ht as the api is down

* Remove modules that use google as google blocks you after one go

* Remove missed code from when removing modules that use google

* Remove missed code from when removing modules that use google

* Add new vt-py dep and update pytest

* WIP virustotal migration to api

* Remove test that fails due to how the api returns not found entries

* Remove entries from myparser re google

* update fastapi and starlette

* update version

* Update dockerfile to use dev ubuntu version

* remove spyse module

* remove spyse dep

* fix tests by removing un-needed tests and indentation fix

* fix some mypy errors

* remove spyse and remove color output and fix mypy error

* flake8 fixes

* bump version and set it a dev version
2022-08-03 23:12:59 +01:00
J.Townsend
15fe11130c
Add new n45ht module, lots of results returned (#899)
* Add new fullhunt module

* Remove python checks in the run script as they are not needed anymore

* Remove netcraft from ci as it is not needed

* Update Dockerfile to fix security issues

* Add new n45ht module, lots of results returned
2021-10-24 04:10:37 +01:00
L1ghtn1ng
8f978821af Fix omnisint module 2021-10-04 00:57:57 +01:00
L1ghtn1ng
65baabbdcf debug info to see what github actions is doing 2021-08-22 04:35:40 +01:00
L1ghtn1ng
6c71979308 debug info to see what github actions is doing 2021-08-22 04:28:24 +01:00
L1ghtn1ng
cca6652512 debug info to see what github actions is doing 2021-08-22 04:23:03 +01:00
L1ghtn1ng
448aa402c4 debug info to see what github actions is doing 2021-08-22 04:22:01 +01:00
L1ghtn1ng
59ac74e629 Found an even better way of checking if running on GH actions and to skip with pytest and tidyer as well 2021-08-22 03:59:34 +01:00
L1ghtn1ng
f43854ef0f Adjust if statment for is_github_action() 2021-08-22 02:20:38 +01:00
L1ghtn1ng
aa5760f419 Adjust unitests to be able to skip if run on github 2021-08-22 02:12:08 +01:00
L1ghtn1ng
f3f62232a4 Add bufferover unit test 2021-06-30 01:15:30 +01:00
L1ghtn1ng
f8e911ee17 flake8 test fix 2021-06-28 01:19:10 +01:00
L1ghtn1ng
faf7b23af2 update threatminer unit test 2021-06-21 00:28:03 +01:00
L1ghtn1ng
3244fac0cf update sublist3r unit test 2021-06-21 00:19:52 +01:00
L1ghtn1ng
d28393b9a2 Add new module anubis and unit test for it. Update shodan related things 2021-06-21 00:19:27 +01:00
L1ghtn1ng
c0e2b38a51 fix omnisint unit test 2021-05-17 22:04:36 +01:00
L1ghtn1ng
ae6216a4ef fix test 2020-12-14 22:18:30 +00:00
L1ghtn1ng
8032d3fdc9 update otx test 2020-09-21 18:36:36 +01:00
L1ghtn1ng
0efdf38bec Add new module Omnisint 2020-09-21 18:36:20 +01:00
mm
9a5784b129 add static typing and tests (qwant search engine discovery) 2020-08-17 13:31:15 +02:00
L1ghtn1ng
51e92b6eb5 Fix threatminer unittest 2020-06-05 15:39:11 +01:00
L1ghtn1ng
1a4328b4bb Add new threatminer module 2020-05-25 20:52:53 +01:00
L1ghtn1ng
d9b4ed3b28 Add new sublist3r module and remove vhost from sources 2020-05-17 23:29:22 +01:00
NotoriousRebel
d90f940668 Updated certspotter search and changed github code to start with test. 2020-02-13 18:45:52 -05:00
NotoriousRebel
7f8aea33ad flake8 fixes. 2020-02-13 17:32:17 -05:00
NotoriousRebel
c1e9e0c9c1 removed unncessary tests. 2020-02-13 17:19:51 -05:00
NotoriousRebel
f9317d15f2 Fixed conflict. 2020-02-13 17:08:25 -05:00
NotoriousRebel
19391b9d8f Updated github tests most are passing. 2020-02-13 16:03:02 -05:00
L1ghtn1ng
4d48dcbb34 misc fixes and working on new module 2020-02-11 19:10:35 +00:00
L1ghtn1ng
fe3d6a332e Fix proxy in setup that was missed and disable github test 2020-02-11 16:24:38 +00:00
L1ghtn1ng
9cb1fcae61 Updated deps for the github test 2020-02-02 23:27:46 +00:00
L1ghtn1ng
ff82dfbf68 Tidy up tests and remove duplicated code 2020-01-15 22:29:42 +00:00
Matt
d9968ee1da
Merge branch 'dev' into master 2020-01-14 21:56:10 -05:00
Matt
1a50276c95
Merge branch 'master' into dev 2020-01-14 21:29:32 -05:00
NotoriousRebel
62f3bc6f93 Got spyse working and fixed linkedin test. 2020-01-14 21:25:58 -05:00