78 commits

Author	SHA1	Message	Date
jzold	6b426a4c72	Add cymon search engine	2018-12-09 17:44:28 +00:00
jzold	505a71781d	fix: optimize search with minimum number of page queries	2018-12-06 16:32:25 +00:00
Laramies	16057fd3de	Update discovery/censys.py	2018-12-01 10:42:25 +01:00
Laramies	e1ef6288ba	Added Trello Search ... New plugin to search public Trello boards	2018-12-01 10:39:01 +01:00
Christian Martorella	eae4fe5927	Merge pull request #107 from NotoriousRebel/master ... Modified discovery/crtsh.py to properly do searches.	2018-11-29 22:24:51 +01:00
NotoriousRebel	fcbca16ab1	Added random selection of user-agent, and sleep inbetween requests for crtsh.py	2018-11-28 14:40:58 -05:00
NotoriousRebel	31a77cc199	Added docstring to crtsh.py	2018-11-28 12:45:03 -05:00
NotoriousRebel	00c884af13	Got crtsh search working as problem was in get_hostnames first line replaced self.results to self.totalresults.	2018-11-27 23:45:19 -05:00
NotoriousRebel	d8a8cb3ccc	Confirmed request is returning correct thing and am close to figuring out parser issue.	2018-11-27 23:40:30 -05:00
NotoriousRebel	f3788c6b41	Added method to get crt.sh ids and crawl them.	2018-11-27 22:05:51 -05:00
Laramies	590489fd5c	Fixed GoogleCSE ... Fixed API message, and error while executing due to order of storing data.	2018-11-27 23:29:05 +01:00
Laramies	36ceaab174	Google Certificates ... Added new search engine Google Certificate Transparency and fixed temporarily Shodan	2018-11-23 00:31:21 +01:00
Christian Martorella	c78acd2ffe	Merge branch 'master' into master	2018-11-22 22:49:00 +01:00
Christian Martorella	92b1a87246	Merge branch 'master' into master	2018-11-22 22:20:06 +01:00
Matt	40df2c71e6	Update googlesearch.py ... Updated req.content to req.text for google dorks option	2018-11-22 16:03:37 -05:00
NotoriousRebel	2d14274a69	Got dns brute force working after replacing when index out of range error occurs just pass.	2018-11-22 12:22:03 -05:00
NotoriousRebel	ea9c1f8abc	Have narrowed down problem and patched up other problems.	2018-11-21 23:11:06 -05:00
NotoriousRebel	cff87874dc	Replaced IPy.py with current version that supports python3.	2018-11-21 16:53:19 -05:00
NotoriousRebel	f04361ca82	Working on IPy.py doctests, cleaning up errors in it and fixed type conversion problem in getitem function.	2018-11-21 13:28:16 -05:00
NotoriousRebel	e826dc663b	Fixed most byte and str improper concats and now need to work on sockets not connecting properly.	2018-11-21 01:36:36 -05:00
NotoriousRebel	d21e2846d7	Cleaned up imports and added proper casting from bytes to str.	2018-11-20 22:17:41 -05:00
NotoriousRebel	d9b8b66286	Updated dnssearch to check if variable is defined.	2018-11-20 13:54:07 -05:00
Matt	f10387da8e	Update lazy.py ... Updated imports.	2018-11-20 13:35:34 -05:00
Matt	5ac0f86623	Update Lib.py ... Updated imports.	2018-11-20 13:35:11 -05:00
NotoriousRebel	157ff0dc69	Converted more code to python3 shodan works for the most part.	2018-11-20 12:04:57 -05:00
NotoriousRebel	4ba7c685c0	CleaConverted more of the code to python3 and verified that running code with all search engines works except crtsh gets inside loop I think.	2018-11-19 21:27:53 -05:00
NotoriousRebel	d38b1c4473	Replaced r.content with r.text in googlesearch to work properly.	2018-11-19 15:57:42 -05:00
NotoriousRebel	35bbfeaf44	Replacing httplib with requests.	2018-11-19 15:28:38 -05:00
NotoriousRebel	554ab59176	Cleaned up more python2 code and had to fix implicit conversion not happening in python3.	2018-11-19 15:00:19 -05:00
NotoriousRebel	57333e72db	Fixed more print statements and tied up other loose odds and ends.	2018-11-15 12:52:33 -05:00
NotoriousRebel	2a20d3ff47	Starting the change from python2 to python3.7	2018-11-14 22:13:52 -05:00
Laramies	d26ce55733	Update discovery/huntersearch.py	2018-11-15 00:05:19 +01:00
Laramies	a2c97e9fc4	Update discovery/huntersearch.py ... Changed limit to 100, to get more results in one go.	2018-11-15 00:04:04 +01:00
Christian Martorella	8e0fc46cbd	Merge pull request #101 from jzold/master ... [New Feature - Censys]	2018-11-14 23:17:30 +01:00
Matt	a0d3ae2409	Update googlesearch.py ... Edited one time to decrease.	2018-11-09 12:46:56 -05:00
NotoriousRebel	221ffa4c84	Decreased time inbetween google dork searches to increase speed of it.	2018-11-09 12:45:54 -05:00
NotoriousRebel	b92cdf07f5	Modified hunter search engine so user just specificies key in huntersearch.py!	2018-11-06 17:12:20 -05:00
NotoriousRebel	36eacf2267	Reworking hunter search engine to integrate more logically and better.	2018-11-05 18:54:32 -05:00
NotoriousRebel	444e7e1d96	Added hunter search engine and made sure it doesn't overwite previous data.	2018-11-05 15:15:36 -05:00
NotoriousRebel	dc8e555c15	Updated huntersearch to work properly, have to verify it doesn't overwrite existing data.	2018-11-05 14:54:59 -05:00
NotoriousRebel	bcdb9a66d4	Reworking huntersearch to integrate better and more logically.	2018-11-04 19:19:48 -05:00
NotoriousRebel	73642b5843	Reworking hunter search engine into theHarvester.py to work properly.	2018-11-04 19:15:07 -05:00
NotoriousRebel	e7b22b94b7	Added hunter search engine and just need to test it, checked to make sure user key was not empty.	2018-11-04 17:26:34 -05:00
jzold	6cf3d18902	Censys implementation	2018-11-02 23:04:20 +00:00
NotoriousRebel	ffd77542fe	Merging to push update. ... Merge branch 'master' of https://github.com/NotoriousRebel/theHarvester	2018-11-02 09:39:47 -04:00
NotoriousRebel	9d3c2b79db	Added huntersearch class for huntersearches, requires an api key.	2018-11-02 09:36:51 -04:00
Christian Martorella	44d4d68990	Merge branch 'master' into master	2018-10-27 21:01:55 +02:00
Laramies	3f6253e8e6	Merge branch 'master' of https://github.com/laramies/theHarvester	2018-10-26 22:30:11 +02:00
Laramies	6903fde30c	Change server for PGP ... Set MIT as default server	2018-10-26 22:30:07 +02:00
NotoriousRebel	6e55a63c40	Made boolean to be an arguement instead of necessary in class as only used in one spot which is inside function.	2018-10-26 16:15:43 -04:00