101 commits

Author	SHA1	Message	Date
NotoriousRebel	6011dadbd7	Cleaned up trello search and modified theHarvester to utilize Trello to return hostnames and Trello urls.	2018-12-22 13:04:00 -05:00
NotoriousRebel	2a5d3221f1	Syncingþ ... Merge remote-tracking branch 'upstream/master'	2018-12-21 21:16:31 -05:00
NotoriousRebel	b959971423	Fixed trello plugin to properly extract urls, reflected in theHarvester.py	2018-12-21 20:14:30 -05:00
NotoriousRebel	52b7a7d427	Integrated security trails into all mode, and touched up minor cosmetics.	2018-12-21 17:47:15 -05:00
NotoriousRebel	d76b3b8daa	Added Security Trails API as plugin and added to theHarvester, also created parser for it.	2018-12-21 15:17:51 -05:00
NotoriousRebel	562fcd7a34	Made search get subdomains and general information about domain, need to work on parsing results.	2018-12-20 22:23:31 -05:00
NotoriousRebel	a0dbd8101c	Added authenticate method and have started working on adding a plugin for Security Trails search.	2018-12-20 20:31:54 -05:00
Laramies	b7e7e285a2	Fixed GoogleCSE ... Fixed API calls	2018-12-19 23:54:07 +01:00
Laramies	1006e05b7a	Randomization ... UA randomization and delays unified across Plugins.	2018-12-19 22:41:02 +01:00
NotoriousRebel	34437a918e	Fixed small error in constants as well as constant User Agent for google and increased delay time if google starts blocking requests.	2018-12-19 16:40:26 -05:00
Laramies	b1fabec6ed	Minor fix ... Changing to HTTPs	2018-12-19 22:37:22 +01:00
Laramies	990d84b8e5	Update googlesearch.py	2018-12-19 22:36:31 +01:00
NotoriousRebel	9245c57575	cleaned up minor whitespace.	2018-12-19 16:25:27 -05:00
NotoriousRebel	805b891f15	Increasing sleep time if google starts blocking requests.	2018-12-19 16:20:44 -05:00
Matt	1fd693d8e5	Update constants.py ... Added docstring.	2018-12-18 18:02:56 -05:00
Matt	7821713d36	Update huntersearch.py ... Removing unnecessary thing.	2018-12-18 00:23:07 -05:00
NotoriousRebel	239b0f31f9	Implemented randomization within plugins and cleaned up small bugs.	2018-12-18 00:21:05 -05:00
NotoriousRebel	7e225c49c7	Started process of refactoring to make plugins more uniform across, implemented successfully on googlesearch, also made special function to check if Google blocks traffic.	2018-12-17 22:48:22 -05:00
NotoriousRebel	6b4b0e5ee3	Resyncing and fixed program crashing if using search engine that doesn't define all_ip, and made print statements more logical.	2018-12-15 22:28:52 -05:00
NotoriousRebel	f3597ee267	Syncing.	2018-12-15 22:07:37 -05:00
NotoriousRebel	b1d979d335	Synching with master.	2018-12-15 22:01:39 -05:00
jzold	6b426a4c72	Add cymon search engine	2018-12-09 17:44:28 +00:00
jzold	505a71781d	fix: optimize search with minimum number of page queries	2018-12-06 16:32:25 +00:00
Laramies	16057fd3de	Update discovery/censys.py	2018-12-01 10:42:25 +01:00
Laramies	e1ef6288ba	Added Trello Search ... New plugin to search public Trello boards	2018-12-01 10:39:01 +01:00
NotoriousRebel	8953b4d100	Made threatcrowd parse totalresults not just results, got censysparser to get pages and crawl them.	2018-11-29 16:48:36 -05:00
Christian Martorella	eae4fe5927	Merge pull request #107 from NotoriousRebel/master ... Modified discovery/crtsh.py to properly do searches.	2018-11-29 22:24:51 +01:00
NotoriousRebel	48cc8ce0de	Updating ... Merge remote-tracking branch 'upstream/master'	2018-11-28 17:16:44 -05:00
NotoriousRebel	fcbca16ab1	Added random selection of user-agent, and sleep inbetween requests for crtsh.py	2018-11-28 14:40:58 -05:00
NotoriousRebel	31a77cc199	Added docstring to crtsh.py	2018-11-28 12:45:03 -05:00
NotoriousRebel	00c884af13	Got crtsh search working as problem was in get_hostnames first line replaced self.results to self.totalresults.	2018-11-27 23:45:19 -05:00
NotoriousRebel	d8a8cb3ccc	Confirmed request is returning correct thing and am close to figuring out parser issue.	2018-11-27 23:40:30 -05:00
NotoriousRebel	f3788c6b41	Added method to get crt.sh ids and crawl them.	2018-11-27 22:05:51 -05:00
Laramies	590489fd5c	Fixed GoogleCSE ... Fixed API message, and error while executing due to order of storing data.	2018-11-27 23:29:05 +01:00
Laramies	36ceaab174	Google Certificates ... Added new search engine Google Certificate Transparency and fixed temporarily Shodan	2018-11-23 00:31:21 +01:00
Christian Martorella	c78acd2ffe	Merge branch 'master' into master	2018-11-22 22:49:00 +01:00
Christian Martorella	92b1a87246	Merge branch 'master' into master	2018-11-22 22:20:06 +01:00
Matt	40df2c71e6	Update googlesearch.py ... Updated req.content to req.text for google dorks option	2018-11-22 16:03:37 -05:00
NotoriousRebel	2d14274a69	Got dns brute force working after replacing when index out of range error occurs just pass.	2018-11-22 12:22:03 -05:00
NotoriousRebel	ea9c1f8abc	Have narrowed down problem and patched up other problems.	2018-11-21 23:11:06 -05:00
NotoriousRebel	cff87874dc	Replaced IPy.py with current version that supports python3.	2018-11-21 16:53:19 -05:00
NotoriousRebel	f04361ca82	Working on IPy.py doctests, cleaning up errors in it and fixed type conversion problem in getitem function.	2018-11-21 13:28:16 -05:00
NotoriousRebel	e826dc663b	Fixed most byte and str improper concats and now need to work on sockets not connecting properly.	2018-11-21 01:36:36 -05:00
NotoriousRebel	d21e2846d7	Cleaned up imports and added proper casting from bytes to str.	2018-11-20 22:17:41 -05:00
NotoriousRebel	d9b8b66286	Updated dnssearch to check if variable is defined.	2018-11-20 13:54:07 -05:00
Matt	f10387da8e	Update lazy.py ... Updated imports.	2018-11-20 13:35:34 -05:00
Matt	5ac0f86623	Update Lib.py ... Updated imports.	2018-11-20 13:35:11 -05:00
NotoriousRebel	157ff0dc69	Converted more code to python3 shodan works for the most part.	2018-11-20 12:04:57 -05:00
NotoriousRebel	4ba7c685c0	CleaConverted more of the code to python3 and verified that running code with all search engines works except crtsh gets inside loop I think.	2018-11-19 21:27:53 -05:00
NotoriousRebel	d38b1c4473	Replaced r.content with r.text in googlesearch to work properly.	2018-11-19 15:57:42 -05:00