All Projects → Cgboal → Sonarsearch

Cgboal / Sonarsearch

A MongoDB importer and API for Project Sonars DNS datasets

Programming Languages

go
31211 projects - #10 most used programming language

Projects that are alternatives of or similar to Sonarsearch

Bugcrowd Levelup Subdomain Enumeration
This repository contains all the material from the talk "Esoteric sub-domain enumeration techniques" given at Bugcrowd LevelUp 2017 virtual conference
Stars: ✭ 513 (+72.73%)
Mutual labels:  osint, dns, subdomain, enumeration
Amass
In-depth Attack Surface Mapping and Asset Discovery
Stars: ✭ 6,284 (+2015.82%)
Mutual labels:  osint, dns, subdomain, enumeration
Reconky-Automated Bash Script
Reconky is an great Content Discovery bash script for bug bounty hunters which automate lot of task and organized in the well mannered form which help them to look forward.
Stars: ✭ 167 (-43.77%)
Mutual labels:  osint, enumeration, penetration-testing, bugbounty
Aiodnsbrute
Python 3.5+ DNS asynchronous brute force utility
Stars: ✭ 370 (+24.58%)
Mutual labels:  osint, dns, subdomain, enumeration
Osmedeus
Fully automated offensive security framework for reconnaissance and vulnerability scanning
Stars: ✭ 3,391 (+1041.75%)
Mutual labels:  osint, subdomain, penetration-testing, bugbounty
Dictionary Of Pentesting
Dictionary collection project such as Pentesing, Fuzzing, Bruteforce and BugBounty. 渗透测试、SRC漏洞挖掘、爆破、Fuzzing等字典收集项目。
Stars: ✭ 492 (+65.66%)
Mutual labels:  dns, subdomain, bugbounty
Amass
In-depth Attack Surface Mapping and Asset Discovery
Stars: ✭ 1,693 (+470.03%)
Mutual labels:  dns, subdomain, enumeration
Oneforall
OneForAll是一款功能强大的子域收集工具
Stars: ✭ 4,202 (+1314.81%)
Mutual labels:  osint, subdomain, bugbounty
Interlace
Easily turn single threaded command line applications into a fast, multi-threaded application with CIDR and glob support.
Stars: ✭ 760 (+155.89%)
Mutual labels:  penetration-testing, enumeration, bugbounty
Hosthunter
HostHunter a recon tool for discovering hostnames using OSINT techniques.
Stars: ✭ 427 (+43.77%)
Mutual labels:  osint, penetration-testing, bugbounty
aquatone
A Tool for Domain Flyovers
Stars: ✭ 43 (-85.52%)
Mutual labels:  osint, penetration-testing, bugbounty
Crithit
Takes a single wordlist item and tests it one by one over a large collection of websites before moving onto the next. Create signatures to cross-check vulnerabilities over multiple hosts.
Stars: ✭ 182 (-38.72%)
Mutual labels:  penetration-testing, enumeration, bugbounty
Nosqlmap
Automated NoSQL database enumeration and web application exploitation tool.
Stars: ✭ 1,928 (+549.16%)
Mutual labels:  penetration-testing, enumeration, bugbounty
Dnsprobe
DNSProb is a tool built on top of retryabledns that allows you to perform multiple dns queries of your choice with a list of user supplied resolvers.
Stars: ✭ 221 (-25.59%)
Mutual labels:  dns, subdomain, bugbounty
Awsbucketdump
Security Tool to Look For Interesting Files in S3 Buckets
Stars: ✭ 1,021 (+243.77%)
Mutual labels:  penetration-testing, enumeration, bugbounty
Rengine
reNgine is an automated reconnaissance framework for web applications with a focus on highly configurable streamlined recon process via Engines, recon data correlation and organization, continuous monitoring, backed by a database, and simple yet intuitive User Interface. reNgine makes it easy for penetration testers to gather reconnaissance with…
Stars: ✭ 3,439 (+1057.91%)
Mutual labels:  osint, penetration-testing, bugbounty
Payloadsallthethings
A list of useful payloads and bypass for Web Application Security and Pentest/CTF
Stars: ✭ 32,909 (+10980.47%)
Mutual labels:  penetration-testing, enumeration, bugbounty
Dirsearch
Web path scanner
Stars: ✭ 7,246 (+2339.73%)
Mutual labels:  penetration-testing, enumeration, bugbounty
Pdlist
A passive subdomain finder
Stars: ✭ 204 (-31.31%)
Mutual labels:  osint, dns, bugbounty
KaliIntelligenceSuite
Kali Intelligence Suite (KIS) shall aid in the fast, autonomous, central, and comprehensive collection of intelligence by executing standard penetration testing tools. The collected data is internally stored in a structured manner to allow the fast identification and visualisation of the collected information.
Stars: ✭ 58 (-80.47%)
Mutual labels:  osint, penetration-testing, bugbounty

SonarSearch

This repository contains all the code needed to create index Rapid7's Project Sonar Forward DNS lookup datasets into a MongoDB database, and query them in a time efficient fashion.

An instance of this API (Crobat) is online at the following URL:

https://sonar.omnisint.io

Crobat API

Currently, Project Crobat offers two APIs. The first of these is a REST API, with the following endpoints:

/subdomains/{domain} - All subdomains for a given domain
/tlds/{domain} - All tlds found for a given domain
/all/{domain} - All results across all tlds for a given domain
/reverse/{ip} - Reverse DNS lookup on IP address
/reverse/{ip}/{mask} - Reverse DNS lookup of a CIDR range

Additionally, Project Crobat offers a gRPC API which is used by the client to stream results over HTTP/2. Thus, it is recommended that the client is used for large queries as it reduces both query execution times, and server load. Also, unlike the REST API, there is no limit to the size of specified when performing reverse DNS lookups.

No authentication is required to use the API, nor special headers, so go nuts.

However, the REST API does have pagination. Currently pages are limited to 10k results per page. To request pages, add ?page=X to the request, where X is the page number. The gRPC API does not require pagination as results are streamed to the client.

Crobat

Crobat is a command line utility designed to allow easy querying of the Crobat API. To install the client, run the following command:

$ go get github.com/cgboal/sonarsearch/crobat

A Docker container is also available:

$ docker run cgboal/crobat:latest -h 

By default, Crobat will return a list of result in plain-text, however, JSON output is also supported.

Below is a full list of command line flags:

$ crobat -h                                                                                                                                                                      
Usage of crobat:
  -r string
    	Perform reverse lookup on IP address or CIDR range. Supports files and quoted lists
  -s string
    	Get subdomains for this value. Supports files and quoted lists
  -t string
    	Get tlds for this value. Supports files and quoted lists
  -u	Ensures results are unique, may cause instability on large queries due to RAM requirements

Additionally, it is now possible to pass either file names, or quoted lists ('example.com example.co.uk') as the value for each flag in order to specify multiple domains/ranges.

Third-Party SDKs

Contributing

If you wish to contribute a SDK written in other languages, shoot me a DM on Twitter (@CalumBoal), or open an issue on this repository and I will provide a link to your repository in the Third-Party SDK's section of this readme.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].