SpiderfootSpiderFoot automates OSINT for threat intelligence and mapping your attack surface.
Stars: ✭ 6,882 (+1616.21%)
DorknetSelenium powered Python script to automate searching for vulnerable web apps.
Stars: ✭ 256 (-36.16%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (-57.36%)
arachnodHigh performance crawler for Nodejs
Stars: ✭ 17 (-95.76%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+210.72%)
Goribot[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
Stars: ✭ 190 (-52.62%)
PhotonIncredibly fast crawler designed for OSINT.
Stars: ✭ 8,332 (+1977.81%)
Operative Frameworkoperative framework is a OSINT investigation framework, you can interact with multiple targets, execute multiple modules, create links with target, export rapport to PDF file, add note to target or results, interact with RESTFul API, write your own modules.
Stars: ✭ 511 (+27.43%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (+33.67%)
AvbookAV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+1928.18%)
aquatoneA Tool for Domain Flyovers
Stars: ✭ 43 (-89.28%)
Freshonions TorscraperFresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (-13.22%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+1095.26%)
Osint SanFramework для сбора данных из открытых источников. В Framework используется большое количество API, их необходимо зарегистрировать самому.
Stars: ✭ 99 (-75.31%)
Querylist🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
Stars: ✭ 2,392 (+496.51%)
SnoopSnoop — инструмент разведки на основе открытых данных (OSINT world)
Stars: ✭ 886 (+120.95%)
TorbotDark Web OSINT Tool
Stars: ✭ 821 (+104.74%)
PyParser-CVEMulti source CVE/exploit parser.
Stars: ✭ 25 (-93.77%)
CrawlerA high performance web crawler in Elixir.
Stars: ✭ 781 (+94.76%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (+9.73%)
ScrapitScraping scripts for various websites.
Stars: ✭ 25 (-93.77%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+63.59%)
Xcrawler快速、简洁且强大的PHP爬虫框架
Stars: ✭ 344 (-14.21%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+3774.06%)
MetaforgeAn OSINT Metadata analyzing tool that filters through tags and creates reports
Stars: ✭ 63 (-84.29%)
SpydanA web spider for shodan.io without using the Developer API.
Stars: ✭ 30 (-92.52%)
Reconspider🔎 Most Advanced Open Source Intelligence (OSINT) Framework for scanning IP Address, Emails, Websites, Organizations.
Stars: ✭ 621 (+54.86%)
flydnsRelated subdomains finder
Stars: ✭ 29 (-92.77%)
linkedinscraperLinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.
Stars: ✭ 22 (-94.51%)
crawlerA simple and flexible web crawler framework for java.
Stars: ✭ 20 (-95.01%)
flink-crawlerContinuous scalable web crawler built on top of Flink and crawler-commons
Stars: ✭ 48 (-88.03%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-96.26%)
mongodb-scraperScraps for publicly accessible MongoDB instances and dumps user passwords
Stars: ✭ 33 (-91.77%)
WebCrawler一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
Stars: ✭ 39 (-90.27%)
slime🍰 一个可视化的爬虫平台
Stars: ✭ 27 (-93.27%)
dijnet-botAz összes számlád még egy helyen :)
Stars: ✭ 17 (-95.76%)
PentestingMisc. Public Reports of Penetration Testing and Security Audits.
Stars: ✭ 24 (-94.01%)
munich-scriptsSome useful scripts simplifying bureaucracy
Stars: ✭ 105 (-73.82%)
bots-zooNo description or website provided.
Stars: ✭ 59 (-85.29%)
BusterAn advanced tool for email reconnaissance
Stars: ✭ 387 (-3.49%)
Open-source-tools-for-CTIPublic Repository of Open Source Tools for Cyber Threat Intelligence Analysts and Researchers
Stars: ✭ 91 (-77.31%)
galerA fast tool to fetch URLs from HTML attributes by crawl-in.
Stars: ✭ 138 (-65.59%)
lightnovel epub🍭 epub generator for (light)novels (轻) 小说 epub 生成器,支持站点:轻之国度、轻小说文库
Stars: ✭ 89 (-77.81%)
QuickScanPort scanning and domain utility.
Stars: ✭ 26 (-93.52%)
Infosec referenceAn Information Security Reference That Doesn't Suck; https://rmusser.net/git/admin-2/Infosec_Reference for non-MS Git hosted version.
Stars: ✭ 4,162 (+937.91%)
Weibo terminator workflowUpdate Version of weibo_terminator, This is Workflow Version aim at Get Job Done!
Stars: ✭ 259 (-35.41%)
StalkphishStalkPhish - The Phishing kits stalker, harvesting phishing kits for investigations.
Stars: ✭ 256 (-36.16%)
ThreatpinchlookupDocumentation and Sharing Repository for ThreatPinch Lookup Chrome & Firefox Extension
Stars: ✭ 257 (-35.91%)
linkyYet Another LInkedIn Scraper...
Stars: ✭ 44 (-89.03%)
tg crawlerJust a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.
Stars: ✭ 71 (-82.29%)
CloudbunnyCloudBunny is a tool to capture the real IP of the server that uses a WAF as a proxy or protection. In this tool we used three search engines to search domain information: Shodan, Censys and Zoomeye.
Stars: ✭ 273 (-31.92%)
Bt Btt磁力網站U3C3介紹以及域名更新
Stars: ✭ 261 (-34.91%)
RcrawlerAn R web crawler and scraper
Stars: ✭ 274 (-31.67%)
Spider Flow新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Stars: ✭ 365 (-8.98%)