2559 Open source projects that are alternatives of or similar to Gosint

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Get Aliexpress product details in JSON

今日头条机器人，支持用户登陆、关注、取消关注、获取关注粉丝、发文、发悟空问答、点赞、评论、采集各种类型新闻讯息等，使用今日头条网页版API实现

Web crawler.

JavaScript + BeautifulSoup = JSSoup

A Laravel wrapper for CrawlerDetect - the web crawler detection library

crawler framework, distributed crawler extractor

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

Shodan.io Command Line Interface

Be nice on the web

All In One Pentesting Tool For Recon & Auditing , Phone Number Lookup , Header , SSH Scan , SSL/TLS Scan & Much More.

Google search results crawler, get google search results that you need

Converting data from services like Censys and Shodan to a common data model

Pentest: Subdomains enumeration tool for penetration testers.

多线程知乎用户爬虫，基于python3

Crawler (Bot) searching for credential leaks on different paste sites.

TIGMINT: OSINT (Open Source Intelligence) GUI software framework

图片爬取下载工具，极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。

Grabs all of the audio files from all of the Blinkist books

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

🧬 Extract and analyze contributors info from git repos

🔑 Hash type identifier (CLI & lib)

robots.txt file parsing and checking for R

🌒 Shell command obfuscation to avoid detection systems

Calculate fingerprints of a website for OSINT search

Information gathering & website reconnaissance | https://phishstats.info/

A collection of useful links for Pentesters

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Yet Another LInkedIn Scraper...

Misc. Public Reports of Penetration Testing and Security Audits.

🌭💦 91porn爬虫在线无限制API接口（永久有效，口令每日更新） 及 在线web预览

bingip2hosts is a Bing.com web scraper that discovers websites by IP address

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

知乎模拟登录，支持提取验证码和保存 Cookies

A simple and flexible web crawler framework for java.

Papercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.

Continuous scalable web crawler built on top of Flink and crawler-commons

Scraps for publicly accessible MongoDB instances and dumps user passwords

Interactive CLI Web Crawler

Az összes számlád még egy helyen :)

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

No description or website provided.

Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.

🍰 一个可视化的爬虫平台

🐛一只登录正方教务管理系统，爬取数据的小爬虫

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Public Repository of Open Source Tools for Cyber Threat Intelligence Analysts and Researchers

我的爬虫合集

A fast tool to fetch URLs from HTML attributes by crawl-in.

🍻 bilibili video (including bangumi) and danmaku downloader | B站视频（含番剧）、弹幕下载器

渗透测试☞经验/思路/总结/想法/笔记

Some useful scripts simplifying bureaucracy

Simple Weibo Scraper

Port scanning and domain utility.

a reliable high-level web crawling & scraping framework for Node.js.

Documentation and Sharing Repository for ThreatPinch Lookup Chrome & Firefox Extension

Update Version of weibo_terminator, This is Workflow Version aim at Get Job Done!

磁力網站U3C3介紹以及域名更新

An R web crawler and scraper

StalkPhish - The Phishing kits stalker, harvesting phishing kits for investigations.