1319 Open source projects that are alternatives of or similar to Spydan

OSINT Swiss Army Knife

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

A web crawler for Go

High performance crawler for Nodejs

Get Aliexpress product details in JSON

🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。

🔍 A collection of interesting, funny, and depressing search queries to plug into shodan.io 👩‍💻

Different utility scripts for pentesting and hacking.

Creating Scrapy scrapers via the Django admin interface

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

A Facebook crawler

快速、简洁且强大的PHP爬虫框架

An open source webapp for scraping: towards a public service for webscraping

A python web scraper for public email lists.

Command line tool that allows you to explore IoT devices by using Shodan API.

🔎 shodansploit > v1.3.0

Security Orchestration, Automation and Response (SOAR) Platform. 安全编排与自动化响应平台，无需编写代码的安全自动化，使用 SOAR 可以让团队工作更加高效

Web Scan Lazy Tools - Python Package

Crawly, a high-level web crawling & scraping framework for Elixir.

A collection of awesome web crawler,spider in different languages

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

A high performance web crawler in Elixir.

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Elegant Scraper and Crawler Framework for Golang

Grabs all of the audio files from all of the Blinkist books

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

Scraping scripts for various websites.

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

Python script to download messages from a Facebook page to a CSV file

thelordseye searches and returns detailed information about devices that are directly connected to the internet [IoT] (Smart TV's, Fridges, Webcams, Traffic Lights etc).

日常小脚本，懒人欢乐多。

🔭 A modern, async Ruby gem for Shodan, the world's first search engine for Internet-connected devices.

A repository dedicated to IoT(internet of things ) and python scripts

network reconnaissance toolkit

Scraps for publicly accessible MongoDB instances and dumps user passwords

A web crawler (for bug hunting) that gathers more than you can imagine.

图片爬取下载工具，极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。

robots.txt file parsing and checking for R

中国明星数据爬取。你甚至可以拿到互联网上所有的人之间的关系，接下来你可以自己发挥！基于这些数据，你可以完成更多有趣的事情。比如说社交网络分析，关系网络可视化，算法研究，和其他有意思的事情。Chinese star data crawling. You can even get all the people on the internet! Based on these data, you can do more interesting things. For example, social network analysis, relational network visualization, algorithm research, and other interesting things.

Get movie info from douban(豆瓣) and display in your terminal

自动答题程序🎉

⚡️ Docker official image for Wallarm Node. API security platform agent.

Download the ts files according to the given m3u8 file.

A simple, fast and easy-to-deploy Heroku ready flask web app template written in Python.

Powerful Shodan API client using RxJava and Retrofit

Download Impartus lectures, convert to mkv for offline viewing.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

A simple web scraping engine supporting concurrent and anonymous scraping

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Command line program to download documents from web portals.

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

A curated list of security resources for a Ruby on Rails application

千万级图片爬虫、视频爬虫 [开源版本] Image Spider

No description or website provided.

Simple for use node html crawler (spider) of site web pages