460 Open source projects that are alternatives of or similar to scrapy_plus

Spin up Tor containers and then proxy HTTP requests via these Tor instances

A Scrapy extension to log items coverage when the spider shuts down

Document Search Engine Tool

python-Reptile

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Scrapy项目（mysql+mongodb豆瓣top250电影）

163music spider by scrapy.

Securely and anonymously share files, host websites, and chat with friends using the Tor network

Bash script for setting up a private Tor bridge

A repository of Tor hidden services.

Scraping Ebay's products using Scrapy Web Crawling Framework

Scrapy, a fast high-level web crawling & scraping framework for dart and Flutter

😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

IP2Proxy Node.js module allows users to query an IP address to determine if it was being used as open proxy, web proxy, VPN anonymizer and TOR exits.

An open source webapp for scraping: towards a public service for webscraping

一些简单有趣的Python小Demo

python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取（生成cookie）、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答

Find existing email addresses by nickname using API/SMTP checking methods without user notification. Please, don't hesitate to improve cat's job! 🐱🔎 📬

LyricsMaster is a library for downloading lyrics from multiple lyrics providers.

The source code for animecenter

Personal Data Engineering Projects

Scrapy project boilerplate done right

TOR BROWSER IN ELECTRON

A simple way to create a Tor onion service for existing Docker containers.

Denarius [$D] is a PoW/PoS Hybrid Cryptocurrency with Tribus a new PoW Hashing Algo built specifically for D, one of a kind hybrid masternodes called Fortuna Stakes, atomic swaps, staking, mining, IPFS, optional Native Tor and I2P, and much more!

Bangumi小工具

Container-based Tor access point (Anonymizing Middlebox).

A minimal android controller library for Tor

A library for peer discovery inside the Tor network

On demand Debian Linux (Tor) Hotspot setup tool

A middleware of cookies persistence for Scrapy

威胁情报采集系统

iabot.toolforge.org

A docker networking driver that transparently tunnels docker containers TCP traffic through a proxy

Automatically change tor ip address over time when accessing the internet. Make it private and safe for you

10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码

The Red Rabbit project is just what a hacker needs for everyday automation. Red Rabbit unlike most frameworks out there does not automate other peoples tools like the aircrack suite or the wifite framework, it rather has its own code and is raw source with over 270+ options. This framework might just be your everyday key to your workflow

proxy for telegram and twitter

TOR Server Docker image

Docker microservice & Crawler by scrapy

Middleware packages for nanoexpress

Firewall-System based on OpenWRT or Pi-Hole with UnBound, TOR, optional Privoxy, opt. ntopng and opt. Configuration of the AVM FRITZ!Box with Presets for Security and Port-List. Please visit:

Send and receive files securely through Tor.

🔐🌐 Privacy-respecting web frontends for popular services

A Web Crawler that scrapes using YAML and python code.

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Whoami provides enhanced privacy, anonymity for Debian and Arch based linux distributions

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Android version of OnionShare (under development)

The Devils Eye is an OSINT tool that extracts onion links and descriptions that match with the users query from the Darkweb, without requiring the use for Tor.

A web search engine built with Python which uses TF-IDF and PageRank to sort search results.

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Tor - Home Assistant Community Add-ons

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

Experiences in extracting data from Facebook with these 3 methods: Facebook Graph API, Automation tools, DevTools Console

免费 IP 代理池。Scrapy 爬虫框架插件

收集各种免费的 Python 爬虫项目