363 Open source projects that are alternatives of or similar to Wenshu_spider

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Everybody can be scrapy guru

☁️ Modern & minimalistic load balancer for the Сloud era

Backend para coleta e disponibilização dos dados 📜

lots of performance (or lots of porn, if you prefer) httpd: Easy, chrooted, fast and simple to use HTTP server for static content. Runs on Linux, BSD, Android and OSX/Darwin. It's free but if you like it, consider donating to the EFF: https://supporters.eff.org/donate

Simplify software testing, by easily mocking any system using HTTP/HTTPS, allowing a team to test and develop against a service that is not complete or is unstable or just to reproduce planned/edge cases.

PHP Proxy html2canvas

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

Automated Caddy reverse proxy for docker containers

最新动态在这里【我的程序员日志】

📡 A simple proxy server created for https://hoppscotch.io

react + flask + scrapy 构建的单页应用漫画网站

Scrapy crawler to collect data on the back catalog of songs listed for sale.

🏃 Some of the python tutorial - 《Python学习笔记》

3proxy - tiny free proxy server

可视化爬虫自动采集平台

A collection of awesome web scaper, crawler.

用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站

A multi-functional version of a popular network circumvention tool

微博爬虫：每天定时爬取微博热搜榜的内容，留下互联网人的记忆。

A proxy server that implements Socks5/Shadowsocks/Redirect/HTTP (tcp) and Shadowsocks/TProxy/Tunnel (udp) protocols.

Go HTTP proxy server library

The best free email forwarding for custom domains. Visit our website to get started (SMTP server)

pigat ( Passive Intelligence Gathering Aggregation Tool ) 被动信息收集聚合工具

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

免费、高速的 V2Ray 代理和订阅。

BeyondCorp-inspired Access Proxy. Secure internal services outside your VPN/perimeter network during a zero-trust transition.

A powerful TCP/UDP tool, which support socks5 proxy by tcp and udp, http proxy and NAT traversal. This tool can help you bypass gfw easily

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

基于微博的数据挖掘与社交舆情分析

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

Modern and Delightful Web Debugging Proxy for macOS, iOS, and Android ⚡️

A powerful web-proxy used as a core for the TestCafe testing framework. 🔨 😃

A secure image proxy server

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题 ；HTTP协议介绍； Requests使用 ；解析器Xpath介绍； MongoDB与MySQL； 多线程爬虫； Scrapy介绍 ；Scrapy-redis介绍； 使用docker部署； 使用nomad管理docker集群； 使用EFK查询docker日志

Scrapy Training companion code

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

😩Tool For Taobao/Tmall| 儿时玩具已经过时

a spider for cnki patent content, just for study and commucation, no use for business.

借助Python抓取微博数据，并对抓取的数据进行情绪分析

scrapy专利爬虫（停止维护）

scrapy框架爬取51job(scrapy.Spider)，智联招聘(扒接口)，拉勾网(CrawlSpider)

Unmaintained 🐳 ☕️ 🕷 Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege

Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池

Code for the second edition Web Scraping with Python book by Packt Publications

PostgreSQL proxy server.

lots of spider (很多爬虫）

稳定易用的代理工具

爬虫, http代理, 模拟登陆!

A one-key script to setup Cloak plugin with Shadowsocks on your server

土巴兔和谷居装修网站爬虫

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

150 LOC Ruby forward proxy using only standard libraries.

all kinds of scrapy demo

🦁 goproxy is a proxy server which can forward http or https requests to remote servers./ goproxy 是一个反向代理服务器，支持转发 http/https 请求。

macOS OpenVPN Server and Client Configuration (OpenVPN, Tunnelblick, PF)

A slack proxy server

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️