2719 Open source projects that are alternatives of or similar to Fooproxy

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Async Python 3.6+ web scraping micro-framework based on asyncio

🌿 Exploring cooperative concurrency primitives in Python

Web crawling framework based on asyncio.

🧊 一个可爱且任性的 B 站视频下载器（bilili V2）

Python爬虫代理IP池(proxy pool)

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

A library of C++ coroutine abstractions for the coroutines TS

Take a modern Python codebase to the next level of performance.

Python asynchronous client library for Kubernetes http://kubernetes.io/

Async Techniques and Examples in Python Course

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

owllook-小说搜索引擎

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

Async WebDriver implementation for asyncio and asyncio-compatible frameworks

Asynchronous HTTP client/server framework for asyncio and Python

🥄 A package for building specific Proxy Pool for different Sites.

Async ODM (Object Document Mapper) for MongoDB based on python type hints

Non-blocking Python methods using decorators

简单易用的Python爬虫框架，QQ交流群：597510560

all kinds of scrapy demo

微博超级话题爬虫，微博词频统计+情感分析+简单分类，新增肺炎超话爬取数据

Digger is a powerful and flexible web crawler implemented by pure golang

Code examples from my toptal engineering blog article

yspider -- 轻量级爬虫系统

Приложение для практического руководства по разработке бекенд-сервисов на Python (на основе вступительного испытания в Школу бэкенд‑разработки Яндекса)

mxget的Python实现

aioelasticsearch-py wrapper for asyncio

Server-sent events support for aiohttp

一个完整的nodeJs 串行爬虫 抓取3万多个页面。

[no longer maintained] Scalable, coroutine-based, fibers/green-threads for Rust. (aka MIO COroutines).

基于swoole的异步轻量级web框架，内部封装协程异步非阻塞全套mysql、redis、mongo、memcached连接池，可以轻松start、reload、stop，加入数据库的查询模块,框架已经封装好近乎同步写法，底层异步调用

MM131网站图片爬取 🚨

Asynchronous Python client for InfluxDB

中国大陆大学列表爬虫

Asynchronous operations (promises) for Unity3d.

CoCrawler is a versatile web crawler built using modern tools and concurrency.

😱Full Automatic Amazon Distributed Spider | 亚马逊分布式四国际站采集选款产品|账号admin,密码adminadmin

Simple REST client for python 3.6+

book.zi5.me全站kindle电子书籍爬取，按照作者书籍名分类，每本书有mobi和equb两种格式，采用分布式进行全站爬取

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

A lite distributed Java spider framework :-)

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

Tina is a teeny tiny, header only, coroutine and job library.

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池

Familiar asyncio ORM for python, built with relations in mind

A framework to build Slack apps using Python

asyncio powered FreeSWITCH cluster control

JS逆向研究

Distributed tracing instrumentation for asyncio with zipkin

Single header asymmetric stackful cross-platform coroutine library in pure C.

一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)

A dynamic FastAPI router that automatically creates CRUD routes for your models

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

Web sessions for aiohttp.web

Build and document REST APIs with aiohttp and apispec

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Crawl some picture for fun