aioScrapy
Overview
aioScrapy是一款基于asyncio与aiohttp的异步协程爬虫框架。
Requirements
- Python3.6
- aiohttp3.4.4
Install
直接下载源码即可
ScrapingBoot / aioScrapy
Licence: other
基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star
Stars: ✭ 34
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to aioScrapy
Arsenic
Async WebDriver implementation for asyncio and asyncio-compatible frameworks
Stars: ✭ 209 (+514.71%)
Mutual labels: twisted, aiohttp, asyncio
Pyee
A port of Node.js's EventEmitter to python
Stars: ✭ 236 (+594.12%)
Mutual labels: twisted, asyncio
Eliot
Eliot: the logging system that tells you *why* it happened
Stars: ✭ 874 (+2470.59%)
Mutual labels: twisted, asyncio
Requests Threads
🎭 Twisted Deferred Thread backend for Requests.
Stars: ✭ 366 (+976.47%)
Mutual labels: twisted, asyncio
Gidgethub
An async GitHub API library for Python
Stars: ✭ 226 (+564.71%)
Mutual labels: twisted, aiohttp
Arq
Fast job queuing and RPC in python with asyncio and redis.
Stars: ✭ 695 (+1944.12%)
Mutual labels: queue, asyncio
Janus
Thread-safe asyncio-aware queue for Python
Stars: ✭ 475 (+1297.06%)
Mutual labels: queue, asyncio
think-async
🌿 Exploring cooperative concurrency primitives in Python
Stars: ✭ 178 (+423.53%)
Mutual labels: queue, asyncio
prometheus-async
Async helpers for prometheus_client.
Stars: ✭ 136 (+300%)
Mutual labels: twisted, asyncio
Loafer
Asynchronous message dispatcher - Currently using asyncio and amazon SQS
Stars: ✭ 104 (+205.88%)
Mutual labels: queue, asyncio
Tokio
Asyncio event loop written in Rust language
Stars: ✭ 236 (+594.12%)
Mutual labels: aiohttp, asyncio
Python Mocket
a socket mock framework - for all kinds of socket animals, web-clients included
Stars: ✭ 209 (+514.71%)
Mutual labels: aiohttp, asyncio
Create Aio App
The boilerplate for aiohttp. Quick setup for your asynchronous web service.
Stars: ✭ 207 (+508.82%)
Mutual labels: aiohttp, asyncio
Aiohttp admin
admin interface for aiohttp application http://aiohttp-admin.readthedocs.io
Stars: ✭ 207 (+508.82%)
Mutual labels: aiohttp, asyncio
rearq
A distributed task queue built with asyncio and redis, with built-in web interface
Stars: ✭ 81 (+138.24%)
Mutual labels: queue, asyncio
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].