1228 Open source projects that are alternatives of or similar to Guwen Spider

Sming - Open Source framework for high efficiency native ESP8266 development

Asynchronous parallel SSH client library.

Compose your async functions with elegance.

基于 Node Express Mongoose 实现的用户注册/登陆权限验证

A better in-memory cache for Node and the browser

Pholcus is a distributed high-concurrency crawler software written in pure golang

Async Redis Client for PHP based on Amp.

Chili: HTTP Served Hot

Typegoose - Define Mongoose models using TypeScript classes.

Async MySQL Connector for .NET and .NET Core

Advanced Developer Async Programming Toolkit

Some classic web crawler projects.一些经典的爬虫

A python grpc client/async client for LND ⚡⚡⚡

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

A simple、 light（only two file)、fast 、powerful 、easy to use 、easy to extend 、 Android Library To Manager your AsyncTask/Thread/CallBack Jobqueue ! 一个超级简单，易用，轻量级，快速的异步任务管理器，类似于AsyncTask，但是比AsyncTask更好用，更易控制，从此不再写Thread ！ ^_^

API Oficial do Te Emprego

Scraping scripts for various websites.

Minimal non-blocking I/O for Rust

Real-time stream processing for python

traffic-shm (Anna) is a Java based lock free IPC library.

Tools for accessing Autodesk Forge APIs from modern Node.js apps.

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

🎬 Tame async code with battle-tested promises

python crawler spider

百度云网盘搜索引擎，包含爬虫 & 网站

Realtime web comms for Clojure/Script

A small demo chat based on Aerys.

Yet Another Web Spider

File serving using tower web

The Resources for "Natural Language to Logical Form" ; "自然语言转逻辑形式"研究资料收集。

A Blockly extension designed to develop games (made with love ❤)

A Generic Low-Code Framework Built on a Config-Driven Tree Walker

Javlibrary spider

用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站

zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目

MEAN Stack Angular 6 CRUD Web Application

PROJECT MOVED: https://github.com/kdex/ws-promise

整合第三方网站的视频和弹幕资源, 为白嫖党提供最佳看番追剧体验

越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）

(A)sync python wrapper for the Brawl Stars API

Kotlin Coroutines await() extension for Retrofit Call

feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架

Gospider - Fast web spider written in Go

Nodejs实现的一个磁力链接爬虫 http://findit.keenwon.com (原域名http://findit.so )

A high performance web crawler in Elixir.

Async ACME library written in PHP based on the Amp concurrency framework.

werkzeug + twisted.web

Simple and modern async event emitter

🐾 Creeper - The Next Generation Crawler Framework (Go)

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

Object Observer functionality of JavaScript objects/arrays via native Proxy

AV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Cross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.

微博超级话题爬虫，微博词频统计+情感分析+简单分类，新增肺炎超话爬取数据

极具创新的面向微服务和 OLTP/OLAP 场景的单机与分布式关系数据库

📋 问卷系统

[no longer maintained] Scalable, coroutine-based, fibers/green-threads for Rust. (aka MIO COroutines).

📡 API for chat application for DogeCodes React course