1228 Open source projects that are alternatives of or similar to Guwen Spider

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

DEPRECATED. Evmongoose is an asynchronous, event(libev) based multi-protocol embedded networking library with functions including TCP, HTTP, WebSocket, MQTT and much more. It's based on mongoose and libev implementation and it's support Lua API.

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

Tina is a teeny tiny, header only, coroutine and job library.

Бот для ВКонтакте. Беседы / группы / развлечения.

A gentle guide for advanced Vert.x users

Async middleware for JavaScript and TypeScript

Reduce boilerplate for redux async actions and reducers

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

high performance .NET driver for Apache Cassandra

爬取微信公众号文章

CNode 社区 Nest 版本 https://cnodejs.org/

获取免费socks/https/http代理的网站集合

A short and easy boilerplate showcasing JWT auth with Nodejs, the Serverless framework, MongoDB and AWS Lambda.

APIs for loginning some websites by using requests.

Tag highlight in neovim

How to set-up a powerful API with Nodejs, GraphQL, MongoDB, Hapi, and Swagger

A Promise library for ClojureScript, or a poor man's core.async

😊👻基于react->express->mongo技术栈的同构SPA

Python爬虫和Flask实现小说网站

Proactive IO & Runtime system

[Course] Introduction to MongoDB code

async minimal redis client for tornado ioloop designed for performances (use C hiredis parser)

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

CLI utility for Drone, an Embedded Operating System.

拼多多爬虫，爬取所有商品、评论等信息

yspider -- 轻量级爬虫系统

Present status of mulitple 'jobs' in a command line tool, using terminal capability codes

Make it easy to develop large, complex Node.js app.

An async process dispatcher for Amp.

Apollo Server 2 how to setup subscriptions

Compose your async functions with elegance.

Minimal non-blocking I/O for Rust

Realtime web comms for Clojure/Script

用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站

feapder是一款支持分布式、批次采集、任务防丢、报警丰富的python爬虫框架

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

备份豆瓣计划

房价预测完整项目：1.爬取链家网数据 2.处理后，用sklearn中几个逻辑回归机器学习模型和keras神经网络搭建模型预测房价 最终结果神经网络效果更好，R^2值0.75左右

all kinds of scrapy demo

⌛️ Express starter for building RESTful APIs

REST API generator with Node.js, Express and Mongoose

B站用户爬虫 好耶~是爬虫

A lightweight boilerplate for a universal webapp based on koa, mongodb, node, vue, and webpack

Golang爬虫 爬取豆瓣电影Top250

基于 Python Asyncio + Redis 实现的代理池

滑动验证码，希望对你们有所帮助❤️

First class async & promise support for redis.

Non-blocking socket and TLS functionality for PHP based on Amp.

Async PHP client/server API for the telegram MTProto protocol

Java Deferred/Promise library similar to JQuery.

抖音API、抖音数据、抖音直播数据、抖音直播Api、抖音视频Api、抖音爬虫、抖音去水印、抖音视频下载、抖音视频解析、抖音直播监控、抖音数据采集

MERN Stack Engine

Unmaintained 🐳 ☕️ 🕷 Scala crawler(spider) framework, inspired by scrapy, created by @gaocegege

爬取北大法宝网http://www.pkulaw.cn/Case/

简单易用的Python爬虫框架，QQ交流群：597510560

微博超级话题爬虫，微博词频统计+情感分析+简单分类，新增肺炎超话爬取数据