1737 Open source projects that are alternatives of or similar to Scriptspider

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

Pluggable foundation blocks for building distributed apps.

Fairly basic redis-like hashmap implementation on top of a epoll TCP server.

A fault tolerant, protocol-agnostic RPC system

my blog, using markdown

👊SpringBoot+Zookeeper+Dubbo打造分布式高并发商品秒杀系统

Python爬虫代理IP池(proxy pool)

Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索

Elastic Key-Value Storage With Strong Consistency and Reliability

👽 OneBlog，一个简洁美观、功能强大并且自适应的Java博客

A lite distributed Java spider framework :-)

A lua library to provide distributed rate measurement using nginx + redis, you can use it to do a throttling system within many nodes.

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

book.zi5.me全站kindle电子书籍爬取，按照作者书籍名分类，每本书有mobi和equb两种格式，采用分布式进行全站爬取

🥄 A package for building specific Proxy Pool for different Sites.

😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识

知乎用户公开个人信息爬虫, 能够爬取用户关注关系，基于Python、使用代理、多线程

A spider on Dcard. Strong and speedy.

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Repository for Docker Image of Apache-Superset. [Docker Image: https://hub.docker.com/r/abhioncbr/docker-superset]

Go语言实例教程从入门到进阶，包括基础库使用、设计模式、面试易错点、工具类、对接第三方等

A new kind of virtual event platform 🐧

Python Stream Processing. A Faust fork

A collection of awesome web scaper, crawler.

Deployment Ready Developer to Developer Full-stack School Management System with payments, e-admission, result management, academic functionalities, and much more implemented in a simple way.

netease-music-spider is a sipder that you can find beautiful girlfriend or handsome boyfriend.

Web scan foundation framework

RedisGraph python client

A boilerplate template for starting a web services using Warp + SQLx (PostgreSQL) + Redis + Juniper (GraphQL). ❤️

😩Tool For Taobao/Tmall| 儿时玩具已经过时

Extend Redis with JavaScript modules

OK帮 云进销存 (SpringBoot Restful 全家桶)

The easiest solution to seed database with Go

Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池

Dynamic execution framework for your Redis data

RPC & event framework for Python 3

Type-safe Redis client for Golang

Tendis is a high-performance distributed storage system fully compatible with the Redis protocol.

🔌 A cache middleware for https://strapi.io

一个浏览器端数据爬虫，做每个人的数据助手

🌶️ 基于 Redis 的延迟队列中间件，采用 Golang 开发，支持 PHP、Golang 等多种语言客户端

RCT (Redis Computed Tomography) include parse redis rdb , slowlog analyze and clientlist analyze

Deploying and managing production-grade etcd clusters on cloud providers: failure recovery, disaster recovery, backups and resizing.

All Terrain Autonomous Quadruped

牛客网高级项目（SNS+社区问答类网站）

基于微博的数据挖掘与社交舆情分析

The most popular service bus for .NET

An implementation of the Raft distributed consensus protocol, verified in Coq using the Verdi framework

PHP client library for RediSearch.

Minimal example utilizing fastapi and celery with RabbitMQ for task queue, Redis for celery backend and flower for monitoring the celery tasks.

A boilerplate for Node.js apps / Rest API / Authentication from scratch - express, mongodb (mongoose).

DEPRECATED version of Mysterium dVPN app. Please look at mysterium-vpn-desktop instead.

中国大陆大学列表爬虫

An email automation solution, written in Golang.

Redis Desktop Manager Mac OSX DMG

A list of useful resources to learn Data Engineering from scratch