413 Open source projects that are alternatives of or similar to Storm Crawler

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

qTox is a chat, voice, video, and file transfer IM client using the encrypted peer-to-peer Tox protocol.

Awesome list of distributed systems resources

Nebula is a powerful framwork for building highly concurrent, distributed, and resilient message-driven applications for C++.

A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）

Redis-based components for Scrapy.

🎉A Bitcask Distributed Key/Value store using Raft for consensus with a Redis compatible API written in Go.

A web front-end for password cracking and analytics

Meshbird is open-source cloud-native multi-region multi-cloud distributed private networking.

A hyperparameter optimization framework

A Graphical Frontend for Sia - https://sia.tech

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

This is a distributed task management system base on .Net Core platform .

PPT I collected

A lightweight distributed configuration management platform. （分布式配置管理平台XXL-CONF）

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

A HTTP Ruby API for Consul

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

这是一个支持分布式和集群的java游戏服务器框架，可用于开发棋牌、回合制等游戏。基于netty实现高性能通讯，支持tcp、http、websocket等协议。支持消息加解密、攻击拦截、黑白名单机制。封装了redis缓存、mysql数据库的连接与使用。轻量级，便于上手。

A collection of awesome web crawler,spider in different languages

Distributed Java.《分布式 Java》

分布式架构开发套件。包括缓存(一二级缓存、自动缓存管理)、队列、分布式定时任务、文件服务(七牛、阿里云OSS、fastDFS)、日志、搜索、分布式锁、分布式事务、集成dubbo、spring boot支持以及常用的工具包等。

A small Vietnamese Go book compiled by ZaloPay teams.

Decentralized Issue Tracking for git

A programmable, observable and distributed job orchestration system.

ZoneMinder is a free, open source Closed-circuit television software application developed for Linux which supports IP, USB and Analog cameras.

分布式任务调度平台(Distributed Job Schedule Platform)

libvineyard: an in-memory immutable data manager.

Desktop client for Cabal, the p2p/decentralized/local-first chat platform.

📌 TransmittableThreadLocal (TTL), the missing Java™ std lib(simple & 0-dependency) for framework/middleware, provide an enhanced InheritableThreadLocal that transmits values between threads even using thread pooling components.

A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in python using Scikit-Learn and TensorFlow.

Simplified distributed locking implementation using Redis

In-memory and distributed caching toolkit for Elixir.

The Infinit policy-based software-defined storage platform.

A developing game server framework,based on Entity Component System(ECS).

LBADD: An experimental, distributed SQL database

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

🕶 Awesome list of distributed, decentralized, p2p apps and tools 👍

A music player that connects to your cloud/distributed storage.

A lightweight distributed message queue framework.(分布式消息队列XXL-MQ)

Fast job queuing and RPC in python with asyncio and redis.

Distributed, fault-tolerant key-value storage written in go.

A high performance, distributed RPC framework.（分布式服务框架XXL-RPC）

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

IPFS implementation in JavaScript

分布式配置管理平台(Distributed Configuration Management Platform)

Java library for secure, distributed, P2P-based file synchronization and sharing.

Oracle Coherence Community Edition

Redis distributed locks in PHP

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Open-source distributed computation and storage platform

ACHE is a web crawler for domain-specific search.

Efficient video analysis at scale

Erlang node implemented in Python 3.5+ (Asyncio-based)

Framework and Library for Distributed Online Machine Learning

Mysterium Network Node - official implementation of distributed VPN network (dVPN) protocol

Peer-to-Peer Databases for the Decentralized Web

A distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）

Password-protect URLs using AES in the browser; create hidden bookmarks without a browser extension