All Categories → Software Architecture → distributed

Top 361 distributed open source projects

An Open Source Machine Learning Framework for Everyone

✭ 161,335

python C++MLIR Starlark HTML go deep-learning machine-learning tensorflow neural-network deep-neural-networks distributed ml

Ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

Cat

CAT 作为服务端项目基础组件，提供了 Java, C/C++, Node.js, Python, Go 等多语言客户端，已经在美团点评的基础架构中间件框架（MVC框架，RPC框架，数据库框架，缓存框架等，消息队列，配置系统等）深度集成，为美团点评各业务线提供系统丰富的性能指标、健康状况、实时告警等。

✭ 16,236

java c Less C#FreeMarker python monitoring metrics distributed realtime tracing apm

Sia

Blockchain-based marketplace for file storage. Project has moved to GitLab: https://gitlab.com/NebulousLabs/Sia

✭ 2,731

go blockchain cloud storage distributed decentralized sia

Shardingsphere Elasticjob Cloud

✭ 248

java cloud distributed scheduler cron job sharding scheduled-jobs

Spring Boot Start Current

Spring Boot 脚手架 Mybatis Spring Security JWT 权限 Spring Cache + Redis

✭ 246

java redis spring-boot websocket distributed spring-security permissions scheduling cors jwt-token

Powerjob

Enterprise job scheduling middleware with distributed computing ability.

✭ 3,231

java workflow distributed scheduler cron akka mapreduce

Dweb.page

Your Gateway to the Distributed Web

✭ 239

javascript distributed search-engine decentralized ipfs iota transfer

Flambe

An ML framework to accelerate research and its path to production.

✭ 236

python deep-learning machine-learning pytorch distributed research ml

Brainiak

Brain Imaging Analysis Kit

✭ 232

python machine-learning distributed neuroscience neuroimaging

Coerce Rs

Coerce - an asynchronous (async/await) Actor runtime and cluster framework for Rust

✭ 231

rust async asynchronous distributed cluster async-await remote actor-model actors await scalable tokio

Server

☁️ Nextcloud server, a safe home for all your data

Ruby Spark

Ruby wrapper for Apache Spark

✭ 221

ruby spark distributed

Vernemq

A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases.

Pysr

Simple, fast, and parallelized symbolic regression in Python/Julia via regularized evolution and simulated annealing

✭ 213

python julia machine-learning numpy distributed automl genetic-algorithm

Pottery

Redis for humans. 🌎🌍🌏

✭ 204

python library redis cache distributed redis-client lock dict

Gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

✭ 2,601

python Vue javascript SCSS HTML shell vue docker vuejs django dashboard spider distributed scrapy scrapyd webspider gerapy

Scannerl

The modular distributed fingerprinting engine

✭ 208

erlang security network distributed scanner fingerprinting

Oneflow

OneFlow is a performance-centered and open-source deep learning framework.

✭ 2,868

C++python Cuda c CMake shell deep-learning machine-learning neural-network deep-neural-networks distributed ml cuda

Improved Body Parts

Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation

✭ 202

python pytorch tutorial distributed pose-estimation apex training heatmap

Voik

♒︎ [WIP] An experimental ~distributed~ commit-log

✭ 200

rust kafka streaming distributed immutable nats

Cookim

Distributed web chat application base websocket built on akka.

✭ 198

scala websocket chat distributed cluster akka

Atomnas

Code for ICLR 2020 paper 'AtomNAS: Fine-Grained End-to-End Neural Architecture Search'

✭ 197

python distributed imagenet neural-architecture-search

Dsock

Distributed WebSocket broker

✭ 197

go redis websocket distributed

Ballista

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

✭ 2,274

java rust scala python kubernetes spark distributed jvm dataframe arrow datafusion

Tfmesos

Tensorflow in Docker on Mesos #tfmesos #tensorflow #mesos

✭ 194

python deep-learning machine-learning docker tensorflow neural-network deep-neural-networks distributed ml mesos

Herddb

A JVM-embeddable Distributed Database

✭ 192

java database sql distributed zookeeper replication distributed-database embeddable

Plynx

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.

✭ 192

javascript machine-learning data-science workflow distributed collaboration reproducibility experiments

Zi5book

book.zi5.me全站kindle电子书籍爬取，按照作者书籍名分类，每本书有mobi和equb两种格式，采用分布式进行全站爬取

✭ 191

python redis mongodb spider distributed

Arewedistributedyet

Website + Community effort to unlock the peer-to-peer web at arewedistributedyet.com ⚡🌐🔑

✭ 189

html browser p2p distributed decentralized webextension

Gateway

🚀构建分布式即时聊天、消息推送系统。 Building distributed instant messaging, push notification systems.

✭ 188

go websocket chat distributed cluster instant-messaging pusher

Js Spark

Realtime calculation distributed system. AKA distributed lodash

✭ 187

javascript spark distributed realtime distributed-computing multicore

Diaspora

A privacy-aware, distributed, open source social network.

✭ 12,937

ruby javascript Haml Gherkin SCSS Handlebars rails distributed social-network decentralized federated hacktoberfest

Bastion

Highly-available Distributed Fault-tolerant Runtime

✭ 2,333

rust shell hacktoberfest distributed-systems asynchronous distributed concurrency fault-tolerance actor smp supervision numa-aware

Dkeras

Distributed Keras Engine, Make Keras faster with only one line of code.

✭ 181

python deep-learning machine-learning tensorflow keras neural-network deep-neural-networks distributed-systems distributed parallel-computing keras-tensorflow tensorflow-models keras-models

Bigben

BigBen - a generic, multi-tenant, time-based event scheduler and cron scheduling framework

✭ 174

kotlin distributed events cron cassandra

Spoon

🥄 A package for building specific Proxy Pool for different Sites.

✭ 173

python redis proxy crawler spider distributed ip proxies proxypool

Idworker

idworker 是一个基于zookeeper和snowflake算法的分布式ID生成工具，通过zookeeper自动注册机器（最多1024台），无需手动指定workerId和datacenterId

✭ 171

java algorithm distributed zookeeper snowflake

Lightgbm

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

✭ 13,293

python r C++c Cuda shell machine-learning distributed microsoft data-mining parallel kaggle lightgbm decision-trees gradient-boosting gbdt gbm gbrt

Onyx

Distributed, masterless, high performance, fault tolerant data processing

✭ 2,019

clojure shell data streaming distributed batch

Dop

JavaScript implementation for Distributed Object Protocol

✭ 163

javascript json data rpc real-time distributed realtime protocol state-management

Diztl

Share, discover & download files in your network 💥

✭ 162

java go golang p2p distributed-systems grpc distributed peer-to-peer communication file-sharing

9volt

A modern, distributed monitoring system written in Go

✭ 160

go golang monitoring distributed high-performance high-availability

Node Rethinkdb Job Queue

A persistent job or task queue backed by RethinkDB.

✭ 158

javascript nodejs npm distributed queue task message job rethinkdb persistent

Pytorch Distributed Example

✭ 157

python pytorch distributed mnist

Ignareo Isml Auto Voter

Ignareo the Carillon, a web spider template of ultimate concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns!

✭ 154

python http asyncio distributed concurrency

Ansible Role Git

Ansible Role - Git

✭ 153

git ansible distributed setup role install version-control vcs

Gym Fx

Forex trading simulator environment for OpenAI Gym, observations contain the order status, performance and timeseries loaded from a CSV file containing rates and indicators. Work In Progress

✭ 151