Top 167 distributed-computing open source projects

Harmonious distributed data analysis in Rust.

An advanced distributed task flow management on top of Celery

Backend.AI is a streamlined, container-based computing cluster orchestrator that hosts diverse programming languages and popular computing/ML frameworks, with pluggable heterogeneous accelerator support including CUDA and ROCM.

Efficient transducers for Julia

Accelerated deep learning R&D

Bare bone examples of machine learning in TensorFlow

Distributed and Parallel Computing Framework with / for Python

An actor framework for Go

A curated list of awesome parallel computing resources

The new, performant, and simplified version of Holochain on Rust (sometimes called Holochain RSM for Refactored State Model)

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

A computation-centric distributed graph processing system.

Train and run Pytorch models on Apache Spark.

Kubernetes Operator for Allreduce-style Distributed Training

Realtime calculation distributed system. AKA distributed lodash

Distributed DAG (Directed acyclic graph) framework for machine learning with UI

papers on scalable and efficient machine learning systems

Cuneiform distributed programming language

A message-passing distributed computing framework for node.js

A module which wraps Hydra and ExpressJS into a library for building distributed applications - such as microservices

🚀 R package: future.apply - Apply Function to Elements in Parallel using Futures

An intuitive remotely-accessible system performance monitoring and task management tool for servers and headless Raspberry Pi setups.

A Clojure dataframe library that runs on Spark

Web scan foundation framework

Fundamentals of Spark with Python (using PySpark), code examples

Java library for distributed zero knowledge proof systems

Easy local cluster creation for Elixir to aid in unit testing

Orleans Membership provider for Kubernetes

Workflow engine for exploration of simulation models using high throughput computing

ScaleCube Cluster is a lightweight Java VM implementation of SWIM: Scalable Weakly-consistent Infection-style Process Group Membership Protocol. features cluster membership, failure detection, and gossip protocol library.

Clojure API for a more dynamic Google Dataflow

Distributed Deep learning with Keras & Spark

A purely functional library to build distributed and event-driven systems

Fast sequential, threaded, and distributed for-loops for Julia—fold for humans™

Open-source software for volunteer computing and grid computing.

High-assurance implementation of the Ouroboros protocol family

A distributed task scheduler for Dask

Teaching materials in python at the @ENSAE

My Distributed Systems references

Parallel Workflow extension for Rake, runs on multicores, clusters, clouds.

📚 深入浅出分布式基础架构，Linux 与操作系统篇 | 分布式系统篇 | 分布式计算篇 | 数据库篇 | 网络篇 | 虚拟化与编排篇 | 大数据与云计算篇

PySpark + Scikit-learn = Sparkit-learn

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Multi-platform Scheduling and Workflows Engine

Runtime for Writing Streaming Applications in Rust.

Java implementation of K-Sortable Globally Unique IDs

Circuit breaker for HTTP requests in Elixir

Concurrent, Asynchronous, Distributed, Communicating Tasks with Python

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Distributed computing for the browser

Distributed Computing for AI Made Simple

JavaScript Digital Organisms simulator

A Hashcat wrapper for distributed hashcracking

A long list of academic papers on the topic of distributed consensus

LizardFS is an Open Source Distributed File System licensed under GPLv3.

SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

🚀 R package: future: Unified Parallel and Distributed Processing in R for Everyone

Framework for large distributed pipelines

A full stack, reactive architecture for general purpose programming. Algebraic and monadically composable primitives for concurrency, parallelism, event handling, transactions, multithreading, Web, and distributed computing with complete de-inversion of control (No callbacks, no blocking, pure state)