197 Open source projects that are alternatives of or similar to dask-pytorch-ddp

🎛 Distributed machine learning made simple.

julia package for running code on slurm clusters

Simple CLI tool for diagnostics and debugging of Cyphal networks

Notebooks that support blog posts and tech talks on Dask / Coiled.

An analytical performance modeling tool for deep neural networks.

WRENCH: Cyberinfrastructure Simulation Workbench

Censorship-resistant trustless protocols for smart contract, generic & high-load computing & machine learning on top of Bitcoin

Scalable machine 🤖 learning for time series forecasting.

Implementation of a LSTM with TensorFlow and distributed on Apache Spark

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Backend.AI is a streamlined, container-based computing cluster orchestrator that hosts diverse programming languages and popular computing/ML frameworks, with pluggable heterogeneous accelerator support including CUDA and ROCM.

Distributed Xarray with Apache Beam

Unleash the power of cloud

🪴 Nebari - your open source data science platform

Build and submit workflows to HTCondor in Python

Dockerized Folding@home client with NVIDIA GPU support to help battle COVID-19

Python client for using Prefect Cloud with Saturn Cloud

📄 The Ambients protocol white paper

SANSA Query Layer

分布式计算：分布式数据处理（流计算/批处理）、消息队列、数据仓库

A simple task queue implementation to enqeue jobs on local or remote processes.

Harmonious distributed data analysis in Rust.

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

Distributed SQL Engine in Python using Dask

Accelerated deep learning R&D

Distributed and Parallel Computing Framework with / for Python

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

Distributed, workflow-driven integration environment

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Yet another distributed compute framework

A framework called "pinspider" on Apache mesos, to get basic user information from a pinterest page of a user.

Proto Actor - Ultra fast distributed actors

Orleans providers for Azure Cosmos DB

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)

MPI Parallel framework for training deep learning models built in Theano

.NET Core framework for inter-service communication

Fleex makes it easy to create multiple VPS on cloud providers and use them to distribute workloads.

Hydra Hot Potato Player (game)

An MPI-based C++ or Python library for easy distributed pipeline processing

JSON messaging based socket interface with multi-threaded server and client

pyABC: distributed, likelihood-free inference

Legacy code connected to the high-assurance implementation of the Ouroboros protocol family

Jet is a simple OOP, dynamically typed, functional language that runs on the Erlang virtual machine (BEAM). Jet's syntax is Ruby-like syntax.

Radio Astronomy Algorithms Library

A simple orchestration library for running complex processes or workflows in Ruby

An easy-to-use WebUI for crypto plotting and farming. Offers Plotman, MadMax, Chiadog, Bladebit, Farmr, and Forktools in a Docker container. Supports Chia, MMX, Chives, Flax, HDDCoin, and BPX among others.

⚡️ An efficient cache for the execution of dask graphs.

Reproducibility for Humans: A lightweight tool to perform reproducible machine learning experiment.

An advanced distributed task flow management on top of Celery

A system for development of high-performance, data-intensive, distributed computing, applications, tools, and libraries.

Efficient transducers for Julia

This repository contains the code base for the Open Stream Processing Benchmark.

Bare bone examples of machine learning in TensorFlow

Fast and easy parallel mapreduce on HPC clusters

An actor framework for Go

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

Label images from Unsplash in browser - using MobileNet on Tensorflow.Js

A distributed block-based data storage and compute engine

Tutorials to help you build your first Swim app

Decentralized Computing Backend for Artificial Intelligence, Web3, Metaverse, and Gaming Application