728 Open source projects that are alternatives of or similar to dislib

Open-source distributed computation and storage platform

🚀 R package: future: Unified Parallel and Distributed Processing in R for Everyone

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

🚀 R package: future.apply - Apply Function to Elements in Parallel using Futures

Parallel Programming with Python and Charm++

Fast and easy parallel mapreduce on HPC clusters

Bare bone examples of machine learning in TensorFlow

WRENCH: Cyberinfrastructure Simulation Workbench

distributed dataflows with functional list operations for data processing with C++14

A distributed block-based data storage and compute engine

Fundamentals of Spark with Python (using PySpark), code examples

Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++

Scheduler for sub-node tasks for HPC systems with batch scheduling

A simplified, lightweight ETL Framework based on Apache Spark

🚀 R package future.batchtools: A Future API for Parallel and Distributed Processing using batchtools

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

A Clojure dataframe library that runs on Spark

An advanced distributed task flow management on top of Celery

Distributed parallelization of 3D volume mesh adaptation

Simple CLI tool for diagnostics and debugging of Cyphal networks

The repo is obsolete. Use at your own risk.

Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Storm, Spark or Flink.

Coding Standards for the USC Biostats group

General interest repository for CSCS users

Prometheus exporter for use with the Lustre parallel filesystem

The Azure HPC On-Demand Platform provides an HPC Cluster Ready solution

YT metadata exporter

Censorship-resistant trustless protocols for smart contract, generic & high-load computing & machine learning on top of Bitcoin

cdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。

An MPI-based C++ or Python library for easy distributed pipeline processing

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

📄 The Ambients protocol white paper

Integrated Manager for Lustre

Serverless application to monitor an AWS Batch architecture through dashboards.

pyABC: distributed, likelihood-free inference

Apache Accumulo Testing

Mirror of Apache Tez (Incubating)

A framework called "pinspider" on Apache mesos, to get basic user information from a pinterest page of a user.

Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

Jet is a simple OOP, dynamically typed, functional language that runs on the Erlang virtual machine (BEAM). Jet's syntax is Ruby-like syntax.

分布式计算：分布式数据处理（流计算/批处理）、消息队列、数据仓库

PredictionIO Python SDK

XML/Document DB on top of distributed cache

Social Network Facebook Analysis (Python, Networkx)

A versatile, template-based FORTRAN wrapper written in Python.

An analytical performance modeling tool for deep neural networks.

(Latest semester at https://github.com/kmader/Quantitative-Big-Imaging-2019) The material for the Quantitative Big Imaging course at ETHZ for the Spring Semester 2018

Singularity 101

A simple orchestration library for running complex processes or workflows in Ruby

TT Tech Research Notes

Java wrapper for ArrayFire

PredictionIO Ruby SDK

This repository collects the materials from the course "Foundations of HPC", 2021, at the Data Science and Scientific Computing Department, University of Trieste

An R package for large scale estimation with stochastic gradient descent

MPI Parallel framework for training deep learning models built in Theano

🧮 An Open Source, Parallel and Heterogeneous Finite Element Analysis Framework

Heavy Peer To Peer: a MPI based benchmark for network diagnostic

Apache Accumulo Docker

This repository provides easy automation scripts for building a HPC environment in Azure. It also includes examples to build e2e environment and run some of the key HPC benchmarks and applications.