752 Open source projects that are alternatives of or similar to Ruby Spark

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

A distributed data processing framework in Haskell.

Realtime calculation distributed system. AKA distributed lodash

R interface for Apache Spark

extremely distributed machine learning

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

♒︎ [WIP] An experimental ~distributed~ commit-log

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

A RPC framework leveraging Spark RPC module

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

Simple and Distributed Machine Learning

Highly-available Distributed Fault-tolerant Runtime

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Unified SQL Analytics Engine Based on SparkSQL

Code for ICLR 2020 paper 'AtomNAS: Fine-Grained End-to-End Neural Architecture Search'

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

BigBen - a generic, multi-tenant, time-based event scheduler and cron scheduling framework

Spark, Spark Streaming and Spark SQL unit testing strategies

Lingvo

State of the Art Natural Language Processing

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Tensorflow in Docker on Mesos #tfmesos #tensorflow #mesos

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Spark Structured Streaming / Kafka / Cassandra / Elastic

A tool for component-driven application development.

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.

GeoTrellis for PySpark

Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation

A privacy-aware, distributed, open source social network.

Redis for humans. 🌎🌍🌏

A better compressed bitset in Java

Apache Spark (PySpark) Practice on Real Data

Distributed Keras Engine, Make Keras faster with only one line of code.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Distributed web chat application base websocket built on akka.

Write your Spark data to Kafka seamlessly

The modular distributed fingerprinting engine

Firely's open source FHIR server

Distributed WebSocket broker

🥄 A package for building specific Proxy Pool for different Sites.

A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases.

idworker 是一个基于zookeeper和snowflake算法的分布式ID生成工具，通过zookeeper自动注册机器（最多1024台），无需手动指定workerId和datacenterId

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

k-Nearest Neighbors algorithm on Spark

Distributed, masterless, high performance, fault tolerant data processing

A JVM-embeddable Distributed Database

Isolation Forest on Spark

Simple, fast, and parallelized symbolic regression in Python/Julia via regularized evolution and simulated annealing

Apache Spark Connector for Azure Cosmos DB

book.zi5.me全站kindle电子书籍爬取，按照作者书籍名分类，每本书有mobi和equb两种格式，采用分布式进行全站爬取

Spark、Flink等离线任务的调度以及实时任务的监控

Profile and monitor your ML data pipeline end-to-end

OneFlow is a performance-centered and open-source deep learning framework.

A scalable nearest neighbor search library in Apache Spark

JavaScript implementation for Distributed Object Protocol

Big Data Ecosystem Docker

Website + Community effort to unlock the peer-to-peer web at arewedistributedyet.com ⚡🌐🔑