752 Open source projects that are alternatives of or similar to Ruby Spark

Avro SerDe for Apache Spark structured APIs.

An open-source toolkit for large-scale genomic analysis

Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation

HandySpark - bringing pandas-like capabilities to Spark dataframes

A privacy-aware, distributed, open source social network.

A Clojure dataframe library that runs on Spark

Redis for humans. 🌎🌍🌏

Monitor Apache Spark from Jupyter Notebook

A better compressed bitset in Java

Compile-time Language Integrated Queries for Scala

Apache Spark (PySpark) Practice on Real Data

Julia binding for Apache Spark

Distributed Keras Engine, Make Keras faster with only one line of code.

Forex trading simulator environment for OpenAI Gym, observations contain the order status, performance and timeseries loaded from a CSV file containing rates and indicators. Work In Progress

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Distributed t-SNE via Apache Spark

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

spark ml 算法原理剖析以及具体的源码实现分析

Distributed web chat application base websocket built on akka.

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Write your Spark data to Kafka seamlessly

Process Common Crawl data with Python and Spark

The modular distributed fingerprinting engine

DEPRECATED version of Mysterium dVPN app. Please look at mysterium-vpn-desktop instead.

Firely's open source FHIR server

Pandas and Spark DataFrame comparison for humans

Distributed WebSocket broker

Web-based and pixels-based collaborative synthesizer

🥄 A package for building specific Proxy Pool for different Sites.

Reinforcement learning library(framework) designed for PyTorch, implements DQN, DDPG, A2C, PPO, SAC, MADDPG, A3C, APEX, IMPALA ...

A distributed MQTT message broker based on Erlang/OTP. Built for high quality & Industrial use cases.

Server

idworker 是一个基于zookeeper和snowflake算法的分布式ID生成工具，通过zookeeper自动注册机器（最多1024台），无需手动指定workerId和datacenterId

A framework to manage distributed WebRTC servers that communicate with browser clients

Geospatial Raster support for Spark DataFrames

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

k-Nearest Neighbors algorithm on Spark

Hazelcast IMDG Go Client

Distributed, masterless, high performance, fault tolerant data processing

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

A JVM-embeddable Distributed Database

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Isolation Forest on Spark

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Simple, fast, and parallelized symbolic regression in Python/Julia via regularized evolution and simulated annealing

Distributed Flow-Based Programming via message queues

Apache Spark Connector for Azure Cosmos DB

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

book.zi5.me全站kindle电子书籍爬取，按照作者书籍名分类，每本书有mobi和equb两种格式，采用分布式进行全站爬取

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Profile and monitor your ML data pipeline end-to-end

OneFlow is a performance-centered and open-source deep learning framework.

An encrypted data analytics platform

Website + Community effort to unlock the peer-to-peer web at arewedistributedyet.com ⚡🌐🔑

Share, discover & download files in your network 💥

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Big Data Ecosystem Docker

A Spark library for Amazon SageMaker.