752 Open source projects that are alternatives of or similar to Ruby Spark

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

Spark RDD with Lucene's query and entity linkage capabilities

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

Blockchain over DHT in GO

golang HTTP stress test tool, support single and distributed

Julia binding for Apache Spark

Distributed streaming key-value storage

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

这是一款分布式的java游戏服务器框架

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

A distributed transaction framework that supports multiple languages, supports saga, tcc, xa, 2-phase message, outbox patterns.

零基础学习spark，大数据学习

Distributed Keras Engine, Make Keras faster with only one line of code.

Clearly see and debug your celery cluster in real time!

An elixir implementation of Rtree, optimized for fast updates.

基于区块链的符合W3C DID和Verifiable Credential规范的分布式身份解决方案

Web framework for Erlang.

Data science and Big Data with Python

p2p peer-to-peer training of tensorflow models

xxl-job is a lightweight distributed task scheduling framework, and this package provide a dotnet executor client for it

Dapper Style Distributed Tracing Instrumentation Libraries

Forex trading simulator environment for OpenAI Gym, observations contain the order status, performance and timeseries loaded from a CSV file containing rates and indicators. Work In Progress

hashtopolis.org

Jupyter magics and kernels for working with remote Spark clusters

This is the decentralised version of PeARS, the people's search engine, to be taken as Phase 1 of the fully distributed system.

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Gringofts makes it easy to build a replicated, fault-tolerant, high throughput and distributed event-sourced system.

Bucketing and partitioning system for Parquet

Decentralized Package Network

Big Data Processing Framework - Unified Data API or SQL on Any Storage

OceanBase is an enterprise distributed relational database with high availability, high performance, horizontal scalability, and compatibility with SQL standards.

Lethean Virtual Private Network (VPN)

Cherry Network's node implemented in Rust

The memo elastic and resilient key-value store.

A SPARQL query federator of heterogeneous data sources

Apache Spark - A unified analytics engine for large-scale data processing

Flowgraph package for scalable asynchronous system development

Distributed t-SNE via Apache Spark

Distributed Data-Flow Coordination Platform Based on Node-RED

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

InsightEdge Core

Production Ready Data Integration Product, documentation：

Module for Effortless Redundancy and Loadbalancing In Naemon

A Time Series Library for Apache Spark

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Documentation repo of nebula orchestration system

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

MIT6.824实现分布式一致性算法——Raft&Paxos

Two-day workshop that covers how to use R to interact databases and Spark

Urho3D extension library

A Spark library for Amazon SageMaker.

A Spark plugin for reading Excel files via Apache POI

MLOps Platform

Java开发者或者大数据开发者面试知识点整理

🚀构建分布式即时聊天、消息推送系统。 Building distributed instant messaging, push notification systems.

A modern, distributed monitoring system written in Go

A robust, and flexible open source User & Entity Behavior Analytics (UEBA) framework used for Security Analytics. Developed with luv by Data Scientists & Security Analysts from the Cyber Security Industry. [PRE-ALPHA]

Cross-platform Distributed Test Runner. Executes tests in parallel, time balanced on multiple machines.

Peace of mind from prototype to production