752 Open source projects that are alternatives of or similar to Ruby Spark

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Distributed Keras Engine, Make Keras faster with only one line of code.

基于区块链的符合W3C DID和Verifiable Credential规范的分布式身份解决方案

Data science and Big Data with Python

xxl-job is a lightweight distributed task scheduling framework, and this package provide a dotnet executor client for it

Forex trading simulator environment for OpenAI Gym, observations contain the order status, performance and timeseries loaded from a CSV file containing rates and indicators. Work In Progress

Jupyter magics and kernels for working with remote Spark clusters

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Bucketing and partitioning system for Parquet

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Lethean Virtual Private Network (VPN)

The memo elastic and resilient key-value store.

Apache Spark - A unified analytics engine for large-scale data processing

Distributed t-SNE via Apache Spark

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Production Ready Data Integration Product, documentation：

A Time Series Library for Apache Spark

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Two-day workshop that covers how to use R to interact databases and Spark

Urho3D extension library

spark ml 算法原理剖析以及具体的源码实现分析

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

Distributed web chat application base websocket built on akka.

Distributed Image Search Engine Crawler

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

"More users = More capacity"

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Efficient variant-call data storage and retrieval library using the TileDB storage library.

Write your Spark data to Kafka seamlessly

Spark (http://sparkjava.com/) support for Swagger (https://swagger.io/)

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

RabbitMQ-backed microservices supporting RPC, pubsub, automatic service discovery and scaling with no code changes.

Process Common Crawl data with Python and Spark

A simple Spark TDD example

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

The modular distributed fingerprinting engine

Distributed Java game server, including cluster management server, gateway server, hall server, game logic server, background monitoring server and a running web version of fishing. State machine, behavior tree, A* pathfinding, navigation mesh and other AI tools

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

A distributed blog publish system based on IPFS

DEPRECATED version of Mysterium dVPN app. Please look at mysterium-vpn-desktop instead.

Parquet file generator

Web-based Cloud Gaming service for Retro Game

Sparkling Water provides H2O functionality inside Spark cluster

Firely's open source FHIR server

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

iotalk is a privacy-minded messaging system built on the IOTA Tangle. Messages are encrypted so only the intended recipient can read them.

Open-source IoT Platform - Device management, data collection, processing and visualization.

🐴 The unreliable key-value store

A Spark library for Amazon SageMaker.

A Spark plugin for reading Excel files via Apache POI

MLOps Platform

Java开发者或者大数据开发者面试知识点整理

🚀构建分布式即时聊天、消息推送系统。 Building distributed instant messaging, push notification systems.