1206 Open source projects that are alternatives of or similar to Distributed Dataset

R interface for Apache Spark

Some class materials for a data processing course using PySpark

Ruby wrapper for Apache Spark

Apache Spark on AWS Lambda

Realtime calculation distributed system. AKA distributed lodash

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

extremely distributed machine learning

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

When Apache Pulsar meets Apache Spark

Build stateful and portable serverless applications without thinking about infrastructure.

A serverless web chat built using AWS Lambda, AWS IoT (for WebSockets) and Amazon DynamoDB

Perform deep neural network based face detection and recognition in the cloud (via AWS lambda) with zero model configuration or tuning.

a nodejs simple aws athena client

PROJECT HAS BEEN SHUTDOWN - Publish and render markdown essays to and from ipfs

Serverless image optimizer for S3, Lambda, and Cloudfront

The world's most advanced open source instant messaging engine for 100K~10M concurrent users https://turms-im.github.io/docs

Telegram Bot using AWS API Gateway and AWS Lambda

🐴 The unreliable key-value store

a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

Amazon Kinesis Streams fan-out via Kinesis Analytics (powered by the Serverless Framework)

Micro is a distributed cloud operating system

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Predict the Power Production of a solar panel farm from Weather Measurements using Machine Learning

A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.

A Pi Zero and Motion based webcamera that forwards images to Amazon Web Services for Image Processing

A Scala kernel for Jupyter

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Web-based Cloud Gaming service for Retro Game

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

⚡ Serverless Framework – Build web, mobile and IoT applications with serverless architectures using AWS Lambda, Azure Functions, Google CloudFunctions & more! –

lambroll is a minimal deployment tool for AWS Lambda.

Spark Terasort

Relation Extraction using Deep learning(CNN)

AWS Lambda image processor

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

FFM (Field-Awared Factorization Machine) on Spark

Distributed SQL database in Rust, written as a learning project

🐍 Quick reference guide to common patterns & functions in PySpark.

a diaspora* client for Android

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

[Maintenance mode] Serverless Status Page System

Raspberry Pi Kubernetes cluster that runs HA/HP Drupal 8

Source code for James Lee's Aparch Spark with Java course

Pluggable foundation blocks for building distributed apps.

Run JAX-RS applications on AWS Lambda using Jersey. Supports Spring 4.x. The serverless framework can be used for deployment.

PhantomJS/Node.js web scraper for AWS Lambda

A sample authentication service implemented with a server-less architecture, using AWS Lambda to host and execute the code and Amazon DynamoDB as persistent storage. This provides a cost-efficient solution that is scalable and highly available and can be used with Amazon Cognito for Developer Authenticated Identities.

Render React.js on-demand with CDN caching

spark summit 2017 SanFrancisco

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Extract Transform Load for Python 3.5+

Alexa Skills Kit Command Line Interface

🔧 Use dplyr to analyze Big Data 🐘

Concurrent and multi-stage data ingestion and data processing with Elixir

C Pixels-based graphical audio synthesizer implemented as a WebSocket server

Hazelcast IMDG Python Client