908 Open source projects that are alternatives of or similar to Spark Structured Streaming Examples

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

Apollo graphql subscriptions over Kafka protocol

大数据分析可视化实践

A repository to keep track of all the code that I end up writing for my blog posts.

Julia binding for Apache Spark

Confluent REST Proxy for Kafka

Big Data Toolkit for the JVM

An Hexagonal Architecture with DDD + Aggregates + Event Sourcing using .NET Core, Kafka e MongoDB (Blog Engine)

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Playground for Kafka/Confluent Docker experimentations

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

GeoTrellis for PySpark

Spark、Flink等离线任务的调度以及实时任务的监控

An open-source toolkit for large-scale genomic analysis

Live-coding the cluster!

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Syslog Collector written in Go, streams to Kafka 0.8

Modern and performant Kafka client library for Ruby based on librdkafka

Apache Kafka bridge

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Content for architecting a data science platform for products using Luigi, Spark & Flask.

StreamLine - Streaming Analytics

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Apache Spark on AWS Lambda

Distributed t-SNE via Apache Spark

WaterDrop is a standalone Karafka component library for generating Kafka messages

Node.js bindings for Apache Spark DataFrame APIs

Profile and monitor your ML data pipeline end-to-end

HandySpark - bringing pandas-like capabilities to Spark dataframes

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

Secor is a service implementing Kafka log persistence

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

spark ml 算法原理剖析以及具体的源码实现分析

Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.

Node.js bindings for librdkafka

本人的RabbitMQ和Kafka详细笔记以及示例代码

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

🦄 开源社区系统：基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Apache Cassandra® metrics exporter for Prometheus

Samsara is a real-time analytics platform

Source code for the Kafka Streams in Action Book

A place to keep useful golang functions and small libraries

Cassandra ORM/ODM/OGM for Node.js with optional support for Elassandra & JanusGraph

Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro

Fundamentals of Spark with Python (using PySpark), code examples

Community driven, reusable components for distributed apps

Projects done in the Data Engineering Nanodegree by Udacity.com

Metronome is a distributed and fault-tolerant event scheduler

Confluent's Apache Kafka .NET client

Process Common Crawl data with Python and Spark

This library wraps Kafka's embedded test cluster, allowing you to more easily create and run integration tests using JUnit against a "real" kafka server running within the context of your tests. No need to stand up an external kafka cluster!

An encrypted data analytics platform

🥚 Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

Jupyter kernel for scala and spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Big Data Ecosystem Docker

我,请始皇[打钱]是一个前后端分离的工具人系统，项目采用 SpringBoot+Go+Vue 开发，项目加入常见的企业级应用所涉及到的技术点，例如 Redis、RabbitMQ 等(主要是多用用工具多踩踩坑)。