2515 Open source projects that are alternatives of or similar to Data Accelerator

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Real Time Analytics and Data Pipelines based on Spark Streaming

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Machine Learning Platform and Recommendation Engine built on Kubernetes

A list about Apache Kafka

C# and F# language binding and extensions to Apache Spark

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

StreamLine - Streaming Analytics

Simple and Distributed Machine Learning

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Apache Spark on AWS Lambda

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Custom state store providers for Apache Spark

Streaming System 相关的论文读物

Open-Source Web GUI for Apache Kafka Management

Kafka Connect HDFS connector

大数据入门指南 ⭐

Fundamentals of Spark with Python (using PySpark), code examples

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

酷玩 Spark: Spark 源代码解析、Spark 类库等

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

A lightweight stream processing library for Go

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

Open-source IoT Platform - Device management, data collection, processing and visualization.

Source code for the Kafka Streams in Action Book

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Apache Spark and Apache Kafka integration example

Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Big Data Toolkit for the JVM

Kafka Tutorials microsite

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

The Internals of Spark SQL

Samsara is a real-time analytics platform

A visual ETL development and debugging tool for big data

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

Sample Event Sourcing implementation with .NET Core

Kafka ecosystem ... but step by step!

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

Streaming reactive and dataflow graphs in Python

Updated repository

🥚 Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

Redpanda is the real-time engine for modern apps. Kafka API Compatible; 10x faster 🚀 See more at vectorized.io/redpanda

Julia binding for Apache Spark

Profile and monitor your ML data pipeline end-to-end

Simple windows desktop application for viewing & querying Apache Parquet files

Tools and Docs on the Azure Data Science Virtual Machine (http://aka.ms/dsvm)