903 Open source projects that are alternatives of or similar to Registry

StreamLine - Streaming Analytics

Streaming System 相关的论文读物

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.

Dumps state of Storm Kafka consumers

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

大数据生态圈学习

Stream computing platform for bigdata

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

A real time Tweet Trend Map and Sentiment Analysis web application with kafka, Angular, Spring Boot, Flink, Elasticsearch, Kibana, Docker and Kubernetes deployed on the cloud

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Real Time Analytics and Data Pipelines based on Spark Streaming

An umbrella project for multiple implementations of model serving

This repository contains the code base for the Open Stream Processing Benchmark.

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

深圳地铁大数据客流分析系统🚇🚄🌟

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Code and presentation for Strata Model Serving tutorial

Kattlo CLI Project

关于kafka的一些相关使用示例代码。

Spring Boot 2.x code examples

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Confluent Schema Registry for Kafka

大数据入门指南 ⭐

Kafkawize : A Self service Apache Kafka Topic Management tool/portal. A Web application which automates the process of creating and browsing Kafka topics, acls, schemas by introducing roles/authorizations to users of various teams of an org.

Production Ready Data Integration Product, documentation：

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

seatunnel plugin developing examples.

推荐项目（实时推荐和离线推荐）

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Apache Spark and Apache Kafka integration example

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Render database schemas into ER diagrams

Prototype for a Metadata Reflection API for ECMAScript

Spark Structured Streaming / Kafka / Cassandra / Elastic

Apache Kafka load testing "...basically a cloth bag filled with small jagged pieces of scrap iron"

《Kafka技术内幕》代码

Source code for the Kafka Streams in Action Book

Use Kafka as a remote storage database for Prometheus (remote write only)

Kafka web UI

🐳基于 Flink 的商品实时推荐系统。使用了 redis 缓存热点数据。当用户产生评分行为时，数据由 kafka 发送到 flink，根据用户历史评分行为进行实时和离线推荐。实时推荐包括：基于行为和实时热门，离线推荐包括：历史热门、历史优质商品和 itemcf 。

OpenMessaging Benchmark Framework

Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

Interactive GraphQL exploration tool built with React - still working on the website

DynamicsWebApi is a Microsoft Dynamics 365 / Microsoft Dataverse (formerly known as Common Data Service) Web API helper library for JavaScript

Flink sink for Clickhouse

Write your Spark data to Kafka seamlessly

MongoDB Kafka Connector

大数据分析可视化实践