confluentinc / Demo Scene
Licence: apache-2.0
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Stars: ✭ 806
Programming Languages
shell
77523 projects
Projects that are alternatives of or similar to Demo Scene
Javakeeper
✍️ Java 工程师必备架构体系知识总结:涵盖分布式、微服务、RPC等互联网公司常用架构,以及数据存储、缓存、搜索等必备技能
Stars: ✭ 502 (-37.72%)
Mutual labels: kafka, mysql, elasticsearch
Operators
Collection of Kubernetes Operators built with KUDO.
Stars: ✭ 175 (-78.29%)
Mutual labels: kafka, mysql, elasticsearch
Spring Boot 2.x Examples
Spring Boot 2.x code examples
Stars: ✭ 104 (-87.1%)
Mutual labels: kafka, mysql, elasticsearch
Books Recommendation
程序员进阶书籍(视频),持续更新(Programmer Books)
Stars: ✭ 558 (-30.77%)
Mutual labels: kafka, mysql, elasticsearch
Kafka Connect Ui
Web tool for Kafka Connect |
Stars: ✭ 388 (-51.86%)
Mutual labels: kafka, kafka-connect, elasticsearch
Rsyslog
a Rocket-fast SYStem for LOG processing
Stars: ✭ 1,385 (+71.84%)
Mutual labels: kafka, elasticsearch, syslog
Echo
🦄 开源社区系统:基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。
Stars: ✭ 129 (-84%)
Mutual labels: kafka, mysql, elasticsearch
Kspp
A high performance/ real-time C++ Kafka streams framework (C++17)
Stars: ✭ 80 (-90.07%)
Mutual labels: kafka, kafka-streams, kafka-connect
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (-71.46%)
Mutual labels: kafka, kafka-streams, kafka-connect
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Stars: ✭ 204 (-74.69%)
Mutual labels: kafka, kafka-streams, kafka-connect
Kafka Connect Elasticsearch
Kafka Connect Elasticsearch connector
Stars: ✭ 550 (-31.76%)
Mutual labels: kafka, kafka-connect, elasticsearch
Cookbook
🎉🎉🎉JAVA高级架构师技术栈==任何技能通过 “刻意练习” 都可以达到融会贯通的境界,就像烹饪一样,这里有一份JAVA开发技术手册,只需要增加自己练习的次数。🏃🏃🏃
Stars: ✭ 428 (-46.9%)
Mutual labels: kafka, mysql, elasticsearch
Logisland
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Stars: ✭ 97 (-87.97%)
Mutual labels: kafka, kafka-streams, elasticsearch
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (-87.22%)
Mutual labels: kafka, kafka-streams, kafka-connect
Dataengineeringproject
Example end to end data engineering project.
Stars: ✭ 82 (-89.83%)
Mutual labels: kafka, kafka-connect, elasticsearch
Flink Learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Stars: ✭ 11,378 (+1311.66%)
Mutual labels: kafka, mysql, elasticsearch
Flume Canal Source
Flume NG Canal source
Stars: ✭ 56 (-93.05%)
Mutual labels: kafka, mysql, elasticsearch
Strimzi Kafka Operator
Apache Kafka running on Kubernetes
Stars: ✭ 2,833 (+251.49%)
Mutual labels: kafka, kafka-streams, kafka-connect
Gnomock
Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻
Stars: ✭ 398 (-50.62%)
Mutual labels: kafka, mysql, elasticsearch
Scripts and samples to support Confluent Platform talks. May be rough around the edges. For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Requirements
You need to allocate Docker 8GB when running these. Avoid allocating all your machine's cores to Docker as this may cause the machine to become unresponsive when running large stacks. On a four-core Mac Book two cores for Docker should be fine.
Contents
-
Applications
-
Data pipelines (Database + KSQL + Elasticsearch)
- Pipeline to the cloud - on-premises RDBMS to Cloud datawarehouse e.g. Snowflake (✍️ blog)
- Rail data streaming pipeline (🗣️talk)
- Apache Kafka and KSQL in Action: Let’s Build a Streaming Data Pipeline! (🗣️talk)
- MySQL / Debezium CDC / KSQL / Elasticsearch
- Oracle CDC / KSQL / Elasticsearch
- Postgres / Debezium CDC / KSQL / Elasticsearch
- CDC demo with MySQL (🗣️talk)
- CDC demo with Oracle
- Building data pipelines with Confluent Cloud and GCP (BigQuery, GCS, etc)
- MS SQL with Debezium and ksqlDB (✍️ blog)
-
ksqlDB (previously known as KSQL)
- Introduction to ksqlDB 01 (🗣️talk)
- Introduction to KSQL 02
- Using Twitter data with ksqlDB
- KSQL UDF Advanced Example
- KSQL Troubleshooting
- ATM Fraud detection with Kafka and KSQL (🗣️talk)
- Kafka Streams/KSQL Movie Demo
- KSQL MQTT demo
- KSQL Dump Utility
- KSQL workshop (more recent version is here)
- Multi-node ksqlDB and Kafka Connect clusters
-
Kafka Connect
- From Zero to Hero with Kafka Connect (🗣️talk)
- Kafka Connect Converters and Serialization (✍️ blog)
- Building a Kafka Connect cluster
- Kafka Connect error handling (✍️ blog)
- Multi-node ksqlDB and Kafka Connect clusters
- Specific connectors
- 👉 S3 Sink (🎥 tutorial)
- 👉 Database (tutorial 🎥 1 / 🎥 2)
- 👉 Elasticsearch (🎥 Tutorial)
- Kafka Connect JDBC Source demo environment (✍️ blog)
- InfluxDB & Kafka Connect (✍️ blog)
- RabbitMQ into Kafka (✍️ blog)
- MQTT Connect Connector Demo
- Example Kafka Connect syslog configuration and Docker Compose (see blog series 1/2/3 and standalone articles here and here)
- Azure SQL Data Warehouse Connector Sink Demo
- IBM MQ Connect Connector Demo
- Solace Sink/Source Demo
- RSS feed into Kafka
-
Confluent Cloud
-
Confluent Platform
-
Misc
-
Hacky export/import between Kafka clusters using
kafkacat
- Docker Compose for just the community licensed components of Confluent Platform
- Topic Tailer, stream topics to the browser using websockets
- KPay payment processing example
- Industry themes (e.g. banking Next Best Offer)
- Distributed tracing
- Analysing Sonos data in Kafka (✍️ blog)
- Analysing Wi-Fi pcap data with Kafka
- Twitter streams and Operator
-
Hacky export/import between Kafka clusters using
Feedback & Questions
Raise an issue on this github project, or head to http://cnfl.io/slack and join our Community Slack group.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].