932 Open source projects that are alternatives of or similar to Kafka Connect Elastic Sink

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

Web tool for Kafka Connect |

Example end to end data engineering project.

Kafka Connect Elasticsearch Source

👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

Kafka Connect Elasticsearch connector

KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.

Java生态研究(Spring Boot + Redis + Dubbo + RocketMQ + Elasticsearch)🔥🔥🔥🔥🔥

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

A search framework and multi-tenant search platform based on java, kafka, kafka connect, elasticsearch

Collection of Kubernetes Operators built with KUDO.

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

A REPL for Apache Kafka

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

🦄 开源社区系统：基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

深圳地铁大数据客流分析系统🚇🚄🌟

Kafka Connect Tooling

Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

syncClient，数据实时同步中间件（同步mysql到kafka、redis、elasticsearch、httpmq）！

Open-Source Web GUI for Apache Kafka Management

基于Gradle构建，使用SpringBoot在各个场景的应用，包括集成消息中间件、前后端分离、数据库、缓存、分布式锁、分布式事务等

Kafka Source Connector For Oracle

Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻

【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch

A high performance/ real-time C++ Kafka streams framework (C++17)

springboot和dubbo、netty的集成，redis mongodb的nosql模板， kafka rocketmq rabbit的MQ模板， solr solrcloud elasticsearch查询引擎

Protobuf converter plugin for Kafka Connect

a Rocket-fast SYStem for LOG processing

Spring Boot 2.x code examples

一个仿照牛客网实现的讨论社区，不仅实现了基本的注册，登录，发帖，评论，点赞，回复功能，同时使用前缀树实现敏感词过滤，使用wkhtmltopdf生成长图和pdf，实现网站UV和DAU统计，并将用户头像等信息存于七牛云服务器。

Samsara is a real-time analytics platform

Bro IDS Dockerfile

Playground for Kafka/Confluent Docker experimentations

PG数据同步工具（Java实现）

Mirus is a cross data-center data replication tool for Apache Kafka

MongoDB Kafka Connector

Golang app to read records from a set of kafka topics and write them to an elasticsearch cluster

Spring Boot 学习教程

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Apache Kafka running on Kubernetes

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能

Get a stream of issues and pull requests for your chosen GitHub repository

Ansible playbooks for the Confluent Platform

amazonriver 是一个将postgresql的实时数据同步到es或kafka的服务

Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.

用java实现一下Logstash的几个常用input/filter/output, 希望能有效率上面的大提升. 现在我们迁移到golang了 https://github.com/childe/gohangout

golang版本的hangout, 希望能省些内存. 使用了自己写的Kafka lib .. 虚. 不过我们在生产环境已经使用近1年, kafka 版本从0.9.0.1到2.0都在使用, 目前情况稳定. 吞吐量在每天2000亿条以上.

The database purpose-built for stream processing applications.

Flume NG Canal source

Kattlo CLI Project

Serverless Platform for the stateful services

🎉🎉🎉JAVA高级架构师技术栈==任何技能通过 “刻意练习” 都可以达到融会贯通的境界，就像烹饪一样，这里有一份JAVA开发技术手册，只需要增加自己练习的次数。🏃🏃🏃

程序员进阶书籍（视频），持续更新（Programmer Books）

🐂基于springcloud +dubbo构建的模拟秒杀项目，模块化设计，集成了分库分表、elasticsearch🔍、gateway、mybatis-plus、spring-session等常用开源组件