Top 73 kafka-connect open source projects

Open-Source Web GUI for Apache Kafka Management

Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Apache Kafka running on Kubernetes

Mirus is a cross data-center data replication tool for Apache Kafka

MongoDB Kafka Connector

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Playground for Kafka/Confluent Docker experimentations

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

Kafka Connect connector for reading CSV files into Kafka.

Kafka Connect Tooling

A REPL for Apache Kafka

equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Kafka Connect connector to stream data in real time from Twitter.

Example end to end data engineering project.

A high performance/ real-time C++ Kafka streams framework (C++17)

Protobuf converter plugin for Kafka Connect

Kattlo CLI Project

This repository contains a Kafka Connect source connector for copying data from IBM MQ into Apache Kafka.

[DEPRECATED] Docker images for Confluent Platform.

Kafka connect Elastic sink connector, with just in time index/delete behaviour.

Kafka Connect Elasticsearch Source

KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.

👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/

Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.

Kafka Connect Elasticsearch connector

The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.

The database purpose-built for stream processing applications.

Web tool for Kafka Connect |

Get a stream of issues and pull requests for your chosen GitHub repository

Ansible playbooks for the Confluent Platform

Kafka Source Connector For Oracle

CLI tool and Go client library for the Kafka Connect REST API

Kafka Connector for DynamoDB [unmaintained]

A kafka-connect REST api client for java

🎼 Docker compose files for various kafka stacks

Oracle database CDC (Change Data Capture)

Kryptonite for Kafka is a client-side 🔒 field level 🔓 crypto library for Apache Kafka® currently focused on Kafka Connect scenarios. It's an ! UNOFFICIAL ! community project

Previously used repository for new Debezium modules and connectors in incubation phase (archived)

Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data

🎉 Microservices Observability - Log Aggregation, Distributed Tracking, Metrics

Kafka-Connect SMT (Single Message Transformations) with SQL syntax (Using Apache Calcite for the SQL parsing)

Kafka Connect connector for receiving data and writing data to Splunk.

A Kafka Connect source connector that generates data for tests

A Kafka Connect Source for FTP servers - Monitors files on an FTP server and feeds changes into Kafka

Docker Image for kafka-connect

An avro converter for Kafka Connect without a Schema Registry

Demonstrations for Kafka with Spring Boot

consume maxwell generated message from kafka,export it to another mysql.

A Kafka source connector capturing Scylla CDC changes

Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.

A commandline tool for resetting Kafka Connect source connector offsets.

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

🥑 Kafka connect sink connector for ArangoDB

☁️ nodejs kafka connect connector for Google BigQuery

CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool