vdesabou / Kafka Docker Playground
Playground for Kafka/Confluent Docker experimentations
Stars: ✭ 140
Programming Languages
shell
77523 projects
Labels
Projects that are alternatives of or similar to Kafka Docker Playground
Kafka Connect Elasticsearch Source
Kafka Connect Elasticsearch Source
Stars: ✭ 22 (-84.29%)
Mutual labels: kafka, kafka-connect
Kafka Connect Protobuf Converter
Protobuf converter plugin for Kafka Connect
Stars: ✭ 79 (-43.57%)
Mutual labels: kafka, kafka-connect
Kafka Connect Elastic Sink
Kafka connect Elastic sink connector, with just in time index/delete behaviour.
Stars: ✭ 23 (-83.57%)
Mutual labels: kafka, kafka-connect
Stream Reactor
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Stars: ✭ 753 (+437.86%)
Mutual labels: kafka, kafka-connect
Kafka Connect
equivalent to kafka-connect 🔧 for nodejs ✨🐢🚀✨
Stars: ✭ 102 (-27.14%)
Mutual labels: kafka, kafka-connect
Demo Scene
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Stars: ✭ 806 (+475.71%)
Mutual labels: kafka, kafka-connect
Ksql
The database purpose-built for stream processing applications.
Stars: ✭ 4,668 (+3234.29%)
Mutual labels: kafka, kafka-connect
Streamx
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-31.43%)
Mutual labels: kafka, kafka-connect
Dataengineeringproject
Example end to end data engineering project.
Stars: ✭ 82 (-41.43%)
Mutual labels: kafka, kafka-connect
Kafka Connect Elasticsearch
Kafka Connect Elasticsearch connector
Stars: ✭ 550 (+292.86%)
Mutual labels: kafka, kafka-connect
Debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Stars: ✭ 5,937 (+4140.71%)
Mutual labels: kafka, kafka-connect
Kafkacenter
KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.
Stars: ✭ 896 (+540%)
Mutual labels: kafka, kafka-connect
All Things Cqrs
Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.
Stars: ✭ 474 (+238.57%)
Mutual labels: kafka, kafka-connect
Cp Docker Images
[DEPRECATED] Docker images for Confluent Platform.
Stars: ✭ 975 (+596.43%)
Mutual labels: kafka, kafka-connect
Kafka Connect Github Source
Get a stream of issues and pull requests for your chosen GitHub repository
Stars: ✭ 327 (+133.57%)
Mutual labels: kafka, kafka-connect
Kafka Connect Ui
Web tool for Kafka Connect |
Stars: ✭ 388 (+177.14%)
Mutual labels: kafka, kafka-connect
Kspp
A high performance/ real-time C++ Kafka streams framework (C++17)
Stars: ✭ 80 (-42.86%)
Mutual labels: kafka, kafka-connect
kafka-docker-playground 
Playground for Kafka/Confluent Docker experimentations...
ℹ️ How to run
Table of Contents
- 🔗 Kafka Connectors
- ☁️ Confluent Cloud
- 🔄 Confluent Replicator and Mirror Maker 2
- 🔐 Environments
- Confluent Commercial
- CP-Ansible Playground
- 👾 Other Playgrounds
- 📚 Useful Resources
🔗 Kafka Connectors
Quick start examples from Confluent docs but in Docker version for ease of use.
| Connector | Product Category | Latest Version (*) | Type | Release Date | CP 6.1.0 CI latest results | CP 6.0.2 CI latest results | CP 5.5.3 CI latest results |
|---|---|---|---|---|---|---|---|
 ActiveMQ Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
ActiveMQ Source
|
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Amazon CloudWatch Logs Source
|
Analytics | 1.1.0 | Confluent Subscription | 2021-01-06 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Amazon CloudWatch Metrics Sink
|
Analytics | 1.1.3 | Confluent Subscription | 2021-01-04 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Amazon DynamoDB Sink
|
Database | 1.1.4 | Confluent Subscription | 2020-12-01 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Amazon Kinesis Source
|
Message Queue | 1.3.3 | Confluent Subscription | 2021-02-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Amazon Redshift Sink
|
Data Warehouse | 1.0.5 | Confluent Subscription | 2021-02-22 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
|
Amazon Redshift Source (using JDBC) |
Data Warehouse | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Amazon S3 Sink
|
Datastore | 10.0.0 | Confluent Community License | 2021-03-03 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Amazon S3 Source
|
Datastore | 1.4.3 | Confluent Subscription | 2021-02-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Amazon SQS Source
|
Message Queue | 1.1.1 | Confluent Subscription | 2021-01-30 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 AMPS Source
|
Message Queue | 1.0.0-preview | Confluent Subscription | 2020-07-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Apache Kudu Source
|
Database | 1.0.2 | Confluent Subscription | 2021-03-12 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Apache Kudu Sink
|
Database | 1.0.2 | Confluent Subscription | 2021-03-12 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 AWS Lambda Sink
|
SaaS Apps | 1.1.1 | Confluent Subscription | 2021-01-07 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Azure Blob Storage Sink
|
Datastore | 1.6.1 | Confluent Subscription | 2021-02-10 | 👍 2021-03-19 | ❌ | 👍 2021-03-20 |
|
Azure Blob Storage Source
|
Datastore | 1.4.3 | Confluent Subscription | 2021-02-08 | ❌ | ❌ | 👍 2021-03-19 |
 Azure Data Lake Storage Gen1 Sink
|
Datastore | 1.6.1 | Confluent Subscription | 2021-02-10 | 👍 2021-03-19 | 👍 2021-03-20 | 👍 2021-03-19 |
|
Azure Data Lake Storage Gen2 Sink
|
Datastore | 1.6.1 | Confluent Subscription | 2021-02-10 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Azure Event Hubs Source
|
Message Queue | 1.2.0 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Azure Functions Sink
|
SaaS Apps | 1.0.9 | Confluent Subscription | 2021-02-09 | 👍 2021-03-19 | ❌ | 👍 2021-03-20 |
 Azure Search Sink
|
Analytics | 1.0.4 | Confluent Subscription | 2021-02-03 | 👍 2021-03-19 | 👍 2021-03-20 | 👍 2021-03-19 |
 Azure Service Bus Source
|
Message Queue | 1.1.3 | Confluent Subscription | 2021-01-29 | ❌ | 👍 2021-03-19 | 👍 2021-03-20 |
 Azure SQL Data Warehouse Sink
|
Data Warehouse | 1.0.4 | Confluent Subscription | 2020-10-08 | 👍 2021-03-19 | ❌ | ❌ |
 Cassandra Sink
|
Database | 2.0.0 | Confluent Subscription | 2020-12-04 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Couchbase Sink
|
Database | 3.4.8 | Open Source (Couchbase) | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 | |
|
Couchbase Source
|
Database | 3.4.8 | Open Source (Couchbase) | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 | |
 Debezium CDC Microsoft SQL Server Source
|
CDC | 1.4.0 | Open Source (Debezium Community) | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 | |
 Debezium CDC MySQL Source
|
CDC | 1.4.0 | Open Source (Debezium Community) | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 | |
 Debezium CDC PostgreSQL Source
|
CDC | 1.4.0 | Open Source (Debezium Community) | 👍 2021-03-19 | 👍 2021-03-19 | ❌ | |
 Debezium CDC MongoDB Source
|
CDC | 1.4.0 | Open Source (Debezium Community) | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 | |
 Data Diode Sink
|
Logs | 1.1.1 | Confluent Subscription | 2019-10-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Data Diode Source
|
Logs | 1.1.1 | Confluent Subscription | 2019-10-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Datadog Metrics Sink
|
Analytics | 1.1.3 | Confluent Subscription | 2021-01-04 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 ElasticSearch Sink
|
Analytics | 11.0.3 | Confluent Community License | 2021-03-12 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 FTPS Sink
|
Datastore | 1.0.3-preview | Confluent Subscription | 2020-10-01 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
FTPS Source
|
Datastore | 1.0.3-preview | Confluent Subscription | 2020-10-01 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Gemfire Sink
|
Database | 1.0.6 | Confluent Subscription | 2021-03-09 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Github Source
|
SaaS Apps | 1.0.4 | Confluent Subscription | 2021-03-09 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Google BigQuery Sink
|
Data Warehouse | 2.1.0 | Open Source (WePay) | 2021-02-11 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Google Cloud BigTable Sink
|
Database | 1.0.7 | Confluent Subscription | 2021-03-05 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Google Cloud Functions Sink
|
SaaS Apps | 1.1.3 | Confluent Subscription | 2021-02-09 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Google Cloud Pub/Sub Source
|
Message Queue | 1.0.6 | Confluent Subscription | 2021-01-16 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Google Cloud Spanner Sink
|
Database | 1.0.5 | Confluent Subscription | 2021-03-11 | ❌ | ❌ | ❌ |
 Google Cloud Storage Sink
|
Datastore | 5.5.5 | Confluent Subscription | 2020-12-29 | 👍 2021-03-20 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Google Cloud Storage Source
|
Datastore | 1.4.3 | Confluent Subscription | 2021-02-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Google Firebase Realtime Database Sink
|
Database | 1.2.0 | Confluent Subscription | 2020-12-01 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Google Firebase Realtime Database Source
|
Database | 1.2.0 | Confluent Subscription | 2020-12-01 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 HBase Sink
|
Database | 1.0.7 | Confluent Subscription | 2021-03-05 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 HDFS 2 Source
|
Datastore | 1.4.3 | Confluent Subscription | 2021-02-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
HDFS 3 Source
|
Datastore | 1.4.3 | Confluent Subscription | 2021-02-08 | 👍 2021-03-20 | 👍 2021-03-19 | 👍 2021-03-19 |
|
HDFS 2 Sink
|
Datastore | 10.0.2 | Confluent Community License | 2021-03-15 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
HDFS 3 Sink
|
Datastore | 1.1.1 | Confluent Subscription | 2021-03-08 | 👍 2021-03-20 | 👍 2021-03-19 | 👍 2021-03-19 |
 HTTP Sink
|
SaaS Apps | 1.2.2 | Confluent Subscription | 2021-03-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 IBM MQ Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-20 | 👍 2021-03-20 |
|
IBM MQ Source
|
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-03-19 | 👍 2021-03-20 | 👍 2021-03-20 |
 InfluxDB Sink
|
Database | 1.2.1 | Confluent Subscription | 2020-09-30 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
InfluxDB Source
|
Database | 1.2.1 | Confluent Subscription | 2020-09-30 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JDBC Hive Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC MySQL Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JDBC Oracle 11 Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JDBC Oracle 12 Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC PostGreSQL Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC Microsoft SQL Server Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JDBC Vertica Sink
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC MySQL Source
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC Oracle 11 Source
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC Oracle 12 Source
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC PostGreSQL Source
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JDBC Microsoft SQL Server Source
|
Database | 10.0.2 | Confluent Community License | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JIRA Source
|
SaaS Apps | 1.0.3-preview | Confluent Subscription | 2021-03-02 | 👍 2021-03-19 | 👍 2021-03-19 | ❌ |
|
JMS ActiveMQ Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JMS Solace Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 JMS TIBCO EMS Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
JMS TIBCO EMS Source
|
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Mapr Sink
|
Datastore | 1.1.3 | Confluent Subscription | 2021-03-11 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
 Marketo Source
|
SaaS Apps | 1.0.0-preview | Confluent Subscription | 2020-10-20 | 👍 2021-03-19 | 👍 2021-03-20 | 👍 2021-03-19 |
 Minio Sink
|
Datastore | 10.0.0 | Confluent Community License | 2021-03-03 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
MongoDB Sink
|
Database | 1.2.0 | Open Source (MongoDB) | 2020-07-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
MongoDB Source
|
Database | 1.2.0 | Open Source (MongoDB) | 2020-07-08 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 MQTT Sink
|
IoT | 1.4.0 | Confluent Subscription | 2020-10-29 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
MQTT Source
|
IoT | 1.4.0 | Confluent Subscription | 2020-10-29 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Neo4j Sink
|
Database | 1.0.9 | Open Source (Neo4j, Inc.) | 2020-09-02 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 OmniSci Sink
|
Database | 1.0.2 | Confluent Subscription | 2019-08-20 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Oracle CDC
|
Database | 1.0.5 | Confluent Subscription | 2021-03-09 | ❌ | ❌ | ❌ |
 PagerDuty Sink
|
SaaS Apps | 1.0.2 | Confluent Subscription | 2020-11-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Prometheus Sink
|
Analytics | 1.1.3-preview | Confluent Subscription | 2021-01-04 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 RabbitMQ Sink
|
Message Queue | 1.5.0 | Confluent Subscription | 2021-03-04 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
RabbitMQ Source
|
Message Queue | 1.5.0 | Confluent Subscription | 2021-03-04 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Redis Sink
|
Database | 0.0.2.11 | Open Source (Jeremy Custenborder) | 2020-01-22 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 SalesForce Bulk API Sink
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SalesForce Bulk API Source
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SalesForce CDC Source
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SalesForce Platform Events Sink
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SalesForce Platform Events Source
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SalesForce PushTopics Source
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SalesForce SObject Sink
|
SaaS Apps | 1.8.0 | Confluent Subscription | 2021-03-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 ServiceNow Sink
|
SaaS Apps | 2.0.3 | Confluent Subscription | 2020-12-09 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
|
ServiceNow Source
|
SaaS Apps | 2.0.3 | Confluent Subscription | 2020-12-09 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
 SFTP Sink
|
Datastore | 2.2.4 | Confluent Subscription | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
SFTP Source
|
Datastore | 2.2.4 | Confluent Subscription | 2021-02-23 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 SNMP Trap Source
|
IoT | 1.1.2 | Confluent Subscription | 2020-04-09 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Snowflake Sink
|
Data Warehouse | 1.5.2 | Open Source (Snowflake, Inc.) | 2021-02-01 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Solace Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Solace Source
|
Message Queue | 1.2.0 | Confluent Subscription | 2020-08-26 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Splunk Sink
|
Analytics | 2.0.2 | Open Source (Splunk) | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 | |
|
Splunk Source
|
Analytics | 1.0.3 | Confluent Subscription | 2020-11-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Spool Dir Source
|
Datastore | 2.0.60 | Open Source (Jeremy Custenborder) | 2021-02-14 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Syslog Source
|
Logs | 1.3.2 | Confluent Subscription | 2020-11-03 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
TIBCO EMS Sink
|
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
TIBCO EMS Source
|
Message Queue | 1.2.0 | Confluent Subscription | 2020-08-26 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
|
Vertica Sink
|
Database | 1.2.5 | Confluent Subscription | 2021-02-18 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
 Zendesk Source
|
SaaS Apps | 1.0.6 | Confluent Subscription | 2021-03-09 | 👍 2021-03-19 | 👍 2021-03-19 | 👍 2021-03-19 |
* You can change default connector version by setting CONNECTOR_TAG environment variable before starting a test, get more details here
☁️ Confluent Cloud
Confluent Cloud Demo
- How to connect your components to Confluent Cloud
- How to monitor your Confluent Cloud cluster
- How to restrict access
- etc...
🔗 Kafka Connectors connected to Confluent Cloud
-
AWS Kinesis source -
ServiceNow source -
ServiceNow sink
-
MongoDB source -
Firebase
Other
- Using cp-ansible with Confluent Cloud
- Using cp-helm-charts with Confluent Cloud
- Using confluent operator with Confluent Cloud
- Demo using dabz/ccloudexporter in order to pull Metrics API data from Confluent Cloud cluster and export it to Prometheus (Grafana dashboard is also available)
-
.NET client (producer/consumer) -
Go client (producer/consumer) -
kafka-admin Managing topics and ACLs using matt-mangia/kafka-admin
-
Confluent Replicator OnPrem to cloud and Cloud to Cloud examples
-
- Confluent REST Proxy Security Plugin with Principal Propagation
- Confluent Schema Registry Security Plugin
- Migrate Schemas to Confluent Cloud using Confluent Replicator
- Confluent Cloud Networking using HAProxy
🔄 Confluent Replicator and Mirror Maker 2
Using Multi-Data-Center setup with US 🇺🇸 and EUROPE 🇪🇺 clusters.
-
Using Confluent Replicator as connector
- Using PLAINTEXT
- Using SASL_PLAIN
- Using Kerberos
- 👾 Using Confluent Replicator as executable
- Using PLAINTEXT
- Using SASL_PLAIN
- Using Kerberos
-
Using Mirror Maker 2
- Using PLAINTEXT
🔐 Environments
Single cluster:
- PLAINTEXT: no security
- SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
- SASL/SCRAM no SSL encryption, SASL/SCRAM-SHA-256 authentication
- SASL_SSL: SSL encryption, SASL/PLAIN authentication
- 2WAY_SSL: SSL encryption, SSL authentication
- Kerberos: no SSL encryption, Kerberos GSSAPI authentication
- SSL_Kerberos SSL encryption, Kerberos GSSAPI authentication
- LDAP Authorizer with SASL/PLAIN no SSL encryption, SASL/PLAIN authentication, LDAP Authorizer for ACL authorization
- RBAC with SASL/PLAIN RBAC with no SSL encryption, SASL/PLAIN authentication
Multi-Data-Center setup:
- PLAINTEXT: no security
- SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
- Kerberos: no SSL encryption, Kerberos GSSAPI authentication
Confluent Commercial
- Control Center
- Tiered Storage
- Tiered storage with AWS S3
- Tiered storage with Minio (unsupported)
- Confluent Rebalancer
- JMS Client
- RBAC with SASL/PLAIN RBAC with no SSL encryption, SASL/PLAIN authentication
- Audit Logs
- Confluent REST Proxy Security Plugin with SASL_SSL and 2WAY_SSL Principal Propagation
CP-Ansible Playground
Easily play with Confluent Platform Ansible playbooks by using Ubuntu based Docker images generated daily from this cp-ansible-playground repository
There is also a Confluent Cloud version available here
👾 Other Playgrounds
- Confluent Replicator [also with SASL_SSL and 2WAY_SSL]
- Testing Separate principals (
connector.client.config.override.policy) for Source connector (SFTP source) - Testing Separate principals (
connector.client.config.override.policy) for Source connector (SFTP sink) - How to write logs to files when using docker-compose
- Publish logs to kafka with Elastic Filebeat
-
.NET basic producer
-
Monitor Confluent Platform with Datadog
📚 Useful Resources
- A Kafka Story 📖: A step by step guide to use Kafka ecosystem (Kafka Connect, KSQL, Java Consumers/Producers, etc..) with Docker
- Kafka Boom Boom 💥: An attempt to break kafka
- Kafka Security playbook 🔒: demonstrates various security configurations with Docker
- MDC and single views 🌍: Multi-Data-Center setup using Confluent Replicator
- Kafka Platform Prometheus 📊: Simple demo of how to monitor Kafka Platform using Prometheus and Grafana.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].