All Projects → lensesio → Kafka Connect Ui

lensesio / Kafka Connect Ui

Licence: other
Web tool for Kafka Connect |

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Kafka Connect Ui

Stream Reactor
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Stars: ✭ 753 (+94.07%)
Mutual labels:  kafka, kafka-connect, redis, elasticsearch, influxdb, cassandra, mqtt
Dataengineeringproject
Example end to end data engineering project.
Stars: ✭ 82 (-78.87%)
Mutual labels:  s3, kafka, kafka-connect, redis, elasticsearch
Firecamp
Serverless Platform for the stateful services
Stars: ✭ 194 (-50%)
Mutual labels:  kafka, redis, elasticsearch, cassandra
Dcos Commons
DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.
Stars: ✭ 162 (-58.25%)
Mutual labels:  kafka, elasticsearch, cassandra, hdfs
Javakeeper
✍️ Java 工程师必备架构体系知识总结:涵盖分布式、微服务、RPC等互联网公司常用架构,以及数据存储、缓存、搜索等必备技能
Stars: ✭ 502 (+29.38%)
Mutual labels:  s3, kafka, redis, elasticsearch
Flink Learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Stars: ✭ 11,378 (+2832.47%)
Mutual labels:  kafka, redis, elasticsearch, influxdb
Haproxy Configs
80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.
Stars: ✭ 106 (-72.68%)
Mutual labels:  redis, elasticsearch, influxdb, cassandra
Nagios Plugins
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
Stars: ✭ 1,000 (+157.73%)
Mutual labels:  kafka, redis, elasticsearch, cassandra
Logisland
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Stars: ✭ 97 (-75%)
Mutual labels:  kafka, elasticsearch, influxdb, cassandra
Juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Stars: ✭ 4,262 (+998.45%)
Mutual labels:  s3, redis, hdfs
Operators
Collection of Kubernetes Operators built with KUDO.
Stars: ✭ 175 (-54.9%)
Mutual labels:  kafka, redis, elasticsearch
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Stars: ✭ 204 (-47.42%)
Mutual labels:  kafka, kafka-connect, mqtt
Echo
🦄 开源社区系统:基于 SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... 并提供详细的开发文档和配套教程。包含帖子、评论、私信、系统通知、点赞、关注、搜索、用户设置、数据统计等模块。
Stars: ✭ 129 (-66.75%)
Mutual labels:  kafka, redis, elasticsearch
Gimel
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (-44.33%)
Mutual labels:  kafka, elasticsearch, cassandra
Ksql Udf Deep Learning Mqtt Iot
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
Stars: ✭ 219 (-43.56%)
Mutual labels:  kafka, kafka-connect, mqtt
Syncclient
syncClient,数据实时同步中间件(同步mysql到kafka、redis、elasticsearch、httpmq)!
Stars: ✭ 227 (-41.49%)
Mutual labels:  kafka, redis, elasticsearch
Spring Boot 2.x Examples
Spring Boot 2.x code examples
Stars: ✭ 104 (-73.2%)
Mutual labels:  kafka, redis, elasticsearch
Springboot Learning
基于Gradle构建,使用SpringBoot在各个场景的应用,包括集成消息中间件、前后端分离、数据库、缓存、分布式锁、分布式事务等
Stars: ✭ 340 (-12.37%)
Mutual labels:  kafka, redis, elasticsearch
Streamx
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-75.26%)
Mutual labels:  s3, kafka, kafka-connect
Kafka Connect Storage Cloud
Kafka Connect suite of connectors for Cloud storage (Amazon S3)
Stars: ✭ 153 (-60.57%)
Mutual labels:  s3, kafka, kafka-connect

kafka-connect-ui

release docker Join the chat at https://gitter.im/Landoop/support

This is a web tool for Kafka Connect for setting up and managing connectors for multiple connect clusters.

Live Demo

kafka-connect-ui.demo.lenses.io

Run standalone with docker

docker run --rm -it -p 8000:8000 \
           -e "CONNECT_URL=http://connect.distributed.url" \
           landoop/kafka-connect-ui

The CONNECT_URL can be a comma separated array of Connect worker endpoints. E.g: CONNECT_URL=http://connect.1.url,http://connect.2.url"

Additionally you can assign custom names to your Connect clusters by appending a semicolon and the cluster name after the endpoint URL. E.g:

"CONNECT_URL=http://connect.1.url;dev cluster,http://connect.2.url;production cluster"

Web UI will be available at localhost:8000

Build from source

git clone https://github.com/Landoop/kafka-connect-ui.git
cd kafka-connect-ui
npm install -g bower http-server
npm install
http-server -p 8080 .

Web UI will be available at localhost:8080

Nginx config

If you use nginx to serve this ui, let angular manage routing with

    location / {
        try_files $uri $uri/ /index.html =404;
        root /folder-with-kafka-connect-ui/;
    }

Setup connect clusters

Use multiple Kafka Connect clusters in env.js :

var clusters = [
   {
     NAME:"prod", //unique name is required
     KAFKA_CONNECT: "http://kafka-connect.prod.url", //required
     KAFKA_TOPICS_UI: "http://kafka-topics-ui.url", //optional
     KAFKA_TOPICS_UI_ENABLED: true //optional
     COLOR: "#141414" //optional
   },
   {
     NAME:"dev",
     KAFKA_CONNECT: "http://kafka-connect.dev.url",
     KAFKA_TOPICS_UI_ENABLED: false
   },
   {
     NAME:"local",
     KAFKA_CONNECT: "http://kafka-connect.local.url",
   }
]

  • Use KAFKA_TOPICS_UI and KAFKA_TOPICS_UI_ENABLED to navigate to the relevant topic when you have kafka-topics-ui installed.
  • Use COLOR to set different header colors for each set up cluster.

Supported Connectors

For our 25+ stream-reactor Kafka Connectors we have a template of metadata within the supported-connectors.js. In any case you will be shown all the existing connectors in your classpath with all the required fields to set them up.

Changelog

Here

License

The project is licensed under the BSL license.

Relevant Projects

  • schema-registry-ui, View, create, evolve and manage your Avro Schemas on your Kafka cluster
  • kafka-topics-ui, UI to browse Kafka data and work with Kafka Topics
  • fast-data-dev, Docker for Kafka developers (schema-registry,kafka-rest,zoo,brokers,landoop)
  • Landoop-On-Cloudera, Install and manage your kafka streaming-platform on you Cloudera CDH cluster

www.landoop.com

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].