All Projects → scholzj → kafka-topic-view

scholzj / kafka-topic-view

Licence: Apache-2.0 license
A simple UI for monitoring Apache Kafka topics and their state.

Programming Languages

go
31211 projects - #10 most used programming language
javascript
184084 projects - #8 most used programming language
HTML
75241 projects
Dockerfile
14818 projects

Projects that are alternatives of or similar to kafka-topic-view

Kafka Streams Workshop
Stars: ✭ 69 (+305.88%)
Mutual labels:  apache-kafka
Waterdrop
WaterDrop is a standalone Karafka component library for generating Kafka messages
Stars: ✭ 136 (+700%)
Mutual labels:  apache-kafka
Apachekafkatutorials
Example Code for Kafka Tutorials @ Learning Journal
Stars: ✭ 155 (+811.76%)
Mutual labels:  apache-kafka
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (+505.88%)
Mutual labels:  apache-kafka
Azure Event Hubs For Kafka
Azure Event Hubs for Apache Kafka Ecosystems
Stars: ✭ 124 (+629.41%)
Mutual labels:  apache-kafka
Docker Kafka
Apache Kafka on Docker
Stars: ✭ 143 (+741.18%)
Mutual labels:  apache-kafka
Kattlo Cli
Kattlo CLI Project
Stars: ✭ 58 (+241.18%)
Mutual labels:  apache-kafka
Cp All In One
docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud
Stars: ✭ 239 (+1305.88%)
Mutual labels:  apache-kafka
Kafka Notebook
The Internals of Apache Kafka
Stars: ✭ 124 (+629.41%)
Mutual labels:  apache-kafka
Azkarra Streams
🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.
Stars: ✭ 146 (+758.82%)
Mutual labels:  apache-kafka
Akka Stream Eventsourcing
Event sourcing for Akka Streams
Stars: ✭ 105 (+517.65%)
Mutual labels:  apache-kafka
Slimmessagebus
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
Stars: ✭ 120 (+605.88%)
Mutual labels:  apache-kafka
Oryx
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Stars: ✭ 1,785 (+10400%)
Mutual labels:  apache-kafka
Karafka
Framework for Apache Kafka based Ruby and Rails applications development.
Stars: ✭ 1,223 (+7094.12%)
Mutual labels:  apache-kafka
Kop
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Stars: ✭ 159 (+835.29%)
Mutual labels:  apache-kafka
Pico
Object Detection and Analysis Made easy using Raspberry Pi, Apache Kafka, AWS Rekognition & Docker
Stars: ✭ 63 (+270.59%)
Mutual labels:  apache-kafka
Go Notify
An email automation solution, written in Golang.
Stars: ✭ 143 (+741.18%)
Mutual labels:  apache-kafka
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (+1252.94%)
Mutual labels:  apache-kafka
Kafkactl
Command Line Tool for managing Apache Kafka
Stars: ✭ 177 (+941.18%)
Mutual labels:  apache-kafka
Kafka Tutorials
Kafka Tutorials microsite
Stars: ✭ 144 (+747.06%)
Mutual labels:  apache-kafka

Kafka Topic View

Kafka Topic View is a simple UI for monitoring Kafka topics and their state. It lists all Kafka brokers, and the partitions assigned to them. The partitions are listed as squares with colors from green (the partitions is in good shape) to red (the partition is under-replicated or offline). When you hover over the partition square, a tooltip shows the details of the partition.

Kafka Topic View screenshot

TODO

  • Configure refresh interval in the UI
  • Add SASL support
  • Better logging
  • CI build

Usage

Locally

Run the binary and use the configuration options to configure where it listens and how it connects to Kafka:

Option Description Default
--listen-addr The address where the HTTP Server runs 0.0.0.0:8080
--fetch-interval The interval at which to fetch the new topic data (default 1m0s) 1m0s
--bootstrap-server Comma separate list of Kafka Brokers to connect to
--kafka-version Version of the Kafka cluster 2.5.0
--tls-ca-file File with the CA certificate for server authentication
--tls-cert-file File with the client certificate for client authentication
--tls-insecure-skip-verify Skip TLS verification when connecting to the Kafka brokers. Use at your own risk!
--tls-key-file File with the key for client authentication
--verbose Turn on verbose logging false
--sarama-verbose Turn on verbose logging int he Sarama Kafka client false

In Kubernetes with Strimzi

Edit the deployment-strimzi.yaml file to match your Strimzi cluster setup (secret names, cluster name, bootstrap servers etc.) and deploy it to Kubernetes:

kubectl apply -f deployment-strimzi.yaml

Use kubectl proxy or kubectl port-forward to access the UI.

Build

Build the Golang backend first:

go build

If needed, build also the container with the backend and UI:

docker build -t <org>/<image>:<tag> ./
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].