All Projects → triffic-tang → Anotherkafkamonitor Akm

triffic-tang / Anotherkafkamonitor Akm

Another app which used to monitor the progress of Kafka Producer and Consumer

Programming Languages

java
68154 projects - #9 most used programming language

Projects that are alternatives of or similar to Anotherkafkamonitor Akm

Kafka Zk Restapi
Kafka Zookeeper RESTful API to perform topic/consumer group administration/metric(offset\lag\message) collection and monitor
Stars: ✭ 121 (+236.11%)
Mutual labels:  zookeeper, consumer, kafka
Qbusbridge
The Apache Kafka Client SDK
Stars: ✭ 272 (+655.56%)
Mutual labels:  consumer, kafka, kafka-producer
Librdkafka
The Apache Kafka C/C++ library
Stars: ✭ 5,617 (+15502.78%)
Mutual labels:  consumer, kafka, kafka-producer
Sarama Cluster
Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]
Stars: ✭ 969 (+2591.67%)
Mutual labels:  consumer, kafka
God Of Bigdata
专注大数据学习面试,大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
Stars: ✭ 6,008 (+16588.89%)
Mutual labels:  zookeeper, kafka
Java Sourcecode Blogs
Java源码分析 【源码笔记】专注于Java后端系列框架的源码分析,每周持续推出Java后端系列框架的源码分析文章。
Stars: ✭ 448 (+1144.44%)
Mutual labels:  zookeeper, kafka
Zenko
Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.
Stars: ✭ 353 (+880.56%)
Mutual labels:  zookeeper, kafka
Kq
Kafka-based Job Queue for Python
Stars: ✭ 530 (+1372.22%)
Mutual labels:  kafka, kafka-producer
Debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Stars: ✭ 5,937 (+16391.67%)
Mutual labels:  kafka, kafka-producer
Books Recommendation
程序员进阶书籍(视频),持续更新(Programmer Books)
Stars: ✭ 558 (+1450%)
Mutual labels:  zookeeper, kafka
Aidp
weiboAd Infrastructure Data Processor : kafka consumer embedded Lua scripting language in data process framework
Stars: ✭ 20 (-44.44%)
Mutual labels:  consumer, kafka
Cookbook
🎉🎉🎉JAVA高级架构师技术栈==任何技能通过 “刻意练习” 都可以达到融会贯通的境界,就像烹饪一样,这里有一份JAVA开发技术手册,只需要增加自己练习的次数。🏃🏃🏃
Stars: ✭ 428 (+1088.89%)
Mutual labels:  zookeeper, kafka
Gpmall
【咕泡学院实战项目】-基于SpringBoot+Dubbo构建的电商平台-微服务架构、商城、电商、微服务、高并发、kafka、Elasticsearch
Stars: ✭ 4,241 (+11680.56%)
Mutual labels:  zookeeper, kafka
Zerocode
A community-developed, free, open source, microservices API automation and load testing framework built using JUnit core runners for Http REST, SOAP, Security, Database, Kafka and much more. Zerocode Open Source enables you to create, change, orchestrate and maintain your automated test cases declaratively with absolute ease.
Stars: ✭ 482 (+1238.89%)
Mutual labels:  consumer, kafka
Full Stack Notes
全栈工程师手册
Stars: ✭ 366 (+916.67%)
Mutual labels:  zookeeper, kafka
Javakeeper
✍️ Java 工程师必备架构体系知识总结:涵盖分布式、微服务、RPC等互联网公司常用架构,以及数据存储、缓存、搜索等必备技能
Stars: ✭ 502 (+1294.44%)
Mutual labels:  zookeeper, kafka
Sitewhere
SiteWhere is an industrial strength open-source application enablement platform for the Internet of Things (IoT). It provides a multi-tenant microservice-based infrastructure that includes device/asset management, data ingestion, big-data storage, and integration through a modern, scalable architecture. SiteWhere provides REST APIs for all system functionality. SiteWhere provides SDKs for many common device platforms including Android, iOS, Arduino, and any Java-capable platform such as Raspberry Pi rapidly accelerating the speed of innovation.
Stars: ✭ 788 (+2088.89%)
Mutual labels:  zookeeper, kafka
Bigdataguide
大数据学习,从零开始学习大数据,包含大数据学习各阶段学习视频、面试资料
Stars: ✭ 817 (+2169.44%)
Mutual labels:  zookeeper, kafka
Trubka
A CLI tool for Kafka
Stars: ✭ 296 (+722.22%)
Mutual labels:  kafka, kafka-producer
Kafka Go
Kafka library in Go
Stars: ✭ 4,200 (+11566.67%)
Mutual labels:  consumer, kafka

AnotherKafkaMonitor

STATUS

Build Status

ENV

  • scala-2.10.*
  • kafka-0.10.*
  • zookeeper-3.4.6

RELEASE INFO


Table Of Contents


Also you can take a quick look before take action(SOME ADDITIONAL INFO), CLICK->Anotherkafkamonitor Manul Book


Inspiration

AnotherKafkaMonitor is an app which used to monitor kafka producer and consumer progress inspried by KafkaOffsetMonitor. It aims to help you figure out what's going on in your kafka cluster, that's to say, to understand how fast the producer send message to the kafka or whether the consumer is far behind the producer or not, if lag exceeds threshold, you will be noticed through alarm email or sms.

Kafka DataStructure In Zookeeper

The Implementation Of AnotherKafkaMonitor Relys On the Datastructure of Kafka In Zookeeper Kafka DataStructure In Zookeeper

How To Install

Several ways can be taken if you want to try

  1. Extract AnotherKafkaMonitor.war into default folder called AnotherKafkaMonitor;
  1. Edit file which located in path of \AnotherKafkaMonitor\WEB-INF\classes\system-config.properties, In corresponding with your Zookeeper and Kafka Cluster Environment;
  2. Move folder AnotherKakfaMonitor to <TOMCAT_HOME>\webapp;
  3. Start tomcat, type http://localhost:<TOMCAT_HTTP_PORT>/AnotherKafkaMonitor into browser, please enjoy.
  • Maybe you want to make some change for your taste.
  1. Download the zip file;
  1. Import into your IDE, like Eclipse or others as you like.

Quick Look

Now, we are going to show you some screenshot of main featrues about AnotherKafkaMonitor

1. DashBoard

Dashboard lists some general info:

  • How many kafka Brokers, Topics, Zookeepers and Consumers you hava in cluster DashBoard

2. Topic List

  • List Topics you have created;
  • List Partition Indexes of each topic. Topic List

3. Cluster Info

  • Kafka Broker List
  • Zookeeper List Cluster Info

4. Consumers

  • List how many consumer group you have
  • The topic(s) consumed by each consumer group
  • RealTime process rate about producer and consumer of one topic Consumers Topic Detail Topic Realtime

5. Alarm Configuration

  • Alarm notice list
  • Add alarm notice Alarm List

6. Zookeeper Client

Support simple shell comand, such as ls, get and delete

Zookeeper Client

Difference

We are going to list the difference between KafkaOffsetMonitor and AnotherKafkaMonitor

  • AnotherKafkaMonitor is much lightweight compared with KafkaOffsetMonitor;
  • AnotherKafkaMonitor is implemented by Java, Not Scala which KafkaOffsetMonitor be implemented.

Future Plan

We are going to make some big step in the future, like below(JUST FOR NOW):

  • Add SMS notice module[DONE];
  • Support more shell command in the future
  • ...

Contributing

The AnotherKafkaMonitor is released under the Apache License and we welcome any contributions within this license. Any pull request is welcome and will be reviewed and merged as quickly as possible.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].