GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → didi → Logi Kafkamanager

didi / Logi Kafkamanager

Licence: apache-2.0
一站式Apache Kafka集群指标监控与运维管控平台

Programming Languages

java
68154 projects - #9 most used programming language
typescript
32286 projects
Less
1899 projects
shell
77523 projects
CSS
56736 projects
javascript
184084 projects - #8 most used programming language

Labels

kafkametricstopicclusterbrokerpartitionclusterskafka-brokerlogikafka-monitorkafka-clusterkafkamonitormirror-makermonitor-topicpartition-countkafkamanagerlogi-kafkamanagerlogi-km

Projects that are alternatives of or similar to Logi Kafkamanager

Kafka Monitor
Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived vital statistics - E2E latency, service produce/consume availability, offsets commit availability & latency, message loss rate and more.
Stars: ✭ 1,817 (-44.6%)
Mutual labels:  metrics, topic, cluster, broker, partition, clusters, kafka-broker, kafka-monitor, kafka-cluster, monitor-topic, partition-count
kafkactl
CLI for Apache Kafka Management -
Stars: ✭ 78 (-97.62%)
Mutual labels:  topic, partition, kafka-cluster
Swarmlet
A self-hosted, open-source Platform as a Service that enables easy swarm deployments, load balancing, automatic SSL, metrics, analytics and more.
Stars: ✭ 373 (-88.63%)
Mutual labels:  metrics, cluster
Hmq
High performance mqtt broker
Stars: ✭ 722 (-77.99%)
Mutual labels:  kafka, cluster
Kube Aliases
Kubernetes Aliases and Bash Functions
Stars: ✭ 40 (-98.78%)
Mutual labels:  metrics, cluster
kmedoids
The Partitioning Around Medoids (PAM) implementation of the K-Medoids algorithm in Python [Unmaintained]
Stars: ✭ 18 (-99.45%)
Mutual labels:  cluster, clusters
KafKare
A Kafka monitoring dashboard
Stars: ✭ 87 (-97.35%)
Mutual labels:  metrics, kafka-cluster
Kafka exporter
Kafka exporter for Prometheus
Stars: ✭ 996 (-69.63%)
Mutual labels:  kafka, metrics
inspr
Inspr is an agnostic application mesh for simpler, faster, and securer development of distributed applications (dApps).
Stars: ✭ 49 (-98.51%)
Mutual labels:  cluster, broker
Kafka Visualizer
A web client for visualizing your Apache Kafka topics live.
Stars: ✭ 98 (-97.01%)
Mutual labels:  kafka, topic
Filodb
Distributed Prometheus time series database
Stars: ✭ 1,286 (-60.79%)
Mutual labels:  kafka, metrics
Kafka Zk Restapi
Kafka Zookeeper RESTful API to perform topic/consumer group administration/metric(offset\lag\message) collection and monitor
Stars: ✭ 121 (-96.31%)
Mutual labels:  kafka, topic
ring-election
A node js library with a distributed leader/follower algorithm ready to be used
Stars: ✭ 92 (-97.2%)
Mutual labels:  cluster, partition
Kafka Security Manager
Manage your Kafka ACL at scale
Stars: ✭ 267 (-91.86%)
Mutual labels:  kafka, broker
MQTT.jl
An asynchronous MQTT client library for julia
Stars: ✭ 15 (-99.54%)
Mutual labels:  topic, broker
Kudo
Kubernetes Universal Declarative Operator (KUDO)
Stars: ✭ 849 (-74.12%)
Mutual labels:  kafka, cluster
Kafdrop
Kafka Web UI
Stars: ✭ 3,158 (-3.72%)
Mutual labels:  kafka, topic
Kafkawize
Kafkawize : A Self service Apache Kafka Topic Management tool/portal. A Web application which automates the process of creating and browsing Kafka topics, acls, schemas by introducing roles/authorizations to users of various teams of an org.
Stars: ✭ 79 (-97.59%)
Mutual labels:  kafka, topic
Icinga2
Icinga is a monitoring system which checks the availability of your network resources, notifies users of outages, and generates performance data for reporting.
Stars: ✭ 1,670 (-49.09%)
Mutual labels:  metrics, cluster
Ecs Exporter
Export AWS ECS cluster metrics to Prometheus
Stars: ✭ 127 (-96.13%)
Mutual labels:  metrics, cluster
View All Similar Projects ➔

logikm_logo

一站式Apache Kafka集群指标监控与运维管控平台

阅读本README文档，您可以了解到滴滴Logi-KafkaManager的用户群体、产品定位等信息，并通过体验地址，快速体验Kafka集群指标监控与运维管控的全流程。

1 产品简介

滴滴Logi-KafkaManager脱胎于滴滴内部多年的Kafka运营实践经验，是面向Kafka用户、Kafka运维人员打造的共享多租户Kafka云平台。专注于Kafka运维管控、监控告警、资源治理等核心场景，经历过大规模集群、海量大数据的考验。内部满意度高达90%的同时，还与多家知名企业达成商业化合作。

1.1 快速体验地址

1.2 体验地图

相比较于同类产品的用户视角单一（大多为管理员视角），滴滴Logi-KafkaManager建立了基于分角色、多场景视角的体验地图。分别是：用户体验地图、运维体验地图、运营体验地图

1.2.1 用户体验地图

  • 平台租户申请  ：申请应用（App）作为Kafka中的用户名，并用 AppID+password作为身份验证
  • 集群资源申请  ：按需申请、按需使用。可使用平台提供的共享集群，也可为应用申请独立的集群
  • Topic   申   请  ：可根据应用（App）创建Topic，或者申请其他topic的读写权限
  • Topic   运   维  ：Topic数据采样、调整配额、申请分区等操作
  • 指   标  监   控  ：基于Topic生产消费各环节耗时统计，监控不同分位数性能指标
  • 消 费 组 运 维 ：支持将消费偏移重置至指定时间或指定位置

1.2.2 运维体验地图

  • 多版本集群管控  ：支持从0.10.2到2.x版本
  • 集    群    监   控  ：集群Topic、Broker等多维度历史与实时关键指标查看，建立健康分体系
  • 集    群    运   维  ：划分部分Broker作为Region，使用Region定义资源划分单位，并按照业务、保障能力区分逻辑集群
  • Broker    运    维  ：包括优先副本选举等操作
  • Topic      运    维  ：包括创建、查询、扩容、修改属性、迁移、下线等

1.2.3 运营体验地图

  • 资  源  治  理  ：沉淀资源治理方法。针对Topic分区热点、分区不足等高频常见问题，沉淀资源治理方法，实现资源治理专家化
  • 资  源  审  批  ：工单体系。Topic创建、调整配额、申请分区等操作，由专业运维人员审批，规范资源使用，保障平台平稳运行
  • 账  单  体  系  ：成本控制。Topic资源、集群资源按需申请、按需使用。根据流量核算费用，帮助企业建设大数据成本核算体系

1.3 核心优势

  • 高 效 的 问 题 定 位  ：监控多项核心指标，统计不同分位数据，提供种类丰富的指标监控报表，帮助用户、运维人员快速高效定位问题
  • 便 捷 的 集 群 运 维  ：按照Region定义集群资源划分单位，将逻辑集群根据保障等级划分。在方便资源隔离、提高扩展能力的同时，实现对服务端的强管控
  • 专 业 的 资 源 治 理  ：基于滴滴内部多年运营实践，沉淀资源治理方法，建立健康分体系。针对Topic分区热点、分区不足等高频常见问题，实现资源治理专家化
  • 友 好 的 运 维 生 态  ：与滴滴夜莺监控告警系统打通，集成监控告警、集群部署、集群升级等能力。形成运维生态，凝练专家服务，使运维更高效

1.4 滴滴Logi-KafkaManager架构图

kafka-manager-arch

2 相关文档

2.1 产品文档

2.2 社区文章

3 滴滴Logi开源用户交流群

image
微信加群：添加mike_zhangliang的微信号备注Logi加群或关注公众号 云原生可观测性 回复 "Logi加群"

4 知识星球

image

✅知识星球首个【Kafka中文社区】，内测期免费加入～https://z.didi.cn/5gSF9
有问必答~！
互动有礼~！
1600+群友一起共建国内最专业的【Kafka中文社区】
PS:提问请尽量把问题一次性描述清楚，并告知环境信息情况哦～！如使用版本、操作步骤、报错/警告信息等，方便嘉宾们快速解答～

5 项目成员

5.1 内部核心人员

iceyuhui、liuyaguang、limengmonty、zhangliangmike、nullhuangyiming、zengqiao、eilenexuzhe、huangjiaweihjw、zhaoyinrui、marzkonglingxu、joysunchao

5.2 外部贡献者

fangjunyu、zhoutaiyang

6 协议

LogiKM基于Apache-2.0协议进行分发和使用，更多信息参见协议文件

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].