GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → PBWebMedia → yarn-prometheus-exporter

PBWebMedia / yarn-prometheus-exporter

Licence: MIT license
Export Hadoop YARN (resource-manager) metrics in prometheus format

Programming Languages

go
31211 projects - #10 most used programming language
Makefile
30231 projects
Dockerfile
14818 projects

Labels

yarnhadoopmetricsexporterapacheprometheusresource-manageryarn-hadoop-clusterapache-hadoop

Projects that are alternatives of or similar to yarn-prometheus-exporter

knit
Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
Stars: ✭ 53 (+20.45%)
Mutual labels:  yarn, hadoop
Jumbune
Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,
Stars: ✭ 64 (+45.45%)
Mutual labels:  yarn, hadoop
Neard
🎲 Portable WAMP software stack
Stars: ✭ 296 (+572.73%)
Mutual labels:  yarn, apache
Nutch
Apache Nutch is an extensible and scalable web crawler
Stars: ✭ 2,277 (+5075%)
Mutual labels:  hadoop, apache
Tensorflowonyarn
Support TensorFlow on YARN
Stars: ✭ 114 (+159.09%)
Mutual labels:  yarn, hadoop
wasp
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
Stars: ✭ 19 (-56.82%)
Mutual labels:  yarn, hadoop
Akkeeper
An easy way to deploy your Akka services to a distributed environment.
Stars: ✭ 30 (-31.82%)
Mutual labels:  yarn, hadoop
Tez
Apache Tez
Stars: ✭ 313 (+611.36%)
Mutual labels:  hadoop, apache
Bigdata Notes
大数据入门指南 ⭐
Stars: ✭ 10,991 (+24879.55%)
Mutual labels:  yarn, hadoop
Hadoop Yarn Api Python Client
Python client for Hadoop® YARN API
Stars: ✭ 91 (+106.82%)
Mutual labels:  yarn, hadoop
Hive Jdbc Uber Jar
Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version
Stars: ✭ 188 (+327.27%)
Mutual labels:  hadoop, apache
beanszoo
Distributed Java micro-services using ZooKeeper
Stars: ✭ 12 (-72.73%)
Mutual labels:  yarn, hadoop
Spark With Python
Fundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (+240.91%)
Mutual labels:  hadoop, apache
fastdata-cluster
Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)
Stars: ✭ 20 (-54.55%)
Mutual labels:  yarn, hadoop
Hive
Apache Hive
Stars: ✭ 4,031 (+9061.36%)
Mutual labels:  hadoop, apache
Bigdata Interview
🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
Stars: ✭ 857 (+1847.73%)
Mutual labels:  yarn, hadoop
hive-jdbc-driver
An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC
Stars: ✭ 31 (-29.55%)
Mutual labels:  hadoop, apache
hadoop-data-ingestion-tool
OLAP and ETL of Big Data
Stars: ✭ 17 (-61.36%)
Mutual labels:  hadoop, apache
Tf Yarn
Train TensorFlow models on YARN in just a few lines of code!
Stars: ✭ 76 (+72.73%)
Mutual labels:  yarn, hadoop
Xlearning
AI on Hadoop
Stars: ✭ 1,709 (+3784.09%)
Mutual labels:  yarn, hadoop
View All Similar Projects ➔

YARN prometheus exporter

Export YARN metrics in Prometheus format.

Build

Requires Go. Tested with Go 1.9+.

go get
go build -o yarn-prometheus-exporter .

Run

The exporter can be configured using environment variables. These are the defaults:

YARN_PROMETHEUS_LISTEN_ADDR=:9113
YARN_PROMETHEUS_ENDPOINT_SCHEME=http
YARN_PROMETHEUS_ENDPOINT_HOST=localhost
YARN_PROMETHEUS_ENDPOINT_PORT=8088
YARN_PROMETHEUS_ENDPOINT_PATH=ws/v1/cluster/metrics

Run the exporter:

./yarn-prometheus-exporter

The metrics can be scraped from:

http://localhost:9113/metrics

Run using docker

Run using docker:

docker run -p 9113:9113 pbweb/yarn-prometheus-exporter

Or using docker-compose:

services:
    image: pbweb/yarn-prometheus-exporter
    restart: always
    environment:
        - "YARN_PROMETHEUS_ENDPOINT_HOST=yarn.hadoop.lan"
    ports:
        - "9113:9113"

License

See LICENSE.md

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].