jmx_exporter-cloudera-hadoop
Prometheus jmx_exporter configurations for Cloudera Hadoop.
Cloudera Hadoop Metrics
For Cloudera Hadoop I enabled jmxremote for each service via the extra java options and used jmxterm to get all beans I needed. Don't forget to remove the jmxremote settings after you are finished.
Exporter ports and configuration files
The table is sorted alphabetically by service name.
| Service | Role | Impl. progress | JMX port | Exporter port | Configuration file |
|---|---|---|---|---|---|
| HDFS | NameNode | ✓ | 18000 | 19000 | cdh-hdfs-namenode.yaml |
| HDFS | SecondaryNameNode | ✓ | 18001 | 19001 | cdh-hdfs-secondarynamenode.yaml |
| HDFS | JournalNode | 0% | 18002 | 19002 | cdh-hdfs-journalnode.yaml |
| HDFS | Failover Controller | 0% | 18003 | 19003 | cdh-hdfs-failover-controller.yaml |
| HDFS | HttpFS | 0% | 18004 | 19004 | cdh-hdfs-httpfs.yaml |
| HDFS | Balancer | 0% | 18005 | 19005 | cdh-hdfs-balancer.yaml |
| HDFS | NFS Gateway | 0% | 18006 | 19006 | cdh-hdfs-nfs-gateway.yaml |
| HDFS | DataNode | ✓ | 18007 | 19007 | cdh-hdfs-datanode.yaml |
| Hive | HiveServer2 | 0% | 18020 | 19020 | cdh-hive-hiveserver2.yaml |
| Hive | Hive Metastore Server | 0% | 18021 | 19021 | cdh-hive-metastore-server.yaml |
| Hive | WebHCat Server | 0% | 18022 | 19022 | cdh-hive-webhcat-server.yaml |
| Hue | Hue Server | 0% | 18040 | 19040 | cdh-hue-server.yaml |
| Hue | Kerberos Ticket Renewer | 0% | 18041 | 19041 | cdh-hue-kerberos-ticket-renewer.yaml |
| Hue | Loadbalancer | 0% | 18042 | 19042 | cdh-hue-loadbalancer.yaml |
| Kafka | Kafka Broker | 0% | 18090 | 19090 | cdh-kafka-broker.yaml |
| Kafka | Kafka MirrorMaker | 0% | 18091 | 19091 | cdh-kafka-mirrormaker.yaml |
| Oozie | Oozie Server | 0% | 18050 | 19050 | cdh-oozie-server.yaml |
| Sentry | Sentry Server | 0% | 18060 | 19060 | cdh-sentry-server.yaml |
| Solr | Solr Server | 0% | 18100 | 19100 | cdh-solr-server.yaml |
| Spark | History Server | 0% | 18070 | 19070 | cdh-spark-history-server.yaml |
| Spark 2 | History Server | 0% | 18080 | 19080 | cdh-spark2-history-server.yaml |
| YARN | ResourceManager | 0% | 18010 | 19010 | cdh-yarn-resourcemanager.yaml |
| YARN | JobHistory Server | 0% | 18011 | 19011 | cdh-yarn-jobhistory-server.yaml |
| YARN | NodeManager | 0% | 18012 | 19012 | cdh-yarn-nodemanager.yaml |
| ZooKeeper | Server | 0% | 18030 | 19030 | cdh-zookeeper-server.yaml |
JMX configuration for getting MBeans
Enable jmxremote
Example for configuring the DataNode:
HADOOP_DATANODE_OPTS=<DEFAULT OPTIONS PROVIDED BY CLOUDERA> \
-Dcom.sun.management.jmxremote \
-Dcom.sun.management.jmxremote.port=18007 \
-Dcom.sun.management.jmxremote.local.only=true \
-Dcom.sun.management.jmxremote.authenticate=false \
-Dcom.sun.management.jmxremote.ssl=false
Get MBeans with jmxterm
$ java -jar jmxterm.jar --url localhost:18007
$>beans
#domain = Hadoop:
Hadoop:name=DataNodeInfo,service=DataNode
Hadoop:name=UgiMetrics,service=DataNode
Hadoop:name=JvmMetrics,service=DataNode
Hadoop:name=MetricsSystem,service=DataNode,sub=Control
Hadoop:name=MetricsSystem,service=DataNode,sub=Stats
Hadoop:name=RpcActivityForPort50020,service=DataNode
Hadoop:name=RpcDetailedActivityForPort50020,service=DataNode
....