HBase 1.x 1,4711,471 5.0 (1 reviews)
7/29/2020
9/20/2020
1
Databases
>=7.1.1
Prometheus
About
Initial test example. Not everything is rendered or usable. Some metrics are wrong, because this is quick copy/adaptation of my other dashboard used with HBase 2.x
Tested with
HBase:
- prometheus v2.19.0
- grafana v7.1.1 (3039f9c3bd)) with prometheus as Data Source
- Hadoop 2.7.1
- hbase 1.1.13 with jmx_prometheus_javaagent-0.13.1-SNAPSHOT.jar (just download form github and compile it on your own)
HBase Master HBASE_OPTS appended:
-javaagent:/data/jmx_exporter/jmx_prometheus_javaagent-0.13.1-SNAPSHOT.jar=0.0.0.0:26010:/data/jmx_exporter/jmx_hbase.yaml
HBase Regionserver HBASE_OPTS appended:
-javaagent:/data/jmx_exporter/jmx_prometheus_javaagent-0.13.1-SNAPSHOT.jar=0.0.0.0:26030:/data/jmx_exporter/jmx_hbase.yaml
- jmx-prometheus config
/data/jmx_exporter/jmx_hbase.yaml:
---
lowercaseOutputName: true
lowercaseOutputLabelNames: true
rules:
- pattern: Hadoop<service=HBase, name=RegionServer, sub=Regions><>Namespace_([^\W_]+)_table_([^\W_]+)_region_([^\W_]+)_metric_(\w+)
name: HBase_metric_$4
labels:
namespace: "$1"
table: "$2"
region: "$3"
- pattern: Hadoop<service=(\w+), name=(\w+), sub=(\w+)><>([\w._]+)
name: hadoop_$1_$4
labels:
"name": "$2"
"sub": "$3"
- pattern: .+
- prometheus scrape targets:
# two hbase masters
- targets:
- m-1:26010
- m-2:26010
labels:
type: master
# three hbase regionservers
- targets:
- m-1:26030
- m-2:26030
- m-3:26030
labels:
type: regionserver
Known limitations
- some metrics are empty because they are remnants from HBase 2.x and they just don't exist (I was lazy)
- You may need to adjust dashboard to match your prometheus labels
- Vast majority of metrics is not yet exposed on the graphs, but you can add them on your own
- Some metrics are duplicated because the way they are exposed by jmx_exporter
Changelog
- Initial release
Contact
- contact author if you have any suggestions etc
Get Dashboard✕
Download
Copy to Clipboard
Used Metrics 1818
hadoop_hbase_numregionservers
hadoop_hbase_numdeadregionservers
hadoop_hbase_ritcount
hadoop_hbase_exceptions
hadoop_hbase_totalrequestcount
hadoop_hbase_receivedbytes
hadoop_hbase_sentbytes
hadoop_hbase_averageload
hadoop_hbase_flushedcellssize
hadoop_hbase_readrequestcount
hadoop_hbase_hlogfilesize
hadoop_hbase_hlogfilecount
hadoop_hbase_flushedcellscount
hadoop_hbase_flushedmemstorebytes
hadoop_hbase_storefileindexsize
hadoop_hbase_storecount
hadoop_hbase_storefilecount
hadoop_hbase_storefilesize