Triton Server
3,899
Get Dashboard

Created 8/12/2024

Updated 8/12/2024

Revision 1

Grafana Version >=8.5.2

Datasources

Prometheus

Description

Visualize metrics from the Triton server.

Source Grafana.com

Used Metrics 11

nv_gpu_power_usage
nv_gpu_utilization
nv_inference_compute_infer_duration_us
nv_inference_compute_input_duration_us
nv_inference_compute_output_duration_us
nv_inference_count
nv_inference_exec_count
nv_inference_queue_duration_us
nv_inference_request_duration_us
nv_inference_request_failure
nv_inference_request_success

Get Dashboard✕

Download

Copy to Clipboard