Triton Server 3,8993,899
8/12/2024
8/12/2024
1
>=8.5.2
Prometheus
Get Dashboard✕
Download
Copy to Clipboard
Used Metrics 1111
nv_inference_request_success
nv_inference_compute_infer_duration_us
nv_inference_request_failure
nv_inference_request_duration_us
nv_gpu_utilization
nv_inference_exec_count
nv_gpu_power_usage
nv_inference_count
nv_inference_queue_duration_us
nv_inference_compute_input_duration_us
nv_inference_compute_output_duration_us