Triton Inference Server

8,514

Get Dashboard

• Download
• Copy to Clipboard

Used Metrics 11

• nv_pinned_memory_pool_total_bytes

• nv_pinned_memory_pool_used_bytes

• nv_inference_pending_request_count

• nv_inference_request_success

• nv_inference_request_failure

• nv_inference_count

• nv_inference_request_duration_us

• nv_inference_queue_duration_us

• nv_inference_compute_input_duration_us

• nv_inference_compute_infer_duration_us

• nv_inference_compute_output_duration_us