Promhub Logo Prom hub

Thanos Receive High Forward Request Failures
info

Description Thanos Receive {{$labels.job}} is failing to forward {{$value | humanize}}% of requests.
Query for 5m 
>>>
	
				
					(sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{result="error", job=~".*thanos-receive.*"}[5m]))/  sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-receive.*"}[5m]))) * 100 > 20
Query Explanation

The rule computes, for each thanos-receive job, the error rate of forward requests over the last 5 minutes by dividing the rate of thanos_receive_forward_requests_total{result="error"} by the total forward request rate, multiplies by 100 to get a percentage, and fires when that percentage exceeds 20 % (i.e., when more than one‑fifth of forward requests fail).

Get Alert✕
Download
Copy to Clipboard