Promhub Logo Prom hub

Thanos Query Overload
warning

Description Thanos Query {{$labels.job}} has been overloaded for more than 15 minutes. This may be a symptom of excessive simultanous complex requests, low performance of the Prometheus API, or failures within these components. Assess the health of the Thanos query instances, the connnected Prometheus instances, look for potential senders of these requests and then contact support.
Query for 15m 
>>>
	
				
					(
				
			
				
					
					
						max_over_time
					
				
			
				
					(
				
			
				
					
				
			
				
					[5m]) - 
				
			
				
					
					
						avg_over_time
					
				
			
				
					(
				
			
				
					
				
			
				
					[5m]) < 1)
Query Explanation

The rule checks whether the gap between the maximum allowed concurrent gate queries (max over the last 5 minutes) and the average number of queries currently in flight (over the same period) is less than 1; if this condition holds continuously for 15 minutes, the Thanos query instance is considered overloaded.

Get Alert✕
Download
Copy to Clipboard