Thanos Query High D N S Failures
warning

Description Thanos Query {{$labels.job}} have {{$value | humanize}}% of failing DNS queries for store endpoints.
Query for 15m
>>>
	
				
					(sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-query.*"}[5m])) / sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-query.*"}[5m]))) * 100 > 1
				
			
    
Query Explanation

The rule calculates the percentage of DNS lookups that failed for Thanos Query’s store APIs over the last 5 minutes, grouped by job. If this failure rate exceeds 1 % for any job matching .*thanos-query.*, the alert is triggered.

Get Alert
Download
Copy to Clipboard