Thanos Rule No Evaluation For10 Intervals
info

Description Thanos Rule {{$labels.job}} has rule groups that did not evaluate for at least 10x of their expected interval.
Query for 5m
>>>
	
				
					
					
						time
					
				
			
				
					() -  max by (job, instance, group) (
				
			
				
					
				
			
				
					{job=~".*thanos-rule.*"})>10 * max by (job, instance, group) (
				
			
				
					
				
			
				
					{job=~".*thanos-rule.*"})
				
			
    
Query Explanation

The query takes the current time (time()) and subtracts the latest evaluation timestamp of each Thanos rule group (prometheus_rule_group_last_evaluation_timestamp_seconds), then checks if that delay is greater than 10 × the group's configured evaluation interval (prometheus_rule_group_interval_seconds). The alert fires when any rule group has not run for at least ten of its expected intervals, indicating the group is stalled or not being evaluated.

Get Alert✕
Download
Copy to Clipboard