Thanos Bucket Replicate Run Latency
critical

Description Thanos Replicate {{$labels.job}} has a 99th percentile latency of {{$value}} seconds for the replicate operations.
Query for 5m
>>>
	
				
					(
				
			
				
					
					
						histogram_quantile
					
				
			
				
					(0.99, sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-bucket-replicate.*"}[5m]))) > 20 and  sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-bucket-replicate.*"}[5m])) > 0)
				
			
    
Query Explanation

The rule computes the 99th‑percentile latency of thanos_replicate_replication_run_duration_seconds for each job matching .*thanos-bucket-replicate.* over the past 5 minutes, and fires when this latency is greater than 20 s while the replication metric is still emitting data (rate > 0).

Get Alert
Download
Copy to Clipboard