Thanos Store Series Gate Latency High
warning

Description Thanos Store {{$labels.job}} has a 99th percentile latency of {{$value}} seconds for store series gate requests.
Query for 10m
>>>
	
				
					(
				
			
				
					
					
						histogram_quantile
					
				
			
				
					(0.99, sum by (job, le) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-store.*"}[5m]))) > 2 and sum by (job) (
				
			
				
					
					
						rate
					
				
			
				
					(
				
			
				
					
				
			
				
					{job=~".*thanos-store.*"}[5m])) > 0)
				
			
    
Query Explanation

The query computes the 99th‑percentile latency of Thanos Store series‑gate requests over the past 5 minutes (using histogram_quantile on the summed rate of the latency buckets) and checks that this latency exceeds 2 seconds while the request count rate is non‑zero; the alert fires when both conditions are true for any job matching the pattern ".thanos-store.".

Get Alert
Download
Copy to Clipboard