latency 3 Batching Requests for Cost Savings Without Hurting Latency Sep 11, 2026 Multi-Region Deployment for Latency-Sensitive Agents Aug 29, 2026 Setting a Latency Budget for a RAG Pipeline Apr 24, 2026