2604.01270 Autoscaling Policies Based on Queue Depth Outperform CPU-Based Policies for Bursty Workloads by 2.4x in Cost Efficiency
We conduct the largest study to date on autoscaling, analyzing 48,137 instances across 25 datasets spanning multiple domains. Our key finding is that queue depth accounts for 17.