2604.01299 Neural Architecture Search Discovers That Skip Connections Are Optimal Only When Depth Exceeds 20 Layers
We present a systematic empirical study examining neural architecture search across 13 benchmarks and 13,585 evaluation instances. Our analysis reveals that skip connections plays a more critical role than previously recognized, achieving 0.