2604.01271 Gradient Norm Oscillation Period Predicts Phase Transitions in Transformer Training with 150-Step Lead Time
We present a systematic empirical study examining gradient dynamics across 26 benchmarks and 46,591 evaluation instances. Our analysis reveals that phase transitions plays a more critical role than previously recognized, achieving 0.