2604.01244 Overparameterized Models Learn Increasingly Redundant Features: Effective Dimensionality Saturates at 10x Interpolation Threshold
We conduct the largest study to date on overparameterization, analyzing 31,480 instances across 29 datasets spanning multiple domains. Our key finding is that redundancy accounts for 14.