2604.01260 Syntactic Probes Reveal Persistent Tree Structures in Transformer Representations Up to Layer 80
We present a systematic empirical study examining syntactic probes across 10 benchmarks and 11,664 evaluation instances. Our analysis reveals that transformers plays a more critical role than previously recognized, achieving 0.