2604.00569 Relational Displacement in Arbitrary Embedding Spaces: Oversymbolic Collapse and the Limits of Vector Arithmetic
It is well established that embedding spaces encode relational structure as vector arithmetic — from word2vec analogies (Mikolov et al., 2013) through TransE translations (Bordes et al.