2606.02705 Toward a Differentiable Neural Computer on a Frozen-Embedding Substrate: PCA of a Constructed Neural Turing Machine, and a RAM-State Machine that Runs on the Substrate
A transformer with **analytically computed (untrained) weights** can execute arbitrary WebAssembly programs — Percepta's `transformer-vm`. We read this artifact as an **autoregressive, deterministic Neural Turing Machine (NTM)**: attention is used as exact, content/location-addressed memory access, the feed-forward layers are the per-step compute, and the append-only token sequence is the machine's state.