Write Back the $Δ$: Revisiting the Same Tokens with Fresh Representations

Transformers process information strictly forward through depth, preventing deeper computation from revisiting and refining earlier representations. To augment the standard forward pass, existing approaches either re-execute depth, incurring additional computation, or modify the residual stream usin