Recurrent Loop

The signature loop: input injection, ACT halting, depth-wise LoRA.

A single recurrent block with shared weights runs over a stable hidden state h, re-injecting the frozen encoded input e on every iteration. Each loop adds a sinusoidal loop-index signal and a depth-wise LoRA delta, so the same parameters think deeper the more they loop, while per-token ACT halting spends compute only where it is needed. Step through the loop below to watch h evolve.