Press play. Thinking text appears in grey, the final answer in dark ink.
The base model gets stuck in a loop
With thinking on, small Qwen keeps re-checking itself — “wait, let me verify…” — until it runs out of budget instead of answering.
An LLM edits 0.016% of the weights
It subtracts one direction from 64 neurons' output weights (ffn_down) in
layers 15 and 19 — 131,072 of ~800M weights.
Stripes drawn ~25× wider than true scale — at real size they would be invisible.
The edited model escapes
Same model, same prompts — it now stops looping and finishes its answers.
Where this might fit
Model souping - diffusion-LoRA merging is one case of it - is weight-space editing too. The difference is the target: souping picks merge weights (and sometimes merge order) with a broad benchmark; weight-space programming zeroes in on a few specific failure cases and the neurons behind them. And here's the fun part: it's a promising fit for agents - propose an edit, test it, feed the result back - the same edit-test-repeat loop behind the recent coding-agent wins.