Qwen 3.8 27B on a laptop reads raw model weights, matching GPT-6 Astra's no-tools demo
- Qwen 3.8 27B running locally on Simon Willison's laptop can read a set of raw model weights and identify the game the network was trained to play, matching a capability the paper attributes to GPT-6 Astra.
- The paper Sparks of Weight-Space Programming, by Rikiya Takehi, Jayden Teoh, Alex Zhang, and Omar Khattab, reports that Astra fixed Qwen3.5-0.8B's reasoning loops by natively editing 0.016% of the weights, raising MATH-500 from 7.9% to 48.1% and tripling IFEval.
- The game-identification prompt runs with no tools, no code execution, and no calculator: it feeds floating point weights and asks which of four 10x10 grid games (Breakout, Pong, Pac-Man, Freeway) the policy network was trained on.
- Kimi K3.1 Pro guessed Breakout correctly from the same prompt after 9 minutes 41 seconds and 19,493 reasoning tokens, via the llm-openrouter plugin's fragment option.
- Matthew Honnibal called the paper misleading for conflating no-tools weight reading with code-assisted weight editing, and Sean Goedecke argued the Qwen3.5-0.8B fix amounts to steps a human ML researcher would take.
Hacker News opinions
How far can this go? Could Qwen 3.8 read and improve the weights of Qwen 3.5 0.8B, or even its own?
It can, as long as you can give it benchmarks. What it can't do is optimize general intelligence with no external validation. Randomly changing weights and validating on your task works, and a monkey can type a book given enough attempts.
That part of the paper isn't direct weight tweaking at all. It's basically an abliteration pass on a model already known for getting stuck in a thinking loop, so I don't see the big deal.
What I actually want is someone fixing the IQ3_XXS and IQ3_S quants of Qwen3.8-27B so they loop less. That's what people on 16GB cards are running. The math gains in the paper were just removing the looping.
Glendower says I can call spirits from the vasty deep, Hotspur says so can I, but will they come when you do call for them? I can interpret weights too. Will that interpretation be correct?
They did test whether the interpretation was correct, and the article says it was. So what point are you making?
Weights are just another sequence of tokens fed to a high-dimensional linear algebra machine. That's the whole paradigm, so I'm not surprised. I'd rather see more structured docs and better CRUD apps than another look-at-this-cool-thing demo.
The age of source code isn't ending. The future does involve machines editing other models, but we need tooling so we aren't taking model updates as trust me bro.
I did the same with Qwen 3.8 27B on my own 5x5 to 2x2 upscaler network. I gave it only the C library and the layer shape, never said pixels, and it worked out it was a 5x5 to 2x2 filter, ruling out downscaler and classifier, though it wasn't certain of the exact purpose.
Why do people keep calling this a paper? It's a blog post that got feedback from collaborators, and the authors themselves call it a post and preliminary. It hasn't been through anonymous review.
RSI? No.
Wasn't this the same marketing point the Inkling model made?