Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Interpretability essay 'Neural Networks Are Already Clean' divides researchers

AI summary

Goodfire researcher Nick Cammarata published a long essay, "Neural Networks Are Already Clean," arguing that the internals of large models are far more understandable than assumed. He reinterprets the famous InceptionV1 "cat-car" neuron as a V-shape detector and reads the superposition circuit from "Zoom In" as ordinary generalization, proposing "recursive generalization" to explain remaining ambiguity. He reports preliminary numbers for Qwen3-32B: about 90 percent of neuron poles have one main job, about 7 percent have two related ones and only 2 to 4 percent remain unexplained; Goodfire says it sees similar results in models up to trillions of parameters, with automated agents doing most of the work. OpenAI's Roon called it a potential major moment in scientific history, while Google DeepMind's Neel Nanda said it is a useful tool rather than a breakthrough and still believes superposition is real; the companion technical paper has not yet been released.

In-depth insight

If model internals really are easier to read, safety monitoring could gain a practical path; the claim still awaits independent confirmation, and Goodfire has a commercial stake in it.

GoodfireNick CammarataNeel Nanda

Original · 7 min readRead the original
Group chat

No comments yet. Start the conversation.