Researcher Claims AI Models Are Decipherable, Challenging Black Box Theory
Nick Cammarata, a former OpenAI researcher now at Goodfire, published a 26,000-word essay arguing that AI neural networks are not opaque black boxes but are actually legible and interpretable. He claims that neurons respond to specific patterns, such as V-shapes, rather than unrelated concepts, challenging the prevailing theory of superposition. While industry leaders like Sam Altman praised the work as a potential breakthrough for AI alignment, critics argue it is unproven and does not solve the complexity of how neurons interact. The findings remain theoretical and lack peer review, but they have sparked intense debate about the future of AI safety and control.