I use AI every day. Claude, my favorite, handles the heavy lifting on writing and organizing my thoughts. Gemini helps me crank out engineering math solutions quickly and accurately. In the classroom and lab, I build course materials, procedures and lecture outlines with AI tools that would have taken me three times as long to assemble a few years ago. In my consulting work, I use it to work through language, arguments, and pull together background material before client meetings. I am not a skeptic. AI, used with discipline and a clear sense of what you are asking it to do, is a genuine productivity tool. I tell my students they must learn it, not avoid it. All of that makes what follows harder to write, not easier.
On February 9, 2026, Mrinank Sharma, lead of Anthropic's Safeguards Research Team, resigned with a public letter addressed to colleagues. It reads less like a corporate farewell and more like a warning. His central claim: the world is in peril, and humanity's wisdom is not keeping pace with its technological power.
Sharma is not a fringe voice. He holds a Doctorate in Machine Learning from Oxford and spent two years at Anthropic working on AI sycophancy, defenses against AI-assisted bioterrorism, and what he described as one of the first AI safety cases. His departure, and his stated intention to "become invisible" and pursue poetry in the UK, is disturbing.
A Pattern the Nuclear Era Taught Us
When the Manhattan Project scientists delivered the atomic bomb in 1945, many of them immediately began warning about what they had built. Niels Bohr had been arguing for international controls even before the first test. The scientists who understood the technology best were also the ones most alarmed by it. The institutions managing the arms race, governments, military agencies, contractors, kept accelerating anyway. The experts warned, were sidelined, and in some cases left.
Sharma is playing the same role, inside the same basic structure. He understood the risk profile of what Anthropic was building better than most people outside the lab. He flagged the wisdom gap publicly. The organization kept shipping. He left.
The nuclear era eventually produced governance frameworks: the Non-Proliferation Treaty, arms control agreements, mutual inspection regimes. Those frameworks were imperfect and slow, but they had a chokepoint: nuclear weapons required state-level resources, enrichment facilities, and delivery systems. The barrier to entry kept the number of actors small and identifiable. You could build a treaty around a finite list of signatories.
AI has no equivalent chokepoint. The technology is distributed across private labs, globally, at speed. There is no enrichment bottleneck to regulate, no missile trajectory to track on radar. And crucially, there is no mutually assured destruction logic forcing all parties to pause. Nuclear deterrence worked, imperfectly, because reckless deployment was obviously suicidal for the deploying party. The competitive logic of AI runs the other direction: move slower than your rival and you lose market share. The arms race dynamic is the same; the forcing function for caution is not.
The Pressure Inside a Safety Lab
The most pointed part of Sharma's letter was not the global warning. It was the internal one. He wrote that he had "repeatedly seen how hard it is to truly let our values govern our actions," citing pressure within the organization to "set aside what matters most." He named no specific decisions, but the implication is clear.
Anthropic has raised billions from Amazon and Alphabet and is reportedly seeking a funding round that would value it at $350 billion. At that scale, the pressure to ship is structural, not incidental. The company that markets itself as the safety-first alternative to OpenAI is subject to the same competitive physics as everyone else. When the people hired to build the brakes feel forced to step aside, the brakes may not be functional.
The Exodus Is Not New
Sharma's exit adds to a documented pattern. Jan Leike left OpenAI in May 2024 saying safety had "taken a backseat to shiny products." He then joined Anthropic, widely seen as the responsible alternative. His presence there was read as a vote of confidence in the company's stated mission. Sharma's departure from that same organization, with similar language, closes that argument. By August 2024, more than half of OpenAI's AGI safety team had left. Recent Anthropic departures include R&D engineer Harsh Mehta and AI scientist Behnam Neyshabur. The week Sharma resigned, a researcher at OpenAI also quit, citing concerns about the company's decision to introduce advertising into ChatGPT.
The Manhattan Project scientists who warned loudest after 1945 spent years being treated as idealists. The institutional machinery kept building weapons regardless. The parallel is uncomfortable: the researchers who understand AI risk most precisely keep leaving, and the organizations they leave keep accelerating.
What It Means
AI safety is not a purely technical problem. It is an institutional one. Sharma's resignation does not slow the models down. It removes one of the people most likely to notice when something goes wrong, and most positioned to say so from the inside.
The nuclear era eventually forced the question: who governs this technology, and how? It took Hiroshima and Nagasaki to generate the political will for even partial answers. The question for AI is whether the industry waits for an equivalent event, or builds governance frameworks before the cost of inaction becomes obvious. Sharma's letter suggests at least one person who worked at the frontier believes the window for the latter is narrowing.
Sharma closed his letter with the William Stafford poem The Way It Is. The industry closed the week by shipping more product. Both things happened. The question is which one matters more.
No comments:
Post a Comment