Posted:

MicrosoftâÂÂs Satya Nadella says AI models need an âÂÂemergency brakeâÂÂ
Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.
In a Saturday morning post on X, Nadella wrote that itâÂÂs time âÂÂto step back and assess the trust architectureâ of AI.
âÂÂWe canâÂÂt treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,â Nadella wrote, using the Trump administrationâÂÂs preferred term for AI.ÃÂ
As outlined by Nadella, this approach âÂÂmeans separating the model from the harness that orchestrates its work,â as well as âÂÂexternalizing controls and safeguards.â He also called for âÂÂevery meaningful model actionâ to be documented with âÂÂtamper-proof human readable evidence,â and for systems where âÂÂan authorized personâ always has the ability âÂÂto pause or shut down a model mid-task.âÂÂ
âÂÂWe must assume a model is compromised and contain it from the start,â he said. âÂÂThink of it like an emergency brake.âÂÂ
NadellaâÂÂs comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.
Topics