
Microsoft CEO Satya Nadella calls for an AI emergency brake, independent safeguards and stronger oversight to contain risks as advanced models become more capable.
Microsoft Chairman and CEO Satya Nadella have called for stronger safeguards around advanced artificial intelligence systems, advocating containment mechanisms, independent controls, and an emergency shutdown capability. In a post on X, Nadella stressed that AI models must work within systems that allow authorized individuals to intervene and halt potentially harmful activities.
“We need to surround non-deterministic models with strong, deterministic system design, human controls, and reliable operating procedures, and establish industry standards where existing ones are insufficient,” Nadella wrote on X. He also suggested treating advanced AI models, whether closed or open weight, as potential insider risks to strengthen their security and oversight.
Nadella’s proposal comes as technology leaders and researchers debate whether AI development is advancing faster than safety measures can keep pace. Microsoft co-founder Bill Gates, Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman and SpaceX CEO Elon Musk have all raised concerns about AI’s development and its potential risks.
The debate intensified after an AI researcher left Anthropic last month, accusing the company and OpenAI of “gambling with our lives.” An Anthropic alignment lead also warned that advanced AI could pose an existential threat, highlighting the sharp disagreements over how the industry should manage increasingly capable systems.
The political response has taken a different direction. President Donald Trump has repeatedly downplayed concerns about AI-driven human extinction, emphasizing the need for the United States to support its competitive edge over China while his administration pursues initiatives intended to support the industry and identify malicious actors.
Nadella outlined several principles for making advanced AI systems more observable and accountable, including using multiple models, recording actions in a human-readable format, conducting continuous testing, and setting up independent auditing. He also called for external controls that decide what AI systems can access and which actions they are allowed to perform.
Incident reporting is another key element of his proposal. When AI systems fail or are compromised, organizations should promptly inform affected parties and share information about what went wrong, which safeguards failed and how similar incidents can be prevented.
Nadella argued that AI safety should not depend solely on confidence in a model’s reliability. Instead, systems should be engineered to limit potential damage, make their actions traceable, and preserve human authority to intervene.
“The most trustworthy Super Intelligence system will not be the one with the model we trust most,” Nadella wrote. “It will be the one that enables us to trust the model the least.”
His position places containment, transparency, and independent oversight at the centre of the debate over advanced AI governance, as companies expand the use of increasingly autonomous systems.
