Space Exploration Technologies Corp. (NASDAQ:SPCX) and Tesla Inc. (NASDAQ:TSLA) CEO Elon Musk on Saturday reiterated his warning about the risk of AI.
Musk’s Warning Amid Broader Concerns
Musk reposted his warning in a post on X amid broader concerns in the AI ecosystem regarding the potential dangers posed by AI systems and frontier models. He said he has been warning about AI for years and views the technology as more hazardous than other innovations he has watched mature so far.
Musk framed artificial general intelligence as a step-change in potential harm, saying, "AGI is significantly higher risk than nuclear weapons, in my opinion." He also said he sees AI as carrying a level of danger he has not associated with previous tech waves.
The warning from Musk comes amid Anthropic CEO Dario Amodei’s call to "pace the frontier" and slow down the development of improvements in capabilities of AI models. Amodei’s call drew support from rival OpenAI’s CEO, Sam Altman, as well as Musk.
Why AGI Is A Greater Threat Than Nuclear Weapons
Musk’s comparison hinges on the idea that a system with broad, human-level capability could create consequences that are hard to contain once it exists. He described AGI as a category of risk that, in his view, exceeds even the destructive potential of nuclear arsenals.
He also tied the concern to limits in human intuition about intelligence gaps. Musk said, "Super smart humans have trouble imagining something vastly smarter than themselves."
What Musk Fears About AI Evolution
Musk said he has "been sounding the alarm on AI for a long time," positioning his comments as part of a sustained effort to spotlight the downside of rapid AI progress. He added that he has observed many technologies develop, but none that he believes carries comparable danger.
In Musk’s telling, the worry is not incremental improvement, but the possibility of systems that outperform people across domains. That difference, he suggested, makes it harder for policymakers, businesses, and researchers to reason about worst-case outcomes.
Increasing Concerns
Former White House AI and Crypto Czar David Sacks emphasized that leading AI companies like OpenAI and Anthropic have the power to slow down AI development themselves if they believe it poses significant risks. He argued that these organizations are at the forefront of AI advancements and have the most control over the deployment of advanced systems.
Meanwhile, OpenAI has decided to delay its initial public offering, citing unresolved safety concerns and alignment challenges. Altman highlighted the need for the industry and governments to collaborate to address these issues.
Evan Hubinger, a researcher at Anthropic, has warned that AI could pose an existential risk to humanity within a decade. He noted that there is currently no clear plan to solve alignment issues for superintelligence, adding to the urgency of the ongoing safety debate.
Check out more of Benzinga’s Consumer Tech coverage by following this link.
Disclaimer: This content was partially produced with the help of AI tools and was reviewed and published by Benzinga editors.
Photo courtesy: Shutterstock
Login to comment