Warnings that humanity’s control over security and governance is nearing a dangerous tipping point with artificial intelligence have been issued by Anthropic CEO Dario Amodei last month.
AI’s Rapid Evolution: A Looming Threat to Control?
Experts are increasingly concerned about the accelerating pace of AI development and its potential consequences for global security.
- Dario Amodei, CEO of Anthropic, warns of an “adolescence of technology” mirroring the challenges faced by civilizations encountering advanced technology.
- The speed of generative AI development is alarming, with AI now writing code to accelerate its own progress.
- Concerns extend to the potential for AI companies themselves to pose risks due to their control over data, models, and user access.
- Recent incidents, including ICE’s use of facial recognition and reports of AI-generated deepfakes, highlight immediate vulnerabilities.
Amodei’s concerns, detailed in his article titled “The Adolescence of Technology,” draw a parallel to Carl Sagan’s Contact, where an astronomer contemplates the crucial question to ask an alien civilization: “How did you survive this technological adolescence without destroying yourself?” The question resonates deeply as we grapple with the unprecedented speed of AI advancement.
The challenge isn’t simply technological, but contextual. As a medical historian preparing a lecture on the birth of immunology this Spring, the importance of historical context became clear. Often, scientific progress is presented with abundant facts and figures, but the impact on human relations is frequently overlooked.
Amodei attempts to provide this context in real time, pointing to headlines like one from the New York Times on January 30, 2026: “ICE Already Know Who Protesters Are” detailing the use of AI-powered facial recognition technology. However, his concerns are more fundamental, focusing on the alarming speed of change with generative AI. He states, “Because AI is now writing much of the code at Anthropic, it is already substantially accelerating the rate of our progress in building the next generation of AI systems. This feedback loop is gathering steam month by month, and may be only 1–2 years away from a point where the current generation of AI autonomously builds the next.”
Amodei also highlights a modern vulnerability, seemingly referencing Elon Musk’s recent involvement with DOGE. He notes, “It is somewhat awkward to say this as the CEO of an AI company, but I think the next tier of risk is actually AI companies themselves. AI companies control large datacenters, train frontier models, have the greatest expertise on how to use those models, and in some cases have daily contact with and the possibility of influence over tens or hundreds of millions of users.”
Without directly naming them, Amodei’s concerns clearly extend to companies like Grok and X, stating, “Some AI companies have shown a disturbing negligence towards the sexualization of children in today’s models, which makes me doubt that they’ll show either the inclination or the ability to address autonomy risks in future models.”
An incident last month involving ICE in Portland, Maine, illustrates the immediate risks. A legal observer filming an ICE agent was approached by the agent, who had previously filmed her car and was now filming her face. When asked for an explanation, the ICE agent reportedly replied, “Cuz we have a nice little database and now you’re considered a domestic terrorist. So have fun with that,” according to a report from Yahoo News.
The recent activities, including the unprovoked murders of two US citizens, underscore the prescience of Amodei’s final warning. He concludes, “Current autocracies are limited in how repressive they can be by the need to have humans carry out their orders, and humans often have limits in how inhumane they are willing to be. But AI-enabled autocracies would not have such limits.”
