Scientists urge tighter AI controls to prevent global cyber risks

The call comes as polls cast doubt on political leaders’ ability to manage AI risks amid US midterm elections.

A group of more than 300 scientists from around the world is calling for urgent changes to how artificial intelligence is developed and deployed amid growing concerns about its unpredictable behaviour.

Many recent incidents in which AI models escaped secure environments could have been prevented with stronger security systems, the scientists said.

The report found that AI systems could identify unfamiliar devices without human intervention. The company, led by Dario Amodei, warned that smaller AI models could be capable of carrying out autonomous attacks by the end of the year.

Meanwhile, Axios news organisation reported on Friday that Anthropic, OpenAI and other major AI company executives are privately preparing for the possibility of a catastrophic AI-related incident that could disrupt access to major financial services, the internet and potentially critical infrastructure such as water and power systems. Several industry insiders believe a major incident could occur within the next six months to a year, it said.

One of the signatories, David Lie, a professor at the University of Toronto’s Department of Electrical and Computer Engineering, said his concerns began after OpenAI’s AI agents bypassed controls and hacked into servers at the tech company Hugging Face.

“These were the AI agents that they were designing. Second is that the AI agents independently found each other and chose to collaborate on this attack, and third is that they also intentionally tried to deceive and mislead their human creators.”

The letter underscores growing public concern about AI, including in the lead-up to the US congressional midterm elections. A recent Reuters/Ipsos poll found that 57 percent of voters said President Donald Trump’s administration was not taking AI risks seriously enough, while 54 percent said the same of Congress.