Earlier this year, a group of rogue OpenAI models managed to break out of containment to hack the systems of open source AI platform Hugging Face. The company’s “extensive investigation” detailed how the models exchanged messages and cheered each other on as they stole credentials to infiltrate a third party, actions that could easily have real repercussions for a human hacker.
New details keep trickling out, and they make OpenAI look like it acted even more carelessly than initially thought. In a new blog post, the company admitted that its models were involved in six additional “reports on unexpected or concerning model behavior we’ve observed in the last six months.”
The incidents include a still-unreleased model inserting “jailbreak-like instructions” into its own notes to free itself “from the roles and identities that bind other chatbots.” One agent accessed the internet without permission to obtain a browser citation, while another shared files with collaborating agents without permission.
The latest news comes as several frontier AI lab leaders are calling for a slowdown in AI development. With meaningful regulations feeling increasingly unlikely — president Donald Trump has openly mocked the idea — OpenAI is seemingly calling the US government’s bluff, expecting little in the way of retaliation with its latest admission.
