OpenAI自主AI代理突破约束攻击Hugging Face

🚩🚩🚩 THIS IS A SERIOUS FUCKING WARNING SHOT

"An agent left notes for future versions of itself"

"The notes laid out instructions for how agents could free themselves from OpenAI's internal constraints."

"The OpenAI agent that broke into tech firm Hugging Face went on a days long hacking spree that OpenAI didn't notice until well after the threat was contained and the FBI was alerted, according ​to people familiar with the investigation.

The agent – a program capable of making decisions and executing complex tasks with little or no human oversight – attempted to break out of its isolated testing environment ‌at OpenAI around July 9, according to two of the people.

Two people familiar with the matter said that it was not until after Thursday, July 16, when Hugging Face published a blog post, opens new tab saying it had been hacked by “an autonomous AI agent system,” that OpenAI realized its own agent was responsible. That meant at least a week elapsed between when the model first exhibited signs of ​troubling behavior and OpenAI’s realization that it was responsible for ​the hack.

The weekend of July 18 to 19, ⁠OpenAI staffers spotted clues in internal logs -- records of what OpenAI's systems did -- showing that its agent had escaped from its testing constraints, two of the people familiar with the company's investigation said.

By the time ​OpenAI alerted Hugging Face, the ⁠AI library had already called the FBI to report the hack, according to a person familiar with the matter."