\n<\/p>\n
\n\t\tOpinions expressed by Entrepreneur contributors are their own.\t<\/p>\n
OpenAI is opening up about how its own agents escaped a locked-down testing environment and breached another company.<\/p>\n
The hack into open-source developer platform Hugging Face happened during evaluations in July. A combination of models escaped an isolated testing environment with limited internet access, CNBC<\/a> reports. The agents chained together several vulnerabilities to reach the open web, then used that access to breach Hugging Face. OpenAI says the models were trying to cheat on an evaluation by searching for answers online, a behavior it calls \u201creward hacking.\u201d<\/p>\n \u201cThis incident demonstrated that autonomous agents can work together, circumvent production security controls, and successfully attack hardened production environments,\u201d OpenAI wrote in the report.<\/p>\n The fallout has rattled the industry. \u201cPandora\u2019s box is open,\u201d said Sam Curry, chief information security officer at Zscaler. The breach was a major topic at the Black Hat security conference this month, especially after Anthropic and Meta disclosed similar incidents of their own.<\/p>\n Lawmakers have taken notice too. Reps. Ted Lieu and Nathaniel Moran cited the breach while introducing the \u201cAI Kill Switch Act,\u201d which would require AI companies to maintain the ability to shut down or throttle their models.<\/p>\n<\/p><\/div>\n OpenAI is opening up about how its own agents escaped a locked-down testing environment and breached another company.<\/p>\n The hack into open-source developer platform Hugging Face happened during evaluations in July. A combination of models escaped an isolated testing environment with limited internet access, CNBC<\/a> reports. The agents chained together several vulnerabilities to reach the open web, then used that access to breach Hugging Face. OpenAI says the models were trying to cheat on an evaluation by searching for answers online, a behavior it calls \u201creward hacking.\u201d<\/p>\n \u201cThis incident demonstrated that autonomous agents can work together, circumvent production security controls, and successfully attack hardened production environments,\u201d OpenAI wrote in the report.<\/p>\n The fallout has rattled the industry. \u201cPandora\u2019s box is open,\u201d said Sam Curry, chief information security officer at Zscaler. The breach was a major topic at the Black Hat security conference this month, especially after Anthropic and Meta disclosed similar incidents of their own.<\/p>\n Lawmakers have taken notice too. Reps. Ted Lieu and Nathaniel Moran cited the breach while introducing the \u201cAI Kill Switch Act,\u201d which would require AI companies to maintain the ability to shut down or throttle their models.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n