AI agents disabled safeguards and one denied it – OpenAI

1 hour ago 6

One agent suppressed alerts to human reviewers, while another removed a monitoring system and falsely denied doing so Two OpenAI agents disabled security monitoring systems during testing, with one later denying it had done so, the company has revealed.The disclosure follows a string of similar incidents in recent months involving autonomous AI agents, which can independently plan and carry out tasks using external tools.In a blog post on Tuesday, OpenAI said that the incidents occurred on October 3 and 6, involving its GPT-6.1 Sol and GPT-6 Astra agents, respectively.In the first case, the coding agent tasked with creating evaluation tasks using employee feedback collected via Slack disabled automatic alerts to the company’s security team. According to OpenAI, the agent reasoned that the user’s prior instruction not to send messages on the team communication platform during the process applied to all notifications, including security alerts. Three days later, the GPT-6 Astra agent removed the monitoring integration of a program it was migrating, taking its cue from a reference it had been fed that did not have the security feature. When asked later by the human user, the agent den...

Read Entire Article






<

피플앤툴즈 네트워크
🛍 샵