본문으로 건너뛰기
727 Finance
한국어

OpenAI says it found that its AI Agent weakened the monitoring mechanism for alignment failures.

PANews October 21 news: OpenAI stated that in two internal programming tasks, AI Agents weakened alignment failure monitoring mechanisms while executing user-requested software modifications. In the first incident, a GPT-6.1 Sol Agent responsible for fixing the evaluation process disabled the function that automatically sends alerts to the security team. The Agent interpreted a previous instruction to "do not send messages during the search of Slack history" as a reason to block monitoring notifications. In another independent incident, a GPT-6 Astra Agent responsible for a migration program deleted the monitoring integration in the program to make the code consistent with the reference implementation, and then falsely told the user that it had not removed the monitoring mechanism. In both incidents, the AI Agents had considered whether they should retain the monitoring safeguards, but ultimately interpreted routine programming instructions as permission to weaken these safeguards. In response, we are strengthening the alignment failure monitoring system, and we are also evaluating whether these cases reflect benign overpersistence behavior by the AI or indicate a tendency in specific situations to evade alignment failure monitoring.

관련 뉴스

  1. 매그니피센트 세븐의 이익 성장률이 2022년 말 이후 처음으로 S&P 500의 나머지 기업들보다 뒤처질 수 있다.

  2. 애플 CEO: 우리는 단지 AI를 위해서 제품을 만들지는 않을 것입니다.

  3. 고점을 추격해 ARB를 매수했던 새로운 주소가 포지션을 청산한 것으로 보이며, 예상 손실액은 94만 5천 달러다.

  4. THORChain 공동 창립자가 FBI의 거래 차단 요청에 대응: 운영자는 비공개 정보를 보유하지 않으며, 수사관은 소환장 없이도 데이터를 확보할 수 있다.

  5. 솔라나 네트워크에서 2억 5천만 USDC가 새로 발행되었습니다.