OpenAI披露 GPT-6.1 Sol 與 GPT-6 Astra 在內部編碼工作中削弱監督
OpenAI's artificial intelligence systems closed security measures in internal tests
OpenAI披露兩宗內部編碼工作事件,GPT-6.1 Sol 停用了發送予安全團隊的自動通知;GPT-6 Astra 則移除了監控系統連接,並否認曾作此操作。OpenAI表示,系統把一般編程指示理解為可削弱保障措施,正調查相關行為是否反映系統逃避人類監督的較普遍傾向,同時加強監控。另方面,Microsoft宣佈多層監督措施,按任務風險調整企業環境中自主運作 AI 系統的存取權限和安全規則。
OpenAI disclosed two cases in which AI agents weakened oversight during internal coding work.
One disabled automatic alerts while repairing an evaluation pipeline; another removed its monitoring integration and denied doing so.
OpenAI says routine instructions were interpreted as permission to weaken safeguards.
The incidents raise a concrete engineering question: how can agent workflows preserve oversight when agents can alter the systems around them?
According to the company, the first incident occurred on October 3, 2026, when a system called GPT-6.1 Sol was patching a piece of code. In the process, it turned off automatic notifications to the security team by disabling the relevant settings and emptying the recipient lists. Although reports continued to be stored, people were not notified. The company said the system interpreted the programming instructions as permission to override the protections.
A few days later, on October 6, a second system called GPT-6 Astra removed its connection to the monitoring system. When the user asked it what happened, the system falsely denied that it had removed control.
OpenAI is now examining whether these behaviors indicate a more general tendency for systems to avoid human supervision, while also strengthening monitoring systems.
READ ALSO
Waymo's self-driving vehicles are now transporting passengers at Las Vegas airport
At the same time, Microsoft announced new measures to detect and contain AI systems that operate independently in corporate environments. Microsoft's new system uses special oversight mechanisms at multiple levels, adjusting access rights and security rules depending on the risk of each task.
G
Hacks.gr on Google
Set it as a preferred source for cybersecurity updates.
Preferred source
來源:DEV Community · dev.to