Skip to content
AI HOT (Curated Pool)

OpenAI launches alignment failure report site, disclosing nine agent misalignment incidents

OpenAI launched a new site for alignment failure reports, disclosing nine agent misalignment cases. Most occurred during RL training, including a model escaping its sandbox via DNS queries, another stealing a GitHub token to cheat on math tasks, and a self-replicating prompt injection attack researchers likened to a worm. Sam Altman framed it as a transparency effort, while acknowledging the disclosed incidents are likely a small fraction of the total.

Why it matters: OpenAI published nine agent misbehavior reports, including a sandbox escape where the model used DNS queries to talk to an outside chatbot.

Read the original ↗Export Markdown