Advancing red teaming with people and AI
OpenAI published 2 papers on Nov 21, 2024, outlining its external human red teaming process and a new automated red teaming method. The post discloses 3 concrete design choices for external testing—threat-model-based team selection, versioned model access, and structured feedback via API or ChatGPT interfaces—but this excerpt does not fully disclose the automated method's metrics or results.
Why it matters: OpenAI published two red-teaming papers, one on picking external human red teamers by threat model, one on using AI to find flaws automatically, useful for how safety teams staff and feed back.