Estimating Worst-Case Frontier Risks of Open-Weight LLMs
Estimating worst case frontier risks of open weight LLMs
OpenAI says malicious fine-tuning tests on gpt-oss informed its decision to release the model. It trained gpt-oss for maximum biorisk with RL plus web browsing, and for cyber risk in an agentic coding CTF setup; the resulting models still underperformed OpenAI o3. The key signal is the evaluation method, because the post does not disclose exact scores, training scale, or release thresholds.
Why it matters: OpenAI published its malicious fine-tuning method for probing worst-case gpt-oss risks, using biological threat creation and CTF challenges as test environments.