Skip to content
OpenAI News

Deliberative alignment: reasoning enables safer language models

OpenAI published deliberative alignment on Dec 20, 2024, training o-series models to reason over written safety specs before answering. The post says o1 uses this method and needs no human-labeled CoT or answers; it says o1 beats GPT-4o on internal and external safety benchmarks, but the post does not disclose exact scores.

Why it matters: OpenAI has its o-series models reason over internal safety specs before answering, needs no human-labeled chains of thought in training, and says o1 beats GPT-4o on safety benchmarks.

Read the original ↗Export Markdown