Defining and evaluating political bias in LLMs
OpenAI published a political-bias evaluation using about 500 prompts across 100 topics and five bias axes to test ChatGPT objectivity in realistic conversations. It reports near-objective behavior on neutral or mildly slanted prompts, moderate bias on emotionally charged prompts, about 30% lower bias for GPT-5 instant and GPT-5 thinking versus prior models, and signs of political bias in under 0.01% of sampled production replies.
Why it matters: About 500 questions across 100 topics, five phrasings from far left to far right, test whether ChatGPT leans, gives one side, or follows the user.