Introducing gpt-realtime and Realtime API updates for production voice agents
OpenAI released the speech-to-speech model gpt-realtime and made the Realtime API generally available, adding remote MCP server support, image input, and SIP phone calling. The post reports 82.8% on Big Bench Audio versus 65.6% for the December 2024 model, and 30.5% on the audio MultiChallenge benchmark versus 20.6%. The key change is that tool access and phone connectivity now ship in the same production API.
Why it matters: Speech in, speech out without a text step is the change that matters for anyone building voice agents on the Realtime API.