Skip to content

#语音

2 today

Today · Nov 17Tuesday · 2 items

OpenAI News

At Holiday Extras, dots get to work before anyone asks

Holiday Extras 员工使用 dots 主动生成产品上线报告、提醒潜在问题,并通过语音讨论即将举行的会议。AI 创新副总裁 Liam Thompson 的 dot 从 Google BigQuery 获取数据后主动提交报告;同事 David Lee 的 dot 在 API 密钥需要停用时检索邮件,列出可能受影响的人。

Google Blog · Gemini

Regional voices are rolling out in the Gemini app.

Gemini 应用在 Android 和 iOS 端上线 66 种新地区语音,覆盖美式英语、英式英语、印度英语、印地语、巴西葡萄牙语、印尼语和韩语等,每种语言都提供定制选项。这些语音针对自然语调和日常清晰度调校,而非夸张口音,用户选定的语音可在 Gemini Live、语言练习和聊天朗读中全局沿用。用户可通过 Gemini Live 的三点菜单或应用设置中的语音选项预览并选择。

Nov 12Thursday

OpenAI News

JioStar’s chief architect on AI discovery at 500M-user scale

JioStar 用 OpenAI API 在 JioHotstar 中构建了对话式视频与板球数据发现助手,支持超过 15 种语言,由小团队约八周完成上线。该平台服务超 5 亿用户,曾支撑 7250 万并发直播体育观众,超 60% 用户偏好语音而非文字输入。团队将准确性、延迟与成本视为三方权衡,并强调评估体系与领域专家在投产中的关键作用。

Google Blog · Gemini

Talk it through with Gemini, now on Apple CarPlay

Google 今天起向全球 iOS Gemini 用户推出 Apple CarPlay 支持,覆盖 Gemini Live 支持的所有语言。用户可在车载屏幕开启或继续语音对话,通过 Gmail 和 Google Calendar 查询日程、了解未读邮件及总结邮件长线程,对话记录会自动同步至 iPhone 上的 Gemini 应用。

Nov 6Friday

OpenAI News

Cult.fit builds operational muscle with Codex

Cult.fit 将 Codex 从工程部门推广到跨职能团队,近几个月非工程团队已构建 20+ 个内部应用。公司用 Codex 重建内部仪表盘功能,节省 $100,000+ 年度软件费用,并通过接入现有客服平台的 AI 智能体将客服成本降低 50%+。其 AI Trainer 还通过 OpenAI API 集成 GPT Realtime,以双向语音提供训练指导并支持记录锻炼。

Oct 27Tuesday

Google Blog · Gemini

15 college students share their favorite Gemini features

Google 邀请 15 名 Google Student Ambassadors 分享他们最常用的 Gemini 功能,涵盖 Study notebooks、Gemini Live、Guided Learning、学习指南生成、自定义测验、无限上传、Audio Overviews、Nano Banana 图像生成和 Chrome 中的 Gemini。

Oct 23Friday

OpenAI News

OpenAI opens Decisions API for faster constrained-answer apps

OpenAI has released the Decisions API, built on GPT-6 Luna. For decisions with a fixed set of answers, it runs up to 10x faster than using GPT-6 Luna through the Responses API.

Why it matters: OpenAI moves constrained classification and routing decisions into a dedicated API, cutting the latency and cost that pile up across high-frequency small decisions in app workflows.

Oct 21Wednesday

Mistral AI

Mistral AI releases Voxtral 3 speech models and a voice agent SDK

Mistral AI released the Voxtral 3 family of speech recognition and speech generation models, plus a real-time voice agent SDK that combines listening, reasoning, tool calls and speaking. Transcription covers 50+ languages with under 500ms real-time latency. Speech generation covers 35+ languages and 50+ dialects, adjusting emotion, pace and accent to context.

Why it matters: Mistral folds recognition, reasoning, tool calls and speech generation into one streaming pipeline, with each stage swappable so a language or voice change doesn't mean rewriting the agent.

Oct 16Friday

OpenAI News

How Localiza reorganized work around generative AI

巴西出行平台 Localiza 将生成式 AI 视为新的计算界面而非单纯生产力工具,围绕三大支柱重组业务:规模化实验、自然语言客户入口和 AI 原生产品。2026 年 3 月,它成为巴西首个、也是拉美首批将应用直接集成进 ChatGPT 的出行平台,用户可在对话中浏览租车、订阅和二手车选项。

Oct 2Friday

Google Blog · Gemini

Google launches Gemini Live Guided Vision as an accessibility aid on Android

Google launched Guided Vision in Gemini Live, which uses real-time visual description and spoken framing prompts to help blind and low-vision users and anyone who needs visual assistance.

Why it matters: Google adds real-time visual description and spoken framing prompts to Gemini Live, letting blind and low-vision users get everyday visual information through conversation.

Sep 25Friday

Google DeepMind

Google DeepMind releases Gemini 3.8 Live with Live Avatar

Google DeepMind released Gemini 3.8 Live with Live Avatar, adding near-real-time video generation to its native real-time conversation model. The result is a dynamic visual avatar with lip sync, natural expressions and smooth turn-taking.

Why it matters: Gemini 3.8 Live adds near-real-time video generation to a live conversation model, with lip sync, switching across 97 languages and asynchronous tool calls mid-dialogue, showing what enterprise multimodal interaction looks like now.

Sep 24Thursday

Google Blog · Gemini

Google launches Gemini 3.8 Live with Live Avatar in Gemini Enterprise

Google launched Gemini 3.8 Live with Live Avatar, pairing near-real-time video generation with native live conversation, available now in Gemini Enterprise. It handles visual and audio input at once, calls tools asynchronously during an ongoing conversation, and syncs lip and facial movement while switching across 97 languages. Enterprises can use preset avatars or customize one from a reference image, though custom creation is limited to an enterprise allowlist. Generated audio and video carry SynthID watermarks.

Why it matters: Google combines live voice conversation with a dynamic avatar and background tool calls, so enterprise support and guided flows don't have to interrupt the conversation to fetch data.

Jun 9Tuesday

Google DeepMind

Google DeepMind releases Gemini 3.5 Live Translate speech model

Google DeepMind released Gemini 3.5 Live Translate, an audio model for near-real-time speech-to-speech translation across more than 70 languages. It detects the language automatically and preserves the speaker's intonation, rhythm and pitch.

Why it matters: Gemini 3.5 Live Translate does continuous speech-to-speech translation across 70-plus languages while keeping the speaker's tone, rhythm and pitch, unlike systems that wait for each sentence.

May 7Thursday

OpenAI News

Advancing Voice Intelligence with New Models in the API

OpenAI introduced new realtime voice models in its API for voice intelligence. The RSS snippet says they reason, translate, and transcribe speech; the post does not disclose counts, pricing, or limits.

Why it matters: OpenAI ships three realtime voice models in the API, with GPT-Realtime-2 calling multiple tools while it reasons and GPT-Realtime-Translate handling 70-plus input languages into 13 output languages.

Apr 30Thursday

Google DeepMind

Google DeepMind announces AI co-clinician medical research program

Google DeepMind announced an AI co-clinician research program, exploring how AI agents can assist patient care under a doctor's clinical supervision. In a blinded evaluation of 98 real primary care queries, the system made no critical errors in 97 cases, and doctors preferred its answers over mainstream evidence synthesis tools. On 140 consultation skills, it matched or beat primary care physicians on 68, but expert physicians were still better overall at spotting red flags and key physical exams.

Why it matters: Google DeepMind details its AI co-clinician research program: in a blinded review of 98 real primary care queries, 97 had no critical errors, and doctors preferred its answers over mainstream evidence synthesis tools.

Apr 16Thursday

Google DeepMind

Google DeepMind releases Gemini 3.1 Flash TTS

Google DeepMind released Gemini 3.1 Flash TTS, a text-to-speech model built around controllability and expressiveness. It is in preview on the Gemini API, Google AI Studio, Vertex AI and Google Vids.

Why it matters: Gemini 3.1 Flash TTS opens in preview across the Gemini API, AI Studio, Vertex AI and Google Vids, covering 70+ languages with audio tags for style and pacing.

Apr 3Friday

X · @OpenAI

ChatGPT is now available in CarPlay

OpenAI is rolling out ChatGPT in CarPlay to iPhone users on iOS 26.4+ where CarPlay is supported. The post confirms voice mode is available in-car, but does not disclose regions, vehicle coverage, or feature limits. The key shift is distribution into the driving interface, not a new model launch.

Why it matters: OpenAI put ChatGPT voice mode into CarPlay, so iPhone users on iOS 26.4 or later can talk to it in the car; the point is the entry point, not a new model.

Mar 24Tuesday

Mistral AI

Mistral AI releases Voxtral TTS, a 4B-parameter speech model

Mistral AI released Voxtral TTS, its first text-to-speech model. It has 4B parameters and supports nine languages: English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi and Arabic. It handles emotional expression and zero-shot cross-lingual voice adaptation.

Why it matters: A 4B open TTS model covering 9 languages, with a head-to-head against ElevenLabs as a reference point.

Feb 5Thursday

Mistral AI

Mistral releases Voxtral Transcribe 2 speech-to-text model family

Mistral released Voxtral Transcribe 2, a family of two speech-to-text models: Voxtral Mini Transcribe V2 for batch transcription and Voxtral Realtime for live use.

Why it matters: An Apache 2.0 realtime transcription model with latency configurable under 200ms and support for 13 languages.

Sep 30, 2025Tuesday

OpenAI News

Sora 2 System Card

OpenAI published the Sora 2 System Card on September 30, 2025, and said the video-audio generation model will launch first via limited invites on sora.com and a standalone iOS app. The post confirms no video uploads and no image uploads with photorealistic people at launch; API timing, pricing, and benchmark scores are not disclosed.

Why it matters: The Sora 2 system card details gains in physics, realism and audio sync, plus the invite-only launch and the initial ban on uploading real people.

OpenAI News

Sora 2 is here

OpenAI released Sora 2 on September 30, 2025 and launched a social iOS app called Sora built on the model. The post says it generates video with synced dialogue and sound effects, and its “characters” feature uses a one-time video and audio recording to verify identity and insert a real person’s likeness; pricing, generation limits, and rollout regions are not disclosed. The key shift is from model demo to a consumer app with a feed, teen limits, and parental controls.

Why it matters: OpenAI shipped Sora 2 and a matching iOS social app the same day, with synced dialogue and sound, and verified users can put their own likeness and voice into scenes.

Aug 28, 2025Thursday

OpenAI News

Introducing gpt-realtime and Realtime API updates for production voice agents

OpenAI released the speech-to-speech model gpt-realtime and made the Realtime API generally available, adding remote MCP server support, image input, and SIP phone calling. The post reports 82.8% on Big Bench Audio versus 65.6% for the December 2024 model, and 30.5% on the audio MultiChallenge benchmark versus 20.6%. The key change is that tool access and phone connectivity now ship in the same production API.

Why it matters: Speech in, speech out without a text step is the change that matters for anyone building voice agents on the Realtime API.

Jul 17, 2025Thursday

Mistral AI

Mistral adds Deep Research, voice mode and more to Le Chat

Mistral rolled out a batch of new Le Chat features: a preview Deep Research mode, a voice mode powered by the new Voxtral speech model, a multilingual thinking mode backed by the Magistral reasoning model, Projects for organizing conversations, and advanced image editing built with Black Forest Labs.

Why it matters: Le Chat ships five features at once, including Deep Research, voice, multilingual reasoning, Projects and image editing, with Deep Research driven by a tool-augmented agent that cites sources.

Jul 15, 2025Tuesday

Mistral AI

Mistral releases Voxtral speech-understanding models in 24B and 3B

Mistral released Voxtral, a speech-understanding model in 24B and 3B versions, both open-sourced under Apache 2.0 and available via API. It supports a 32k token context, handling up to 30 minutes of transcription or 40 minutes of understanding, with built-in Q&A and summarization, multilingual recognition and voice function calling. It keeps the text abilities of Mistral Small 3.1.

Why it matters: Mistral open-sourced two speech-understanding models with 32k context and function calling, priced at less than half comparable APIs, which helps when picking a speech stack.

Mar 21, 2025Friday

OpenAI News

Early methods for studying affective use and emotional well-being on ChatGPT

OpenAI and MIT Media Lab studied affective use on ChatGPT with two tracks: nearly 40 million interactions in an observational analysis and a 4-week RCT with nearly 1,000 participants. The post says emotional engagement is rare overall and concentrated in a small subset of heavy Advanced Voice Mode users; the provided body does not fully disclose all quantitative well-being results. Watch subgroup effects, not platform averages.

Why it matters: OpenAI and MIT paired observational analysis of nearly 40 million conversations with a four-week randomized trial of almost 1,000 people to study ChatGPT's emotional use and mental health.

Mar 20, 2025Thursday

OpenAI News

Introducing next-generation audio models in the API

OpenAI released three API audio models on March 20, 2025: gpt-4o-transcribe, gpt-4o-mini-transcribe, and gpt-4o-mini-tts. The post says the STT models beat Whisper v2 and v3 on FLEURS and other benchmarks across 100+ languages, while the TTS model adds style control but stays limited to monitored preset synthetic voices. The key shift is controllable TTS plus lower WER; the post does not disclose pricing or latency figures.

Why it matters: OpenAI shipped three audio models in the API, two for speech-to-text and one for text-to-speech that learns tone, drawing finer lines around the voice stack.

Oct 1, 2024Tuesday

OpenAI News

Introducing the Realtime API

OpenAI launched a public beta of the Realtime API on Oct. 1, 2024 for all paid developers, using a persistent WebSocket to stream low-latency speech-to-speech interactions with GPT-4o. It supports function calling and interruption handling, priced at $5/1M text input tokens and $100/1M audio input tokens; the post also says audio I/O for Chat Completions would arrive in the following weeks.

Why it matters: Removes the speech-to-text and text-to-speech hops that made voice agents slow.

Aug 8, 2024Thursday

OpenAI News

GPT-4o System Card

OpenAI published the GPT-4o System Card on August 8, 2024, reporting 3 of 4 Preparedness categories as low risk and persuasion as borderline medium. The post says GPT-4o accepts text, audio, image, and video inputs, responds to audio in as little as 232 ms with a 320 ms average, and is 50% cheaper than GPT-4 Turbo in the API. The key issue for practitioners is voice safety: the card names unauthorized voice generation, speaker identification, and sensitive trait attribution, and says only models with post-mitigation scores at medium or below can be deployed.

Why it matters: OpenAI's official system card gives the measured voice latency and names the audio safety risks, so teams can judge the multimodal limits from primary data.

Sep 25, 2023Monday

OpenAI News

ChatGPT can now see, hear, and speak

OpenAI says ChatGPT now supports seeing, hearing, and speaking. The post body is empty, so it does not disclose model versions, rollout timing, regional limits, pricing, or API scope. The real watchpoints are voice latency, vision limits, and access paths.

Why it matters: OpenAI added voice conversation and image understanding to ChatGPT, with speech synthesis from a few seconds of real audio and image input built on multimodal GPT-3.5 and GPT-4.