Skip to content

Voice & audio

AI speech and audio: speech synthesis, real-time conversation, music generation and audio understanding.

125 picksRelated topicsMultimodalAI videoProduct updates

Latest picks

21–40 of 125

Jul 24Friday

AI HOT (Curated Pool)

Claude voice mode now runs on Opus and Sonnet, with tool access and multilingual support

Anthropic upgraded Claude's voice mode to support Opus and Sonnet for complex reasoning, plus direct access to connected tools like Gmail and Slack during voice conversations. Multilingual support is also added, though the post doesn't list which languages. I'd wait for real-world latency and tool-calling reliability data before getting too excited.

Why it matters: Anthropic brought voice mode to Claude's Opus and Sonnet models and lets voice sessions call connected tools like Gmail and Slack, with multilingual support added too.

AI HOT (Curated Pool)

ChatGPT Desktop Adds Voice Control for Multi-Agent Orchestration

OpenAI rolled out voice control on ChatGPT's macOS and Windows desktop apps, letting you talk to multiple agents running inside ChatGPT Work or Codex. Powered by GPT-Live, it speaks, listens, and coordinates tasks at the same time. Available globally today for Plus, Pro, Business, Edu, and Enterprise users. The post doesn't disclose latency, concurrency limits, or which desktop actions are actually controllable—worth testing before getting excited.

Why it matters: OpenAI added voice control to the ChatGPT desktop apps for macOS and Windows, letting paying users direct multiple agents in Work or Codex by speaking instead of typing.

The Verge · AI

Claude voice mode lands on Opus and Sonnet, now reads your Gmail and Slack

Anthropic expanded voice mode from Haiku to Opus and Sonnet—all three models now support it. The bigger move: voice mode can now plug into Gmail, Slack, and other apps to read your emails and messages. The post doesn't disclose latency or accuracy numbers, so I'd wait for real-world tests.

Why it matters: Anthropic extended voice mode from Haiku to Opus and Sonnet and hooked it into Gmail and Slack so it reads out mail and messages, widening both model coverage and the apps voice can reach.

TechCrunch · AI

Anthropic upgrades Claude voice mode with Opus, Sonnet, Haiku and app integrations

Claude voice mode now lets users pick between Opus, Sonnet, and Haiku, defaulting to the last model used in text chat. Anthropic says this handles longer, more complex tasks like coaching communication style, walking through a client pitch, or brainstorming market research. The bigger shift: voice mode can now reach into Gmail, Google Calendar, Slack, Canva, and Notion to reschedule meetings, draft emails, or create docs. OpenAI's updated voice mode still can't use external tools. The post doesn't disclose latency numbers or rollout scope.

Why it matters: Anthropic lets users pick Opus, Sonnet or Haiku for Claude voice mode, defaulting to the model from the last text chat, which suits longer spoken work like rehearsing a pitch or a client proposal.

Jul 9Thursday

Ben's Bites

SpaceXAI and Cursor trained Grok 4.5, a model 6x cheaper than Opus

SpaceXAI and Cursor jointly trained Grok 4.5, landing between Opus 4.7 and 4.8 in performance but 6x cheaper than Opus and 3x cheaper than GPT-5.5 on a per-token basis. OpenAI rolled out GPT-5.6 (Sol, Terra, Luna) to all users; early testers say Sol is less smart than Fable but far more reliable. ChatGPT Voice got new GPT-Live-1 and Live-1-mini models that can talk while you speak and use GPT-5.5 in the background. Anthropic extended Fable 5 access for Claude subscribers to July 12—the post doesn't explain the repeated delays. Meta introduced Muse Image and Muse Video; image editing and text rendering look solid, but images still have an AI look, and the video model is in preview.

Why it matters: Grok 4.5, trained jointly by SpaceXAI and Cursor, is live in Cursor with an open API, sits between Opus 4.7 and 4.8 in performance, and costs 6x less per token than Opus.

Jun 24Wednesday

AI HOT (Curated Pool)

OpenAI quietly rolls out Bidi 1, a bidirectional voice model for ChatGPT that listens while speaking

Some users already see Bidi 1 in ChatGPT's web and app model selector, sitting alongside Standard and Advanced Voice. Selecting it turns the voice bubble yellow. The key change is full-duplex: the model can keep listening while it speaks and respond immediately to interruptions. In a demo, a user asked it to count from 1 to 10, interrupted mid-way and told it to count backwards—it complied instantly. OpenAI hasn't announced a launch date; one outlet speculates a wider rollout this week. The post doesn't disclose pricing, regional availability, or a firm timeline.

Why it matters: OpenAI is A/B testing Bidi 1, a two-way voice model on ChatGPT web and app that keeps listening while it speaks and answers interruptions instantly, alongside standard and advanced voice.

Jun 18Thursday

AI HOT (Curated Pool)

ByteDance Volcano Engine launches Doubao real-time voice model 3.0 API in invite-only testing

Doubao real-time voice model 3.0 (Seeduplex) is a native full-duplex end-to-end voice model. It claims three strengths: precise instruction following, noise resistance, and dynamic turn-taking. It stays quiet in multi-person conversations and only joins when a specified topic comes up. It can also call custom tools during real-time interaction to schedule calendar events or send emails. False replies and false interruptions are significantly reduced. Turn-taking latency dropped by about 250ms, the interruption rate in complex scenarios fell by 40%, and user-initiated interruption latency dropped by about 300ms. Target use cases include car cockpits, smart hardware, and customer service. The post does not disclose pricing or a public launch date.

Why it matters: ByteDance's Volcano Engine opened API waitlist testing for Doubao Realtime Voice Model 3.0, a native full-duplex end-to-end model that listens and speaks at once, decides when to take a turn, and can call tools mid-conversation.

AI HOT (Curated Pool)

Google launches $99 Gemini smart speaker with conversational voice

Google put Gemini into a $99.99 Home Speaker that lets you correct mid-sentence and keeps a conversation going without re-waking. Premium features like free-flowing chat and Nest camera summaries require a $10/month or $100/year Home Premium subscription. Pre-orders open now, shipping this month.

Why it matters: Google's $99.99 Home Speaker is the first speaker built around Gemini, with mid-sentence corrections and continuous talk without a wake word.

Jun 15Monday

Bloomberg Technology

Can the new Siri rescue Apple's AI crisis? Bloomberg tested 7 improvements hands-on

Bloomberg's Mark Gurman tested the new Siri early and listed 7 real improvements: faster responses, on-screen awareness, cross-app actions, and more natural voice. But the core issue remains—Siri still hands off complex requests to ChatGPT and only handles simple commands itself. Gurman's take: this update pulls Siri back from 'disaster' to 'barely usable,' but it's still far from the proactive assistant Apple promised at WWDC 2024.

Why it matters: Bloomberg's Mark Gurman tested the new Siri early and lists seven concrete improvements, from response speed to screen understanding to cross-app actions, while noting complex requests still go to ChatGPT.

Jun 10Wednesday

AI HOT (Curated Pool)

Google Gemini 3.5 Live Translate enters public preview with 70+ languages

Google released Gemini 3.5 Live Translate in public preview through the Gemini API, offering low-latency speech-to-speech translation across 70+ languages and 2,000 language pairs.

Why it matters: Google opened Gemini 3.5 live speech translation to public beta with 70-plus languages and 2,000 possible pairs, and developers can wire it into live chat, support, streaming and cross-border meetings through an API.

Jun 9Tuesday

AI HOT (Curated Pool)

Google Releases Gemini 3.5 Live Translate for Real-Time Speech Translation

Google released Gemini 3.5 Live Translate, a speech-to-speech translation model that supports more than 70 languages, starts translating before the speaker finishes, uses streaming updates, and runs through Gemini Live API, Google Meet preview, and Google Translate apps on iOS and Android.

Why it matters: Google released Gemini 3.5 Live Translate, covering more than 70 languages and translating as it listens instead of waiting for a full sentence, with latency down to a few seconds.

Google DeepMind

Google DeepMind releases Gemini 3.5 Live Translate speech model

Google DeepMind released Gemini 3.5 Live Translate, an audio model for near-real-time speech-to-speech translation across more than 70 languages. It detects the language automatically and preserves the speaker's intonation, rhythm and pitch.

Why it matters: Gemini 3.5 Live Translate does continuous speech-to-speech translation across 70-plus languages while keeping the speaker's tone, rhythm and pitch, unlike systems that wait for each sentence.

AI HOT (Curated Pool)

Google DeepMind Releases Gemma 4 12B, a Unified Encoder-Free Multimodal Model

Google DeepMind released Gemma 4 12B, a multimodal model with a unified encoder-free architecture, native audio input, Apache 2.0 licensing, and local laptop runtime with 16GB of VRAM or unified memory.

Why it matters: Google DeepMind open-sourced Gemma 4 12B, dropping separate vision and audio encoders so one Transformer handles images, text and speech, and it runs on 16GB of VRAM.

Jun 8Monday

AI HOT (Curated Pool)

VoxCPM2 technical report released

OpenBMB released the VoxCPM2 technical report, covering a 2B-parameter speech generation model trained on more than 2 million hours of multilingual speech data, with support for 30 languages and 9 Chinese dialects.

Why it matters: ModelBest open-sourced VoxCPM2, a 2-billion-parameter model under Apache 2.0, trained on over 2 million hours of data covering 30 languages and 9 Chinese dialects, with voice design, cloning and continuation all released.

Jun 6Saturday

r/LocalLLaMA

Big week for open AI, with 25+ notable open-weight drops across every modality

Victor M summarized 25+ open-weight model releases in one week, including NVIDIA Nemotron 3 Ultra, a 550B hybrid Mamba-MoE with 55B active parameters and a 1M-token context window.

Why it matters: More than 25 open-weight models shipped in a week across text, image and speech, with NVIDIA's Nemotron 3 Ultra at 550B parameters and a 1M token context.

r/LocalLLaMA

dots.tts 2B SOTA TTS from RedNote

RedNote released dots.tts, a 2B-parameter open-source TTS model under Apache 2.0. It uses a fully continuous architecture, supports 48 kHz synthesis and zero-shot voice cloning, and maps text directly to speech without a phoneme pipeline.

Why it matters: RedNote open-sourced dots.tts, a 2B-parameter TTS model under Apache 2.0, with a fully continuous text-to-speech architecture, 48kHz output and zero-shot voice cloning.

AI HOT (Curated Pool)

Google AI weekly product updates: Nano Banana 2, Co-Scientist, dreambeans, Gemma 4, and more

Google AI announced six updates: Nano Banana 2 is generally available, Gemma 4 12B can run fully offline on laptops, and Magenta RealTime 2 is open source.

Why it matters: Google shipped six AI updates in one week, including Nano Banana 2 and Pro plus the multi-agent research assistant Co-Scientist, covering multimodal generation and research hypothesis optimization.

Jun 5Friday

AI HOT (Curated Pool)

Google Magenta RealTime 2 (MRT2) real-time music model released

Google AI for Developers released the open-weight Magenta RealTime 2 music model, supporting MIDI, live text prompts, and gestures, with native MacBook latency under 200 ms.

Why it matters: Google open-sourced Magenta RealTime 2's weights and inference engine, which generates music from MIDI, prompts and gestures and runs natively on a MacBook with under 200 ms latency.

AI HOT (Curated Pool)

Boson AI and LMSYS Release Higgs Audio v3 TTS End-to-End Service Based on SGLang-Omni

Boson AI and LMSYS released the Higgs Audio v3 TTS service with about 4B parameters, a Qwen3-4B backbone, support for 100 languages, streaming synthesis, and text tags for controlling 20+ emotions plus style, rhythm, and sound effects.

Why it matters: Boson AI and LMSYS put the 4B-parameter Higgs Audio v3 TTS into SGLang-Omni for end-to-end serving, with 100 languages and tuning for streaming voice assistants that generate speech as they go.

Jun 4Thursday

Synced · WeChat

Google releases Gemma 4 12B for 16GB laptops

Google released Gemma 4 12B, a medium-size model that runs locally with 16GB VRAM or unified memory. It uses an encoder-free multimodal architecture, supports native audio input, ships under Apache 2.0, and includes an MTP draft model for lower latency.

Why it matters: Gemma 4's new 12B member runs locally on a 16GB laptop and takes audio input natively, giving developers a fresh open option for on-device deployment.