Skip to content

Voice & audio

AI speech and audio: speech synthesis, real-time conversation, music generation and audio understanding.

125 picksRelated topicsMultimodalAI videoProduct updates

Latest picks

1–20 of 125

Oct 29Thursday

The Decoder

Nvidia releases open speech model Nemotron 3.5 Transcribe for transcription, translation and speaker ID

Nvidia released Nemotron 3.5 Transcribe, an open speech model that handles transcription, translation, speaker recognition and audio question answering through text instructions. Fine-tuning it on mostly synthetic speech data for medical transcription cut the error rate from 23.8% to 11.8%, and Nvidia also documented the loss in general English accuracy that came with it.

Why it matters: The medical fine-tune halves the error rate, and Nvidia reports the general English accuracy it gave up to get there.

Oct 23Friday

OpenAI News

OpenAI opens Decisions API for faster constrained-answer apps

OpenAI has released the Decisions API, built on GPT-6 Luna. For decisions with a fixed set of answers, it runs up to 10x faster than using GPT-6 Luna through the Responses API.

Why it matters: OpenAI moves constrained classification and routing decisions into a dedicated API, cutting the latency and cost that pile up across high-frequency small decisions in app workflows.

Oct 21Wednesday

Mistral AI

Mistral AI releases Voxtral 3 speech models and a voice agent SDK

Mistral AI released the Voxtral 3 family of speech recognition and speech generation models, plus a real-time voice agent SDK that combines listening, reasoning, tool calls and speaking. Transcription covers 50+ languages with under 500ms real-time latency. Speech generation covers 35+ languages and 50+ dialects, adjusting emotion, pace and accent to context.

Why it matters: Mistral folds recognition, reasoning, tool calls and speech generation into one streaming pipeline, with each stage swappable so a language or voice change doesn't mean rewriting the agent.

Oct 15Thursday

AI HOT · Products

xAI releases Grok Voice 3.0, keeps Voice Agent API pricing unchanged

xAI released Grok Voice 3.0, a speech-to-speech model available today through the Voice Agent API with sub-second latency. It ranks first on Artificial Analysis's Speech-to-Speech Index at 86.9 and scores 71.6% on τ-Voice, close to GPT-Live-1 (Astra) but with 40% lower latency.

Why it matters: Grok Voice 3.0 matches GPT-Live-1 on customer-service call tests while cutting latency by 40%.

Oct 13Tuesday

Hacker News front page

Apple HomeView puts Siri AI in a home hub with personal assistant and smart home control

Apple HomeView runs a Siri AI built on Apple Intelligence, combining personal context, knowledge questions and smart home control into a home assistant. The device has an A18 chip and a 7-inch Liquid Retina display and can recognize up to six users. Reaching personal content requires a paired iPhone or iPad on the same Wi-Fi, recently unlocked, plus face recognition.

Why it matters: Apple HomeView brings a personalized assistant to a shared household device, using face recognition and paired-device conditions to separate personal content from what guests can use.

Oct 9Friday

Simon Willison

Simon Willison builds a blog newsletter index with Codex voice mode

Simon Willison built a blog Newsletters index almost entirely through Codex voice mode, then finished deployment with keyboard prompts and code review. Talking to GPT-6 Astra High in the Codex tab of the ChatGPT desktop app while cooking, he got the Django data model, four import paths, archive pages and search integration done in about half an hour, then spent another half hour fixing the API import for a private GitHub repo and the page display.

Why it matters: Willison split voice-driven building from keyboard review, using speech for the bulk of the feature and typing to fix the import code.

Oct 2Friday

Google Blog · Gemini

Google launches Gemini Live Guided Vision as an accessibility aid on Android

Google launched Guided Vision in Gemini Live, which uses real-time visual description and spoken framing prompts to help blind and low-vision users and anyone who needs visual assistance.

Why it matters: Google adds real-time visual description and spoken framing prompts to Gemini Live, letting blind and low-vision users get everyday visual information through conversation.

Sep 30Wednesday

AI HOT · Models

ElevenLabs ships Eleven v4 and low-latency Turbo for expressive speech

ElevenLabs released the text-to-speech model Eleven v4 and a low-latency version, Eleven v4 Turbo, with stronger emotional expression, speaker consistency and multi-speaker dialogue. Both support more than 90 languages, and Instant Voice Clones need only 10 seconds of audio. Turbo's median inference latency is about 100ms, with about 150ms from request to audible speech.

Why it matters: ElevenLabs pairs emotional control with low latency in Eleven v4 Turbo, so voice agents can answer fast and still sound natural.

Sep 25Friday

Google DeepMind

Google DeepMind releases Gemini 3.8 Live with Live Avatar

Google DeepMind released Gemini 3.8 Live with Live Avatar, adding near-real-time video generation to its native real-time conversation model. The result is a dynamic visual avatar with lip sync, natural expressions and smooth turn-taking.

Why it matters: Gemini 3.8 Live adds near-real-time video generation to a live conversation model, with lip sync, switching across 97 languages and asynchronous tool calls mid-dialogue, showing what enterprise multimodal interaction looks like now.

TechCrunch · AI

Google tests letting Gemini call businesses for you

Google is testing 'Call for Me,' letting Gemini make calls to businesses. It's limited to US Pixel 11 owners with a Gemini subscription, using the beta Google Phone app. Gemini can now share user-approved personal info, expanding what it can do. You can follow the call live and take over anytime. The post doesn't disclose a launch date, pricing changes, or the business-side experience.

Why it matters: Google began testing Call for Me, which lets Gemini phone businesses on a user's behalf, starting with US paying subscribers on Pixel 11 who also run the beta phone app.

Sep 24Thursday

Google Blog · Gemini

Google launches Gemini 3.8 Live with Live Avatar in Gemini Enterprise

Google launched Gemini 3.8 Live with Live Avatar, pairing near-real-time video generation with native live conversation, available now in Gemini Enterprise. It handles visual and audio input at once, calls tools asynchronously during an ongoing conversation, and syncs lip and facial movement while switching across 97 languages. Enterprises can use preset avatars or customize one from a reference image, though custom creation is limited to an enterprise allowlist. Generated audio and video carry SynthID watermarks.

Why it matters: Google combines live voice conversation with a dynamic avatar and background tool calls, so enterprise support and guided flows don't have to interrupt the conversation to fetch data.

Latent Space

Meta Connect 2026: Muse agent lands on glasses, voice, video, and a new Charm gadget

Meta positioned Muse as the core of a hardware-plus-agent play at Connect. Muse now does voice and real-time video, handles long background conversations, and gets its own email address you can CC. Mac computer use lets you queue jobs and walk away. It's free for now but may take a transaction cut later; retail partners include Walmart, Best Buy, and Sephora, with productivity connectors for Box, GitHub, and Notion. Hardware updates: Ray-Ban Meta Gen 3 with better battery and mics, plus Charm, a standalone handheld gadget. No new frontier model shipped—only an MSL tease.

Why it matters: At Connect 2026 Meta put its Muse assistant into the glasses with voice and live video, and teased a standalone email and Mac control, showing how its hardware and agent plans fit together.

The Verge · AI

Meta unveils Muse Charm, a standalone AI gadget that looks like a strapless smartwatch

Meta teased the Muse Charm at the end of Connect, a dedicated hardware device for its Muse AI agent. It resembles a chunky strapless smartwatch with a lanyard. A fingerprint sensor on the top right activates voice input; the front has at least three mic holes and a small camera. Zuckerberg noted you don't need to unlock a phone to use it. The post doesn't disclose pricing, battery life, or a release date.

Why it matters: Meta closed its Connect event with Muse Charm, a standalone AI device where a fingerprint press starts a conversation with the Muse agent without unlocking a phone.

The Verge · AI

Meta is bringing its Muse AI agent to smart glasses with voice activation

Two weeks after launching Muse, Meta says it's working on bringing the agent to its smart glasses, including the new ones shown at Connect. You'll activate it by saying its name and can ask it to guide workouts, log meals, or help shop for products you're looking at. The glasses are also getting an FDA-cleared hearing enhancement feature for adults with mild to moderate hearing loss. The post doesn't specify a launch date or which models will get Muse.

Why it matters: Meta says it is working on bringing its two-week-old Muse assistant to its smart glasses, where a spoken name triggers workout coaching, meal logging or price checks.

AI HOT (Curated Pool)

GPT Voice now uses tools like email, calendar, and Slack, and lands on ChatGPT Work

Greg Brockman announced that GPT Voice can now use tools like email, calendar, and Slack, powered by GPT-6 Astra, Sol, and Luna. Voice also lands on ChatGPT Work across web and mobile, letting users create docs, presentations, websites, or sheets hands-free in the browser. Rolling out globally today in the latest app version. The post doesn't disclose latency, accuracy, or enterprise access details, so I'd discount the demo until we see real-world numbers.

Why it matters: Greg Brockman says upgraded GPT Voice can call email, calendar and Slack and lands in ChatGPT Work, moving voice from chat to actual office tasks.

AI HOT (Curated Pool)

ChatGPT Voice now calls email, calendar, Slack plugins, powered by GPT-6 Astra, Sol, Luna

OpenAI added plugin access to ChatGPT Voice so it can work across email, calendar, and Slack. Voice is live on ChatGPT Work web and mobile, letting users create docs, decks, sites, and spreadsheets by speaking. OpenAI says it's powered by GPT-6 Astra, Sol, and Luna, rolling out globally in the latest app version the same day. The post doesn't cover plugin permission scopes, latency, or pricing.

Why it matters: OpenAI wires voice into email, calendar and Slack plugins, says three GPT-6 models drive it, and lets ChatGPT Work users on web and mobile generate docs, decks, sites and sheets by speaking.

AI HOT (Curated Pool)

OpenAI adds Mail, Calendar, Slack plugins to ChatGPT Voice, powered by GPT-6 Astra, Sol, Luna

ChatGPT Voice now works with Mail, Calendar, and Slack plugins, running on GPT-6 Astra, Sol, and Luna. ChatGPT Work on web and mobile also gets voice input—you can create docs, presentations, websites, or sheets by speaking. The post doesn't disclose rollout regions, latency, or plugin permission details.

Why it matters: ChatGPT voice now reaches email, calendar and Slack plugins and runs on GPT-6 series models, so office voice use moves from conversation to cross-app tasks.

Aug 10Monday

Hacker News front page

Kinney Drugs pulls AI phone assistant after hundreds of complaints

Kinney Drugs rolled back its AI phone assistant Burt after three months, following customer reports of incoherent calls, wrong dosages, and missed prescription alerts. President John Marraffa said HIPAA compliance doesn't equal a good experience. Incoming patient calls return to a touch-tone system; Burt stays only for opt-in refill texts. The article does not name the underlying model or voice vendor.

Why it matters: Kinney Drugs pulled its AI phone assistant after three months and hundreds of complaints about wrong dosages and missed refill reminders, with its president admitting compliance is not the same as a good experience.

Jul 28Tuesday

Ben's Bites

Claude Opus 5 ships at half the price of Fable 5, but early users say it argues and stops early

Anthropic released Claude Opus 5 at half the cost of Fable 5, claiming near-parity. Every's review found it argues, stops early, and fights old prompting habits. Anthropic cut over 80% of Claude Code's system prompt for Opus 5 and Fable 5 with no measurable coding-eval loss. Theo spent hours rewriting CLAUDE.md and skills files and called it worth it. ChatGPT Voice now controls the desktop app inside Work and Codex, spawning new sessions for tasks and reporting back—like a voice-driven OpenClaw. Keshav found it weaker for serious work than manually using 5.6 Sol in Codex, but decent for email, dashboards, and charts. Claude's voice mode quietly added Sonnet and Opus support plus mid-conversation tool calls to Gmail, Calendar, and Slack. Kimi K3 weights and tech report are public, with a 50% discount on Droid until Aug 10. Jensen Huang posted on X for the first time amid rumors of a US ban on Chinese open-weight models.

Why it matters: Anthropic released Claude Opus 5 at half the price of Fable 5, and Every's review records it arguing and stopping before tasks are done, yet the same reviewer ranked it first in a blind test.

Jul 24Friday

TechCrunch · AI

OpenAI brings its new voice mode to the ChatGPT desktop app, letting it control agents and apps

ChatGPT's desktop app now accepts voice commands that can control agents and perform multi-step tasks. It uses the ChatGPT-Live voice models launched earlier this month, works with ChatGPT Work and Codex, and can browse websites and apps. On macOS, Appshots lets it read screen content. A demo showed a developer asking ChatGPT to create a thread, make a pull request, and find a bug's root cause in one go. The smartphone version only handled conversation; the desktop update adds real execution. Anthropic also updated Claude's voice mode yesterday to operate Gmail, Slack, and other apps.

Why it matters: OpenAI put the ChatGPT-Live voice model it shipped earlier this month into the desktop app, so users can direct agents and browse by voice and read screen content on macOS through Appshots.