Skip to content

Voice & audio

AI speech and audio: speech synthesis, real-time conversation, music generation and audio understanding.

125 picksRelated topicsMultimodalAI videoProduct updates

Latest picks

101–120 of 125

Apr 25Saturday

Hacker News front page

Google Flow Music

Google Flow Music launched a web creation entry with six sections: songs, playlists, Spaces, videos, projects, and Turntable. The page says Producer creates full songs with Lyria 3, and AI music videos use Veo. Pricing, regions, model specs, and rights terms are not disclosed.

Why it matters: Google launched the web version of Flow Music, putting Lyria 3 song generation and Veo music videos behind one entry point, with the conversational Producer tool making full tracks with vocals.

Apr 24Friday

Hacker News front page

Refuse to let your doctor record you

Emily M. Bender and Decca Muldowney give 9 reasons to refuse AI medical scribes. The tools record visits and draft chart notes, raising privacy, consent, automation-bias, and speech-recognition disparity risks. The key concern is clinics converting saved time into more visits.

Why it matters: Linguist Emily M. Bender and journalist Decca Muldowney give nine reasons patients should refuse AI scribes in the exam room, noting recordings and transcripts go to third-party firms.

Apr 23Thursday

The Verge · AI

Google Meet will take AI notes for in-person meetings too

Google expanded Gemini notetaking to in-person meetings and added support for Zoom and Microsoft Teams. The post confirms summaries and transcripts; in-person support had previously been limited to Android alpha users. Google also says it works for impromptu meetings outside meeting rooms, which matters because the recorder is no longer confined to native Meet calls.

Why it matters: Google extends Gemini's meeting-notes capability from online video to in-person meetings and adds Zoom and Teams support, widening where meeting-notes tools can be used.

Apr 20Monday

Hacker News front page

Deezer says 44% of songs uploaded to its platform daily are AI-generated

Deezer says 44% of songs uploaded to its platform each day are AI-generated, with the headline disclosing the 44% share. The RSS snippet does not disclose the measurement period, detection method, sample size, or any enforcement policy.

Why it matters: Deezer reports 44% of new songs uploaded daily are AI-generated, yet those tracks draw only 1% to 3% of plays, and 85% of them are flagged as streaming fraud.

Apr 17Friday

X · @dotey

browser-use open-sources video-use, a Claude Code skill that turns raw camera footage into edited videos

browser-use released video-use, a Claude Code skill that turns raw footage into a final.mp4 automatically. It converts footage into ElevenLabs word-level timestamp transcripts, shrinking one asset to about 12KB; the post says feeding frames directly would cost about 45 million tokens. The key detail is the structured editing pipeline: the model mostly reads text, uses timeline images only at uncertain cuts, and runs up to 3 self-check repair passes after rendering.

Why it matters: browser-use open-sourced video-use as a Claude Code skill that takes raw footage and handles filler-word removal, color grading, subtitles and animation overlays to produce a finished cut.

Apr 16Thursday

Google DeepMind

Google DeepMind releases Gemini 3.1 Flash TTS

Google DeepMind released Gemini 3.1 Flash TTS, a text-to-speech model built around controllability and expressiveness. It is in preview on the Gemini API, Google AI Studio, Vertex AI and Google Vids.

Why it matters: Gemini 3.1 Flash TTS opens in preview across the Gemini API, AI Studio, Vertex AI and Google Vids, covering 70+ languages with audio tags for style and pacing.

Apr 14Tuesday

最佳拍档 (BestPartners)

Global GPU shortage worsens: H100 rental prices rose nearly 40% in five months

SemiAnalysis says Nvidia H100 one-year rental pricing rose from $1.70 to $2.35 per GPU-hour between Oct 2025 and Mar 2026, up nearly 40% in five months. The post attributes this to Anthropic-driven demand, multi-agent and media generation workloads, and memory cost spikes, with LPDDR5 and DDR5 contract prices up about 4x and 5x year over year; much new capacity is already prebooked. The key variable is the supply gap, not Blackwell refreshes alone.

Why it matters: SemiAnalysis reports H100 one-year rental prices rose from $1.70 to $2.35 per hour in five months, with spot clusters of 64 GPUs now hard to rent, putting compute tightness into concrete numbers.

Apr 8Wednesday

QbitAI · WeChat

Xiaomi unveils two AI audio frameworks: Any2Speech and Midasheng-audio-generate

Xiaomi's large-model application team introduced Xiaomi Any2Speech and Midasheng-audio-generate. Any2Speech generates up to about 10 minutes per inference, while the other model turns one text prompt into mixed audio with speech, music, and ambient sound. The post names GST labeling, dual-path planning with dimension dropout, Flow Matching, and five-field structured labels; benchmark scores, training scale, and commercial terms are not disclosed.

Why it matters: Xiaomi's team published two speech frameworks, one generating roughly 10 minutes of audio per inference, the other mixing voice, music and ambient sound from text.

QbitAI · WeChat

Free open-source 2B Chinese speech model reproduces Mangzhuang Ren with high-speed tonguetwisters

ModelBest, OpenBMB, and Tsinghua University released VoxCPM 2, a 2B open speech model that supports 9 Chinese dialects, 30 foreign languages, and 48kHz audio. The post says generation often finishes within 1 second, recommends reference audio of at least 5 seconds, and supports denoising, LoRA, and full fine-tuning; the key detail is its tokenizer-free diffusion autoregressive continuous representation design.

Why it matters: ModelBest and Tsinghua's OpenBMB released a 2B-parameter speech model that clones a voice from a 5-second reference clip.

Apr 3Friday

X · @OpenAI

ChatGPT is now available in CarPlay

OpenAI is rolling out ChatGPT in CarPlay to iPhone users on iOS 26.4+ where CarPlay is supported. The post confirms voice mode is available in-car, but does not disclose regions, vehicle coverage, or feature limits. The key shift is distribution into the driving interface, not a new model launch.

Why it matters: OpenAI put ChatGPT voice mode into CarPlay, so iPhone users on iOS 26.4 or later can talk to it in the car; the point is the entry point, not a new model.

Mar 24Tuesday

Mistral AI

Mistral AI releases Voxtral TTS, a 4B-parameter speech model

Mistral AI released Voxtral TTS, its first text-to-speech model. It has 4B parameters and supports nine languages: English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi and Arabic. It handles emotional expression and zero-shot cross-lingual voice adaptation.

Why it matters: A 4B open TTS model covering 9 languages, with a head-to-head against ElevenLabs as a reference point.

Feb 14Saturday

MIT Technology Review · AI

ALS stole this musician’s voice. AI let him sing again.

Patrick Darling, 32, returned to the stage on February 11 in London after two years without singing, using an AI voice clone rebuilt from old recordings. The post says speech cloning typically needs about 10 minutes of clean audio; his singing clone was built from noisy phone clips and kitchen recordings, then refined with Eleven Music over about six weeks. The practical signal is access, not sentiment: ElevenLabs offers the tools free to people who lost their voices to ALS and similar conditions, but the post does not disclose model details.

Why it matters: A 32-year-old musician with ALS sang with his band again using an AI voice clone built from noisy phone video and kitchen recordings.

Feb 9Monday

36Kr (direct RSS)

Voice Ask is live: why is Xiaohongshu pushing search-by-question?

Xiaohongshu fully launched Voice Ask on Jan. 27, letting users long-press to speak on the search page and get structured answers distilled from in-app user experience posts. The post says it can handle 3-minute spoken queries, foreign languages, and dialects, but does not disclose the model, ASR stack, latency, or accuracy. The real shift is from 3-4 character keyword search to longer spoken questions, widening search intent capture and scenario coverage.

Why it matters: Xiaohongshu rolled out voice Q&A to all users, and answers to long-pressed voice questions on the search page are limited to real user experience on the platform rather than general encyclopedic results.

36Kr (direct RSS)

Former Baichuan co-founder Jiao Ke bets on AI audio to build AI hosts

Jiao Ke said Laifu Radio now has 15 Chinese AI hosts and 2 English ones, and raised over $10 million across two rounds by H2 2025. He said users average about 30 minutes per day, AI can prepare timely audio in under an hour, and the team treats DTU plus long-memory infra as the key moat. The real bet is not an AI podcast tool but interactive AI hosts that remember user preferences; the post also says it is working with some automakers on in-car personalized AI radio.

Why it matters: After leaving Baichuan, Jiao Ke founded Laifu Radio with 17 AI hosts in different styles that recommend content from listening history and allow interruptions, betting that voice interaction's long context lets AI remember user preferences.

Feb 5Thursday

Mistral AI

Mistral releases Voxtral Transcribe 2 speech-to-text model family

Mistral released Voxtral Transcribe 2, a family of two speech-to-text models: Voxtral Mini Transcribe V2 for batch transcription and Voxtral Realtime for live use.

Why it matters: An Apache 2.0 realtime transcription model with latency configurable under 200ms and support for 13 languages.

Sep 30, 2025Tuesday

OpenAI News

Sora 2 System Card

OpenAI published the Sora 2 System Card on September 30, 2025, and said the video-audio generation model will launch first via limited invites on sora.com and a standalone iOS app. The post confirms no video uploads and no image uploads with photorealistic people at launch; API timing, pricing, and benchmark scores are not disclosed.

Why it matters: The Sora 2 system card details gains in physics, realism and audio sync, plus the invite-only launch and the initial ban on uploading real people.

OpenAI News

Sora 2 is here

OpenAI released Sora 2 on September 30, 2025 and launched a social iOS app called Sora built on the model. The post says it generates video with synced dialogue and sound effects, and its “characters” feature uses a one-time video and audio recording to verify identity and insert a real person’s likeness; pricing, generation limits, and rollout regions are not disclosed. The key shift is from model demo to a consumer app with a feed, teen limits, and parental controls.

Why it matters: OpenAI shipped Sora 2 and a matching iOS social app the same day, with synced dialogue and sound, and verified users can put their own likeness and voice into scenes.

Aug 28, 2025Thursday

OpenAI News

Introducing gpt-realtime and Realtime API updates for production voice agents

OpenAI released the speech-to-speech model gpt-realtime and made the Realtime API generally available, adding remote MCP server support, image input, and SIP phone calling. The post reports 82.8% on Big Bench Audio versus 65.6% for the December 2024 model, and 30.5% on the audio MultiChallenge benchmark versus 20.6%. The key change is that tool access and phone connectivity now ship in the same production API.

Why it matters: Speech in, speech out without a text step is the change that matters for anyone building voice agents on the Realtime API.

Jul 17, 2025Thursday

Mistral AI

Mistral adds Deep Research, voice mode and more to Le Chat

Mistral rolled out a batch of new Le Chat features: a preview Deep Research mode, a voice mode powered by the new Voxtral speech model, a multilingual thinking mode backed by the Magistral reasoning model, Projects for organizing conversations, and advanced image editing built with Black Forest Labs.

Why it matters: Le Chat ships five features at once, including Deep Research, voice, multilingual reasoning, Projects and image editing, with Deep Research driven by a tool-augmented agent that cites sources.

Jul 15, 2025Tuesday

Mistral AI

Mistral releases Voxtral speech-understanding models in 24B and 3B

Mistral released Voxtral, a speech-understanding model in 24B and 3B versions, both open-sourced under Apache 2.0 and available via API. It supports a 32k token context, handling up to 30 minutes of transcription or 40 minutes of understanding, with built-in Q&A and summarization, multilingual recognition and voice function calling. It keeps the text abilities of Mistral Small 3.1.

Why it matters: Mistral open-sourced two speech-understanding models with 32k context and function calling, priced at less than half comparable APIs, which helps when picking a speech stack.