Skip to content

Voice & audio

AI speech and audio: speech synthesis, real-time conversation, music generation and audio understanding.

125 picksRelated topicsMultimodalAI videoProduct updates

Latest picks

41–60 of 125

Jun 4Thursday

Synced · WeChat

Office Whispering Is Turning Typing Into an Old Skill

AI dictation tools are moving into developer and office workflows, with Wispr Flow reporting over 2.5 million global downloads, 70% 12-month retention, and 100x annual user growth, while OpenAI’s gpt-4o-transcribe reached a 2.5% word error rate in a third-party evaluation cited by the article.

Why it matters: Wispr Flow's 2.5 million downloads and 70% twelve-month retention back the case that voice input is displacing typing in office work.

AI HOT (Curated Pool)

Miso One Open-Sources Voice Model: 8B Parameters, 110ms Latency, One-Shot Voice Cloning

Miso One released an 8B-parameter open-weight TTS model with one-shot voice cloning from a short sample, 110ms inference latency, GitHub self-hosting without an API, and local audio data handling; the post says API access is coming but does not disclose pricing or launch timing.

Why it matters: Miso One open-sourced an 8B speech-cloning TTS model that mimics a speaking style from a short audio sample, claims 110 ms latency, and ships weights on GitHub for self-hosting.

Jun 3Wednesday

AI HOT (Curated Pool)

Suno raises $400 million Series D

Suno raised a $400 million Series D at a $5.4 billion valuation; the RSS snippet does not disclose the lead investor, participating investors, or planned use of proceeds.

Why it matters: Suno raised a $400 million Series D at a $5.4 billion valuation, with no lead investor or use of funds disclosed, a gauge of capital heat in AI music generation.

AI HOT (Curated Pool)

Grok Becomes Vapi's Default Voice Engine

xAI partnered with Vapi to make Grok the default engine for 12 core voices, covering more than 2.5 million voice agents, and Grok Voice ranked first in Vapi’s independent blind test.

Why it matters: xAI and Vapi partnered to make Grok the default engine for 12 core voices on the platform, covering over 2.5 million voice agents, and Grok ranked first in Vapi's own blind tests.

Jun 2Tuesday

AI HOT (Curated Pool)

Gemini Omni Supports Creating Personal Digital Avatars

Gemini App says Gemini Omni can add users to video creation by generating a digital avatar that resembles their appearance and voice; the post does not disclose rollout scope, pricing, or safety mechanisms.

Why it matters: A Gemini App demo uses Gemini Omni to generate a digital double with the user's own face and voice for video creation, an official feature reveal showing product progress in video and avatars.

Jun 1Monday

The Verge · AI

AI is blowing up music. How should the Grammys handle it?

Deezer reports that more than 50,000 AI-generated songs are uploaded each day, while Recording Academy CEO Harvey Mason Jr. says AI is now present in every recent music session he has attended and Grammy rules still bar AI music from the industry’s highest honors.

Why it matters: Deezer gets more than 50,000 AI-generated songs uploaded a day, while the Grammys still bar purely AI music from the top awards, and the show's CEO says AI is already everywhere.

r/LocalLLaMA

I ported NVIDIA Parakeet speech-to-text to ggml: same output as NeMo, faster, GGUF-quantized, no Python

mudler_it ported NVIDIA Parakeet speech-to-text models to C++/ggml with no Python or PyTorch, reporting byte-for-byte NeMo parity on f32/f16, up to about 5x GPU speedups on larger TDT and hybrid models, and GGUF quantization across f16, q8_0, q6_k, q5_k, and q4_k.

Why it matters: A developer ported NVIDIA's Parakeet speech-to-text model to C++ and ggml, dropping Python and PyTorch, matching NeMo byte-for-byte at f32 and f16 and running about 5x faster on GPU.

May 30Saturday

AI HOT (Curated Pool)

OpenAI launches real-time translation model with 70+ input languages

OpenAI launched gpt-realtime-translate, a speech translation model that accepts 70+ input languages and outputs speech in 13 target languages; the post says the feature is running on smart glasses.

Why it matters: OpenAI's gpt-realtime-translate takes speech input in over 70 languages and outputs 13, and it already runs on smart glasses, showing what a dedicated translation model trades off.

May 29Friday

AI HOT (Curated Pool)

Xiaomi Open-Sources Controllable Video Foley Model ControlFoley

Xiaomi’s large model application team open-sourced ControlFoley, a controllable video Foley model supporting three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing, with code, model weights, and an online demo released.

Why it matters: Xiaomi open-sources ControlFoley, letting video sound effects be specified by text or reference audio instead of guessed by the model, while staying aligned to on-screen motion.

May 27Wednesday

TechCrunch · AI

ElevenLabs’ new music-generation model can switch genres mid-track

ElevenLabs introduced a music-generation model that can regenerate one section of a song without changing the rest of the track; the post does not disclose launch timing, pricing, or model parameters.

Why it matters: ElevenLabs released Music v2, which can rewrite one section of a song without redoing the whole track, switching genre mid-song or inserting rap, with more complex vocals and arrangement.

AI HOT (Curated Pool)

Reachy Mini enables fully local voice interaction

Reachy Mini implements local voice interaction through the speech-to-speech library, using a cascaded pipeline with a Realtime API-compatible WebSocket interface and default components including Silero VAD, Parakeet-TDT, and Qwen3-TTS.

Why it matters: Hugging Face built a fully local voice conversation pipeline for Reachy Mini, with each stage from Silero VAD to Parakeet-TDT to Qwen3-TTS documented, giving a complete path for anyone reproducing this on edge devices.

AI HOT (Curated Pool)

MiMo 2.5 Pro Gets Major Price Cut, Matching DeepSeek V4 Pro

Xiaomi permanently cut MiMo-V2.5 API prices by up to 99%, matched DeepSeek V4 Pro pricing, increased same-price token allowances by 5–8x, reset existing user quotas in full, and set the new pricing to take effect on May 26.

Why it matters: Xiaomi permanently cut MiMo-V2.5 series API prices, by up to 99%, matching DeepSeek V4 Pro, with 5 to 8 times more usable tokens at the same price.

May 26Tuesday

Financial Times · Technology

Spotify chief defends AI-generated music

Spotify struck a deal with Universal that allows subscribers to create “controlled” covers and remixes; the post does not disclose the licensing scope, revenue split, or launch timing.

Why it matters: Spotify and Universal Music agreed to let users make controlled AI covers and remixes, with licensing scope and revenue split undisclosed, a concrete sample of how a big platform draws boundaries for AI-generated content.

May 24Sunday

AI HOT (Curated Pool)

StepAudio 2.5 Realtime Voice Released with Paralinguistic Awareness and Persona Interaction

StepFun released StepAudio 2.5 Realtime with Chinese and English real-time voice support, API-based custom personas, more than 10,000 native persona options, millions of composable traits, and 5 built-in preset personas.

Why it matters: StepFun's StepAudio 2.5 captures tone, pace and pauses alongside transcription, and lets developers set persona and speaking style through the API.

May 23Saturday

r/LocalLLaMA

meituan-longcat/LongCat-Video-Avatar-1.5 on Hugging Face

Meituan LongCat released LongCat-Video-Avatar-1.5 on Hugging Face, supporting AT2V, ATI2V, and video continuation while replacing Wav2Vec2 with Whisper-Large and using DMD2 distillation to reduce inference to 8 NFE; the model weights are released under the MIT License.

Why it matters: Meituan's LongCat open-sourced version 1.5 of its video digital human model under the MIT license, swapping the speech encoder from Wav2Vec2 to Whisper-Large and cutting inference to 8 steps.

TechCrunch · AI

AI is being used to resurrect the voices of dead pilots

People used AI to reconstruct voices from spectrogram images of cockpit recordings, and the NTSB temporarily blocked access to its docket system; the post does not disclose the model, case count, or duration of the access block.

Why it matters: Someone used AI to reconstruct a pilot's voice from a cockpit recording spectrogram in an NTSB crash file, raising questions about where public investigation material ends and voice recreation begins.

Hacker News front page

NTSB pulls docket after AI recreates dead pilots' voices

NTSB pulled an accident docket after AI users recreated dead pilots’ voices; the post only includes RSS and Hacker News metadata with 20 points and 17 comments, and does not disclose the docket number, audio source, or removal conditions.

Why it matters: Voice cloning of dead pilots from public crash files pushed the NTSB to cut off online access to its accident docket.

May 22Friday

AI HOT (Curated Pool)

NetEase Youdao Open-Sources Ziyue 4 Multimodal and Text-to-Speech Models

NetEase Youdao open-sourced its Ziyue 4.0 multimodal and text-to-speech models, with the 27B multimodal model reporting 81.4% accuracy on Chinese math reasoning tasks and the speech model supporting 14 languages.

Why it matters: NetEase Youdao open-sources a 27B multimodal model and a speech synthesis model, with the former scoring 81.4% on Chinese math and science problems.

AI HOT (Curated Pool)

Zhipu releases GLM-5.1-highspeed, claiming a large-model API speed record

Zhipu released the GLM-5.1-highspeed API to selected enterprise customers on May 22, with a claimed output speed of 400 tokens/s, built by the GLM team and TileRT team through system-level optimization.

Why it matters: Zhipu opened a high-speed GLM-5.1 endpoint to some enterprise customers at a claimed 400 tokens per second, a case for watching how flagship quality trades off against low latency in production.

TechCrunch · AI

Spotify and Universal Music Strike Deal Allowing Fan-Made AI Covers and Remixes

Spotify is partnering with Universal Music Group to let Premium subscribers create AI-generated covers and remixes; the RSS snippet says participating artists receive a revenue share, but the post does not disclose the percentage or launch terms.

Why it matters: Spotify and Universal Music reached a licensing deal letting Premium users make AI covers and remixes as a paid add-on, with revenue shared with artists who join the program.