Skip to content

#语音

4 today

Jun 4Thursday

Synced · WeChat

Google releases Gemma 4 12B for 16GB laptops

Google released Gemma 4 12B, a medium-size model that runs locally with 16GB VRAM or unified memory. It uses an encoder-free multimodal architecture, supports native audio input, ships under Apache 2.0, and includes an MTP draft model for lower latency.

Why it matters: Gemma 4's new 12B member runs locally on a 16GB laptop and takes audio input natively, giving developers a fresh open option for on-device deployment.

Synced · WeChat

Office Whispering Is Turning Typing Into an Old Skill

AI dictation tools are moving into developer and office workflows, with Wispr Flow reporting over 2.5 million global downloads, 70% 12-month retention, and 100x annual user growth, while OpenAI’s gpt-4o-transcribe reached a 2.5% word error rate in a third-party evaluation cited by the article.

Why it matters: Wispr Flow's 2.5 million downloads and 70% twelve-month retention back the case that voice input is displacing typing in office work.

AI HOT (Curated Pool)

Miso One Open-Sources Voice Model: 8B Parameters, 110ms Latency, One-Shot Voice Cloning

Miso One released an 8B-parameter open-weight TTS model with one-shot voice cloning from a short sample, 110ms inference latency, GitHub self-hosting without an API, and local audio data handling; the post says API access is coming but does not disclose pricing or launch timing.

Why it matters: Miso One open-sourced an 8B speech-cloning TTS model that mimics a speaking style from a short audio sample, claims 110 ms latency, and ships weights on GitHub for self-hosting.

Jun 3Wednesday

AI HOT (Curated Pool)

Suno raises $400 million Series D

Suno raised a $400 million Series D at a $5.4 billion valuation; the RSS snippet does not disclose the lead investor, participating investors, or planned use of proceeds.

Why it matters: Suno raised a $400 million Series D at a $5.4 billion valuation, with no lead investor or use of funds disclosed, a gauge of capital heat in AI music generation.

AI HOT (Curated Pool)

Grok Becomes Vapi's Default Voice Engine

xAI partnered with Vapi to make Grok the default engine for 12 core voices, covering more than 2.5 million voice agents, and Grok Voice ranked first in Vapi’s independent blind test.

Why it matters: xAI and Vapi partnered to make Grok the default engine for 12 core voices on the platform, covering over 2.5 million voice agents, and Grok ranked first in Vapi's own blind tests.

Jun 2Tuesday

AI HOT (Curated Pool)

Gemini Omni Supports Creating Personal Digital Avatars

Gemini App says Gemini Omni can add users to video creation by generating a digital avatar that resembles their appearance and voice; the post does not disclose rollout scope, pricing, or safety mechanisms.

Why it matters: A Gemini App demo uses Gemini Omni to generate a digital double with the user's own face and voice for video creation, an official feature reveal showing product progress in video and avatars.

Jun 1Monday

The Verge · AI

AI is blowing up music. How should the Grammys handle it?

Deezer reports that more than 50,000 AI-generated songs are uploaded each day, while Recording Academy CEO Harvey Mason Jr. says AI is now present in every recent music session he has attended and Grammy rules still bar AI music from the industry’s highest honors.

Why it matters: Deezer gets more than 50,000 AI-generated songs uploaded a day, while the Grammys still bar purely AI music from the top awards, and the show's CEO says AI is already everywhere.

r/LocalLLaMA

I ported NVIDIA Parakeet speech-to-text to ggml: same output as NeMo, faster, GGUF-quantized, no Python

mudler_it ported NVIDIA Parakeet speech-to-text models to C++/ggml with no Python or PyTorch, reporting byte-for-byte NeMo parity on f32/f16, up to about 5x GPU speedups on larger TDT and hybrid models, and GGUF quantization across f16, q8_0, q6_k, q5_k, and q4_k.

Why it matters: A developer ported NVIDIA's Parakeet speech-to-text model to C++ and ggml, dropping Python and PyTorch, matching NeMo byte-for-byte at f32 and f16 and running about 5x faster on GPU.

May 30Saturday

AI HOT (Curated Pool)

OpenAI launches real-time translation model with 70+ input languages

OpenAI launched gpt-realtime-translate, a speech translation model that accepts 70+ input languages and outputs speech in 13 target languages; the post says the feature is running on smart glasses.

Why it matters: OpenAI's gpt-realtime-translate takes speech input in over 70 languages and outputs 13, and it already runs on smart glasses, showing what a dedicated translation model trades off.

May 29Friday

AI HOT (Curated Pool)

Xiaomi Open-Sources Controllable Video Foley Model ControlFoley

Xiaomi’s large model application team open-sourced ControlFoley, a controllable video Foley model supporting three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing, with code, model weights, and an online demo released.

Why it matters: Xiaomi open-sources ControlFoley, letting video sound effects be specified by text or reference audio instead of guessed by the model, while staying aligned to on-screen motion.

May 27Wednesday

TechCrunch · AI

ElevenLabs’ new music-generation model can switch genres mid-track

ElevenLabs introduced a music-generation model that can regenerate one section of a song without changing the rest of the track; the post does not disclose launch timing, pricing, or model parameters.

Why it matters: ElevenLabs released Music v2, which can rewrite one section of a song without redoing the whole track, switching genre mid-song or inserting rap, with more complex vocals and arrangement.

AI HOT (Curated Pool)

Reachy Mini enables fully local voice interaction

Reachy Mini implements local voice interaction through the speech-to-speech library, using a cascaded pipeline with a Realtime API-compatible WebSocket interface and default components including Silero VAD, Parakeet-TDT, and Qwen3-TTS.

Why it matters: Hugging Face built a fully local voice conversation pipeline for Reachy Mini, with each stage from Silero VAD to Parakeet-TDT to Qwen3-TTS documented, giving a complete path for anyone reproducing this on edge devices.

AI HOT (Curated Pool)

MiMo 2.5 Pro Gets Major Price Cut, Matching DeepSeek V4 Pro

Xiaomi permanently cut MiMo-V2.5 API prices by up to 99%, matched DeepSeek V4 Pro pricing, increased same-price token allowances by 5–8x, reset existing user quotas in full, and set the new pricing to take effect on May 26.

Why it matters: Xiaomi permanently cut MiMo-V2.5 series API prices, by up to 99%, matching DeepSeek V4 Pro, with 5 to 8 times more usable tokens at the same price.

May 26Tuesday

Financial Times · Technology

Spotify chief defends AI-generated music

Spotify struck a deal with Universal that allows subscribers to create “controlled” covers and remixes; the post does not disclose the licensing scope, revenue split, or launch timing.

Why it matters: Spotify and Universal Music agreed to let users make controlled AI covers and remixes, with licensing scope and revenue split undisclosed, a concrete sample of how a big platform draws boundaries for AI-generated content.

May 24Sunday

AI HOT (Curated Pool)

StepAudio 2.5 Realtime Voice Released with Paralinguistic Awareness and Persona Interaction

StepFun released StepAudio 2.5 Realtime with Chinese and English real-time voice support, API-based custom personas, more than 10,000 native persona options, millions of composable traits, and 5 built-in preset personas.

Why it matters: StepFun's StepAudio 2.5 captures tone, pace and pauses alongside transcription, and lets developers set persona and speaking style through the API.

May 23Saturday

r/LocalLLaMA

meituan-longcat/LongCat-Video-Avatar-1.5 on Hugging Face

Meituan LongCat released LongCat-Video-Avatar-1.5 on Hugging Face, supporting AT2V, ATI2V, and video continuation while replacing Wav2Vec2 with Whisper-Large and using DMD2 distillation to reduce inference to 8 NFE; the model weights are released under the MIT License.

Why it matters: Meituan's LongCat open-sourced version 1.5 of its video digital human model under the MIT license, swapping the speech encoder from Wav2Vec2 to Whisper-Large and cutting inference to 8 steps.

TechCrunch · AI

AI is being used to resurrect the voices of dead pilots

People used AI to reconstruct voices from spectrogram images of cockpit recordings, and the NTSB temporarily blocked access to its docket system; the post does not disclose the model, case count, or duration of the access block.

Why it matters: Someone used AI to reconstruct a pilot's voice from a cockpit recording spectrogram in an NTSB crash file, raising questions about where public investigation material ends and voice recreation begins.

Hacker News front page

NTSB pulls docket after AI recreates dead pilots' voices

NTSB pulled an accident docket after AI users recreated dead pilots’ voices; the post only includes RSS and Hacker News metadata with 20 points and 17 comments, and does not disclose the docket number, audio source, or removal conditions.

Why it matters: Voice cloning of dead pilots from public crash files pushed the NTSB to cut off online access to its accident docket.

May 22Friday

AI HOT (Curated Pool)

NetEase Youdao Open-Sources Ziyue 4 Multimodal and Text-to-Speech Models

NetEase Youdao open-sourced its Ziyue 4.0 multimodal and text-to-speech models, with the 27B multimodal model reporting 81.4% accuracy on Chinese math reasoning tasks and the speech model supporting 14 languages.

Why it matters: NetEase Youdao open-sources a 27B multimodal model and a speech synthesis model, with the former scoring 81.4% on Chinese math and science problems.

AI HOT (Curated Pool)

Zhipu releases GLM-5.1-highspeed, claiming a large-model API speed record

Zhipu released the GLM-5.1-highspeed API to selected enterprise customers on May 22, with a claimed output speed of 400 tokens/s, built by the GLM team and TileRT team through system-level optimization.

Why it matters: Zhipu opened a high-speed GLM-5.1 endpoint to some enterprise customers at a claimed 400 tokens per second, a case for watching how flagship quality trades off against low latency in production.

TechCrunch · AI

Spotify and Universal Music Strike Deal Allowing Fan-Made AI Covers and Remixes

Spotify is partnering with Universal Music Group to let Premium subscribers create AI-generated covers and remixes; the RSS snippet says participating artists receive a revenue share, but the post does not disclose the percentage or launch terms.

Why it matters: Spotify and Universal Music reached a licensing deal letting Premium users make AI covers and remixes as a paid add-on, with revenue shared with artists who join the program.

May 21Thursday

The Verge · AI

Spotify is launching AI-generated remixes

Spotify and UMG announced a licensing deal that lets Premium subscribers pay for AI-generated remixes and covers of streaming songs; artists can opt out, while participating artists collect royalties from these AI remixes.

Why it matters: Spotify and Universal Music will let paying users make AI remixes and covers, with artists able to opt out and share royalties.

Financial Times · Technology

Spotify targets high-spending superfans with AI-generated music

Spotify and Universal Music Group struck a licensing deal for a paid AI-generated music add-on inside Spotify’s app, targeting high-spending superfans; the RSS snippet does not disclose pricing, launch timing, supported markets, or model details.

Why it matters: Spotify's licensing deal with Universal Music will put paid AI music generation inside the app for high-spending fans, turning generation into a paid product within the subscription.

May 20Wednesday

AI HOT (Curated Pool)

Stability AI Launches Stability Audio 3.0 for Songs Up to 6 Minutes

Stability AI launched the Stability Audio 3.0 audio generation model family with four sizes ranging from 459 million to 2.7 billion parameters; the small model targets on-device use and generates audio under 2 minutes locally, while medium and large models support full music creation beyond 6 minutes and 20 seconds.

Why it matters: Stability AI released four audio models, the two smallest run locally, the mid and large models push generation to 6 minutes 20 seconds, double the previous generation, and the small and mid models are open-sourced.

TechCrunch · AI

Stability AI releases a new audio model that can create 6-minute songs

Stability AI released Stability Audio 3.0 small; the title says it can create six-minute songs, while the RSS snippet only discloses that the small model can run on-device and generate two-minute tracks.

Why it matters: Stability AI's Stable Audio 3.0 doubles track length to 6 minutes 20 seconds, and two of the four models run locally with open weights.

AI HOT (Curated Pool)

Gemini Omni Supports Video Creation With Personal Likeness and Voice

Gemini Omni lets users create digital-avatar videos using their personal likeness and voice, and the avatar can generate videos without uploading an image each time; the post does not disclose pricing, regions, or launch timing.

Why it matters: Gemini Omni lets users build a digital double from their own face and voice, then reuse it for on-camera videos without re-uploading photos each time.

TechCrunch · AI

You Can Now Talk to Your Gmail Inbox, as Seen at Google I/O 2026

Google expanded Gmail’s AI Inbox with conversational voice search, letting users ask Gemini to find details buried in email. The RSS snippet does not disclose rollout scope, supported languages, pricing, latency, or the retrieval mechanism behind Gmail search.

Why it matters: Google put voice conversation search into Gmail, so users can ask Gemini to pull specific details out of their mail.

TechCrunch · AI

Google takes a page from Meta, announces audio-powered smart glasses at I/O 2026

Google announced “audio glasses” at I/O 2026, letting users issue voice commands across its apps and services, including Gemini; the RSS snippet does not disclose price, launch timing, or hardware specifications.

Why it matters: Google put Gemini in screenless audio glasses that work on both Android and iOS, a direct answer to Meta's Ray-Ban line.

The Verge · AI

Gmail is going to start talking to you

Google is launching Gmail Live for Gmail, letting users tap a search-bar icon and ask voice questions about inbox content; a press demo retrieved school event dates, locations, and an upcoming Detroit trip from the employee’s email.

Why it matters: Gmail Live lets users ask questions out loud in the search bar to pull dates and trip details from their inbox.

TechCrunch · AI

Google's Gemini Omni turns images, audio, and text into video

Google's Gemini Omni generates and edits video through conversation, using text, images, audio, and video as inputs, with Omni Flash named as the starting version; the RSS snippet says the model reasons across modalities, but the post does not disclose launch date, pricing, context limits, benchmarks, or API availability.

Why it matters: Gemini Omni takes text, images, audio and video as input and generates or edits video through conversation, with the first release, Omni Flash, focused on cross-modal reasoning.

AI HOT (Curated Pool)

Google launches Antigravity 2.0 platform, builds an OS in 12 hours

Google announced Antigravity 2.0 at I/O and demonstrated an agent building a runnable operating system from scratch in 12 hours, using 93 parallel sub-agents, more than 15,000 model calls, and 2.6 billion tokens, with API costs under $1,000.

Why it matters: Google's I/O demo used 93 parallel sub-agents, 15,000 model calls and 2.6 billion tokens to build a working OS in 12 hours for under $1,000 in API cost.

AI HOT (Curated Pool)

Google releases Gemini Omni for any-input-to-any-output generation and conversational video editing

Google released Gemini Omni and Omni Flash at I/O 2026, supporting text, image, audio, and video inputs and outputs, with conversational video editing; Omni Flash is available in Gemini App, Google Flow, and YouTube Shorts, while the post does not disclose the API launch date.

Why it matters: Google's Gemini Omni converts across text, images, audio and video, with a demo editing a video's character or background from one sentence.

r/LocalLLaMA

Floor for local meeting summarization on a 6GB GPU: Qwen3.5 0.8B works in 57s, Granite 4 350M hallucinates

The author tested VoiceFlow 1.6.0 on an RTX 3060 Laptop 6GB, where Qwen3.5 0.8B summarized a 4-minute meeting in 57 seconds with 16K context, while Granite 4 350M returned summaries in 0.6-2.8 seconds but fabricated Binance and Star Trek content.

Why it matters: A user tested two small models on a 6GB RTX 3060 laptop: Qwen3.5 0.8B summarized a 4-minute meeting in 57 seconds, while the faster Granite 4 350M made things up.

May 19Tuesday

r/LocalLLaMA

21 GPUs benchmarked running a small TTS model, with 5GB peak VRAM

A Reddit user rented 21 GPUs on vast.ai to benchmark OmniVoice, a small TTS model with about 5GB peak VRAM, using xRT as the audio generation speed metric and averaging 3 voice-cloning runs with reference audio.

Why it matters: A Reddit user benchmarked 21 rented GPUs on a small voice-cloning TTS model, averaging three runs per card, as a buying reference for anyone building speech synthesis.

May 15Friday

AI HOT (Curated Pool)

Connect Grok to the Hermes Agent

xAI connects Grok subscription accounts to Nous Research’s open-source Hermes Agent across all subscription tiers, letting users run Grok 4.3 text chat and reasoning, generate spoken replies with text-to-speech, create images and videos with Grok Imagine, and connect the agent to WhatsApp or Discord.

Why it matters: xAI wired its paid Grok subscription into Nous Research's open-source agent Hermes, where users get Grok 4.3 text reasoning, speech synthesis, and Grok Imagine image and video generation.

AI HOT (Curated Pool)

Accelerating On-Device AI: Arm and Google AI Edge Optimization Practices

Arm SME2 and Google AI Edge integrate with LiteRT, XNNPACK, and KleidiAI to optimize Stability AI’s stable-audio-open-small, delivering over 2x faster audio generation and 4x lower memory use on Arm-based mobile devices and laptops.

Why it matters: Arm and Google AI Edge use SME2 instructions to put matrix units in the CPU, more than doubling on-device audio model inference speed and cutting memory to a quarter.

May 13Wednesday

AI HOT (Curated Pool)

Google Launches New Android Smart Assistant

Google introduced Android Intelligence at Android Show 2026, with multi-step automation across Android apps, browser-use features for Gemini in Chrome, automatic form filling, Rambler voice-note transcription, and custom Gen UI widgets; the post does not disclose rollout timing, supported devices, or pricing.

Why it matters: Google put an assistant at the OS level that books coffee, replies to messages and fills forms across apps, a concrete step past single-app agents.

TechCrunch · AI

Google adds Gemini-powered dictation to Gboard, which could be bad news for dictation startups

Google adds Gemini-powered dictation to Gboard for an initial launch on Samsung Galaxy and Google Pixel phones; the post does not disclose supported languages, pricing, offline behavior, or a rollout date.

Why it matters: Google put Gemini dictation into Gboard on Samsung Galaxy and Pixel phones first, and a built-in option makes it harder for paid dictation startups to hold subscribers.

May 12Tuesday

TechCrunch · AI

AI Voice Startup Vapi Hits $500M Valuation After Winning Amazon Ring Over 40 Rivals

Vapi reached a $500 million valuation after Amazon Ring chose its AI voice platform over 40 rivals, and the RSS snippet says its enterprise business has grown tenfold since early 2025 as companies move support and sales calls to AI agents.

Why it matters: Amazon's Ring picked Vapi for customer service and sales calls after weighing more than 40 options, showing how a voice AI platform gets through enterprise procurement.

Xinzhiyuan · WeChat

OpenAI releases GPT-Realtime-2, described as a GPT-5-level reasoning audio model

OpenAI released GPT-Realtime-2 alongside Realtime-Translate and Realtime-Whisper, with a 128K context window, five reasoning-effort levels, and API pricing of $32 per million input tokens and $64 per million output tokens.

Why it matters: OpenAI's GPT-Realtime-2 brings 128K context, five reasoning levels and published API pricing, giving voice agent builders real numbers for cost planning.