Google ADK 教程:用流式工具与响应调度构建不中断对话的语音智能体
Google ADK 教程介绍如何结合 gemini-3.8-live、非阻塞工具与响应调度,让语音智能体在耗时查询期间保持对话。销售报告工作流测试中,改用流式工具后,智能体开始说话的时间从 14.4 秒缩短至 1.2 秒,但后台查询耗时并未减少。
Google ADK 教程介绍如何结合 gemini-3.8-live、非阻塞工具与响应调度,让语音智能体在耗时查询期间保持对话。销售报告工作流测试中,改用流式工具后,智能体开始说话的时间从 14.4 秒缩短至 1.2 秒,但后台查询耗时并未减少。
蚂蚁 inclusionAI 开源 Ming-3.0-tts,提供 0.5b 稠密模型和基于 Ling V3 的 tiny MoE 模型,后者为 7.9B total · 1.3B active。
一款名为 Duck Pond 的鸭叫合成器在 Hacker News 亮相,所有鸭叫声均实时合成、无任何录音素材。场景中有一小群绿头鸭:三只母鸭、两只公鸭和两窝小鸭,用户站在岸边即可从所在位置听到每声鸭叫。
巴西出行平台 Localiza 将生成式 AI 视为新的计算界面而非单纯生产力工具,围绕三大支柱重组业务:规模化实验、自然语言客户入口和 AI 原生产品。2026 年 3 月,它成为巴西首个、也是拉美首批将应用直接集成进 ChatGPT 的出行平台,用户可在对话中浏览租车、订阅和二手车选项。
xAI released Grok Voice 3.0, a speech-to-speech model available today through the Voice Agent API with sub-second latency. It ranks first on Artificial Analysis's Speech-to-Speech Index at 86.9 and scores 71.6% on τ-Voice, close to GPT-Live-1 (Astra) but with 40% lower latency.
Why it matters: Grok Voice 3.0 matches GPT-Live-1 on customer-service call tests while cutting latency by 40%.
Apple HomeView runs a Siri AI built on Apple Intelligence, combining personal context, knowledge questions and smart home control into a home assistant. The device has an A18 chip and a 7-inch Liquid Retina display and can recognize up to six users. Reaching personal content requires a paired iPhone or iPad on the same Wi-Fi, recently unlocked, plus face recognition.
Why it matters: Apple HomeView brings a personalized assistant to a shared household device, using face recognition and paired-device conditions to separate personal content from what guests can use.
Simon Willison built a blog Newsletters index almost entirely through Codex voice mode, then finished deployment with keyboard prompts and code review. Talking to GPT-6 Astra High in the Codex tab of the ChatGPT desktop app while cooking, he got the Django data model, four import paths, archive pages and search integration done in about half an hour, then spent another half hour fixing the API import for a private GitHub repo and the page display.
Why it matters: Willison split voice-driven building from keyboard review, using speech for the bulk of the feature and typing to fix the import code.
Google launched Guided Vision in Gemini Live, which uses real-time visual description and spoken framing prompts to help blind and low-vision users and anyone who needs visual assistance.
Why it matters: Google adds real-time visual description and spoken framing prompts to Gemini Live, letting blind and low-vision users get everyday visual information through conversation.
ElevenLabs released the text-to-speech model Eleven v4 and a low-latency version, Eleven v4 Turbo, with stronger emotional expression, speaker consistency and multi-speaker dialogue. Both support more than 90 languages, and Instant Voice Clones need only 10 seconds of audio. Turbo's median inference latency is about 100ms, with about 150ms from request to audible speech.
Why it matters: ElevenLabs pairs emotional control with low latency in Eleven v4 Turbo, so voice agents can answer fast and still sound natural.
Google DeepMind released Gemini 3.8 Live with Live Avatar, adding near-real-time video generation to its native real-time conversation model. The result is a dynamic visual avatar with lip sync, natural expressions and smooth turn-taking.
Why it matters: Gemini 3.8 Live adds near-real-time video generation to a live conversation model, with lip sync, switching across 97 languages and asynchronous tool calls mid-dialogue, showing what enterprise multimodal interaction looks like now.
Google is testing 'Call for Me,' letting Gemini make calls to businesses. It's limited to US Pixel 11 owners with a Gemini subscription, using the beta Google Phone app. Gemini can now share user-approved personal info, expanding what it can do. You can follow the call live and take over anytime. The post doesn't disclose a launch date, pricing changes, or the business-side experience.
Why it matters: Google began testing Call for Me, which lets Gemini phone businesses on a user's behalf, starting with US paying subscribers on Pixel 11 who also run the beta phone app.
Google launched Gemini 3.8 Live with Live Avatar, pairing near-real-time video generation with native live conversation, available now in Gemini Enterprise. It handles visual and audio input at once, calls tools asynchronously during an ongoing conversation, and syncs lip and facial movement while switching across 97 languages. Enterprises can use preset avatars or customize one from a reference image, though custom creation is limited to an enterprise allowlist. Generated audio and video carry SynthID watermarks.
Why it matters: Google combines live voice conversation with a dynamic avatar and background tool calls, so enterprise support and guided flows don't have to interrupt the conversation to fetch data.
Meta positioned Muse as the core of a hardware-plus-agent play at Connect. Muse now does voice and real-time video, handles long background conversations, and gets its own email address you can CC. Mac computer use lets you queue jobs and walk away. It's free for now but may take a transaction cut later; retail partners include Walmart, Best Buy, and Sephora, with productivity connectors for Box, GitHub, and Notion. Hardware updates: Ray-Ban Meta Gen 3 with better battery and mics, plus Charm, a standalone handheld gadget. No new frontier model shipped—only an MSL tease.
Why it matters: At Connect 2026 Meta put its Muse assistant into the glasses with voice and live video, and teased a standalone email and Mac control, showing how its hardware and agent plans fit together.
Meta teased the Muse Charm at the end of Connect, a dedicated hardware device for its Muse AI agent. It resembles a chunky strapless smartwatch with a lanyard. A fingerprint sensor on the top right activates voice input; the front has at least three mic holes and a small camera. Zuckerberg noted you don't need to unlock a phone to use it. The post doesn't disclose pricing, battery life, or a release date.
Why it matters: Meta closed its Connect event with Muse Charm, a standalone AI device where a fingerprint press starts a conversation with the Muse agent without unlocking a phone.
Two weeks after launching Muse, Meta says it's working on bringing the agent to its smart glasses, including the new ones shown at Connect. You'll activate it by saying its name and can ask it to guide workouts, log meals, or help shop for products you're looking at. The glasses are also getting an FDA-cleared hearing enhancement feature for adults with mild to moderate hearing loss. The post doesn't specify a launch date or which models will get Muse.
Why it matters: Meta says it is working on bringing its two-week-old Muse assistant to its smart glasses, where a spoken name triggers workout coaching, meal logging or price checks.
Greg Brockman announced that GPT Voice can now use tools like email, calendar, and Slack, powered by GPT-6 Astra, Sol, and Luna. Voice also lands on ChatGPT Work across web and mobile, letting users create docs, presentations, websites, or sheets hands-free in the browser. Rolling out globally today in the latest app version. The post doesn't disclose latency, accuracy, or enterprise access details, so I'd discount the demo until we see real-world numbers.
Why it matters: Greg Brockman says upgraded GPT Voice can call email, calendar and Slack and lands in ChatGPT Work, moving voice from chat to actual office tasks.
OpenAI added plugin access to ChatGPT Voice so it can work across email, calendar, and Slack. Voice is live on ChatGPT Work web and mobile, letting users create docs, decks, sites, and spreadsheets by speaking. OpenAI says it's powered by GPT-6 Astra, Sol, and Luna, rolling out globally in the latest app version the same day. The post doesn't cover plugin permission scopes, latency, or pricing.
Why it matters: OpenAI wires voice into email, calendar and Slack plugins, says three GPT-6 models drive it, and lets ChatGPT Work users on web and mobile generate docs, decks, sites and sheets by speaking.
ChatGPT Voice now works with Mail, Calendar, and Slack plugins, running on GPT-6 Astra, Sol, and Luna. ChatGPT Work on web and mobile also gets voice input—you can create docs, presentations, websites, or sheets by speaking. The post doesn't disclose rollout regions, latency, or plugin permission details.
Why it matters: ChatGPT voice now reaches email, calendar and Slack plugins and runs on GPT-6 series models, so office voice use moves from conversation to cross-app tasks.
Kinney Drugs rolled back its AI phone assistant Burt after three months, following customer reports of incoherent calls, wrong dosages, and missed prescription alerts. President John Marraffa said HIPAA compliance doesn't equal a good experience. Incoming patient calls return to a touch-tone system; Burt stays only for opt-in refill texts. The article does not name the underlying model or voice vendor.
Why it matters: Kinney Drugs pulled its AI phone assistant after three months and hundreds of complaints about wrong dosages and missed refill reminders, with its president admitting compliance is not the same as a good experience.
Anthropic released Claude Opus 5 at half the cost of Fable 5, claiming near-parity. Every's review found it argues, stops early, and fights old prompting habits. Anthropic cut over 80% of Claude Code's system prompt for Opus 5 and Fable 5 with no measurable coding-eval loss. Theo spent hours rewriting CLAUDE.md and skills files and called it worth it. ChatGPT Voice now controls the desktop app inside Work and Codex, spawning new sessions for tasks and reporting back—like a voice-driven OpenClaw. Keshav found it weaker for serious work than manually using 5.6 Sol in Codex, but decent for email, dashboards, and charts. Claude's voice mode quietly added Sonnet and Opus support plus mid-conversation tool calls to Gmail, Calendar, and Slack. Kimi K3 weights and tech report are public, with a 50% discount on Droid until Aug 10. Jensen Huang posted on X for the first time amid rumors of a US ban on Chinese open-weight models.
Why it matters: Anthropic released Claude Opus 5 at half the price of Fable 5, and Every's review records it arguing and stopping before tasks are done, yet the same reviewer ranked it first in a blind test.
ChatGPT's desktop app now accepts voice commands that can control agents and perform multi-step tasks. It uses the ChatGPT-Live voice models launched earlier this month, works with ChatGPT Work and Codex, and can browse websites and apps. On macOS, Appshots lets it read screen content. A demo showed a developer asking ChatGPT to create a thread, make a pull request, and find a bug's root cause in one go. The smartphone version only handled conversation; the desktop update adds real execution. Anthropic also updated Claude's voice mode yesterday to operate Gmail, Slack, and other apps.
Why it matters: OpenAI put the ChatGPT-Live voice model it shipped earlier this month into the desktop app, so users can direct agents and browse by voice and read screen content on macOS through Appshots.
Anthropic upgraded Claude's voice mode to support Opus and Sonnet for complex reasoning, plus direct access to connected tools like Gmail and Slack during voice conversations. Multilingual support is also added, though the post doesn't list which languages. I'd wait for real-world latency and tool-calling reliability data before getting too excited.
Why it matters: Anthropic brought voice mode to Claude's Opus and Sonnet models and lets voice sessions call connected tools like Gmail and Slack, with multilingual support added too.
OpenAI rolled out voice control on ChatGPT's macOS and Windows desktop apps, letting you talk to multiple agents running inside ChatGPT Work or Codex. Powered by GPT-Live, it speaks, listens, and coordinates tasks at the same time. Available globally today for Plus, Pro, Business, Edu, and Enterprise users. The post doesn't disclose latency, concurrency limits, or which desktop actions are actually controllable—worth testing before getting excited.
Why it matters: OpenAI added voice control to the ChatGPT desktop apps for macOS and Windows, letting paying users direct multiple agents in Work or Codex by speaking instead of typing.
Anthropic expanded voice mode from Haiku to Opus and Sonnet—all three models now support it. The bigger move: voice mode can now plug into Gmail, Slack, and other apps to read your emails and messages. The post doesn't disclose latency or accuracy numbers, so I'd wait for real-world tests.
Why it matters: Anthropic extended voice mode from Haiku to Opus and Sonnet and hooked it into Gmail and Slack so it reads out mail and messages, widening both model coverage and the apps voice can reach.
Claude voice mode now lets users pick between Opus, Sonnet, and Haiku, defaulting to the last model used in text chat. Anthropic says this handles longer, more complex tasks like coaching communication style, walking through a client pitch, or brainstorming market research. The bigger shift: voice mode can now reach into Gmail, Google Calendar, Slack, Canva, and Notion to reschedule meetings, draft emails, or create docs. OpenAI's updated voice mode still can't use external tools. The post doesn't disclose latency numbers or rollout scope.
Why it matters: Anthropic lets users pick Opus, Sonnet or Haiku for Claude voice mode, defaulting to the model from the last text chat, which suits longer spoken work like rehearsing a pitch or a client proposal.
SpaceXAI and Cursor jointly trained Grok 4.5, landing between Opus 4.7 and 4.8 in performance but 6x cheaper than Opus and 3x cheaper than GPT-5.5 on a per-token basis. OpenAI rolled out GPT-5.6 (Sol, Terra, Luna) to all users; early testers say Sol is less smart than Fable but far more reliable. ChatGPT Voice got new GPT-Live-1 and Live-1-mini models that can talk while you speak and use GPT-5.5 in the background. Anthropic extended Fable 5 access for Claude subscribers to July 12—the post doesn't explain the repeated delays. Meta introduced Muse Image and Muse Video; image editing and text rendering look solid, but images still have an AI look, and the video model is in preview.
Why it matters: Grok 4.5, trained jointly by SpaceXAI and Cursor, is live in Cursor with an open API, sits between Opus 4.7 and 4.8 in performance, and costs 6x less per token than Opus.
Some users already see Bidi 1 in ChatGPT's web and app model selector, sitting alongside Standard and Advanced Voice. Selecting it turns the voice bubble yellow. The key change is full-duplex: the model can keep listening while it speaks and respond immediately to interruptions. In a demo, a user asked it to count from 1 to 10, interrupted mid-way and told it to count backwards—it complied instantly. OpenAI hasn't announced a launch date; one outlet speculates a wider rollout this week. The post doesn't disclose pricing, regional availability, or a firm timeline.
Why it matters: OpenAI is A/B testing Bidi 1, a two-way voice model on ChatGPT web and app that keeps listening while it speaks and answers interruptions instantly, alongside standard and advanced voice.
Doubao real-time voice model 3.0 (Seeduplex) is a native full-duplex end-to-end voice model. It claims three strengths: precise instruction following, noise resistance, and dynamic turn-taking. It stays quiet in multi-person conversations and only joins when a specified topic comes up. It can also call custom tools during real-time interaction to schedule calendar events or send emails. False replies and false interruptions are significantly reduced. Turn-taking latency dropped by about 250ms, the interruption rate in complex scenarios fell by 40%, and user-initiated interruption latency dropped by about 300ms. Target use cases include car cockpits, smart hardware, and customer service. The post does not disclose pricing or a public launch date.
Why it matters: ByteDance's Volcano Engine opened API waitlist testing for Doubao Realtime Voice Model 3.0, a native full-duplex end-to-end model that listens and speaks at once, decides when to take a turn, and can call tools mid-conversation.
Google put Gemini into a $99.99 Home Speaker that lets you correct mid-sentence and keeps a conversation going without re-waking. Premium features like free-flowing chat and Nest camera summaries require a $10/month or $100/year Home Premium subscription. Pre-orders open now, shipping this month.
Why it matters: Google's $99.99 Home Speaker is the first speaker built around Gemini, with mid-sentence corrections and continuous talk without a wake word.
Bloomberg's Mark Gurman tested the new Siri early and listed 7 real improvements: faster responses, on-screen awareness, cross-app actions, and more natural voice. But the core issue remains—Siri still hands off complex requests to ChatGPT and only handles simple commands itself. Gurman's take: this update pulls Siri back from 'disaster' to 'barely usable,' but it's still far from the proactive assistant Apple promised at WWDC 2024.
Why it matters: Bloomberg's Mark Gurman tested the new Siri early and lists seven concrete improvements, from response speed to screen understanding to cross-app actions, while noting complex requests still go to ChatGPT.
Google released Gemini 3.5 Live Translate in public preview through the Gemini API, offering low-latency speech-to-speech translation across 70+ languages and 2,000 language pairs.
Why it matters: Google opened Gemini 3.5 live speech translation to public beta with 70-plus languages and 2,000 possible pairs, and developers can wire it into live chat, support, streaming and cross-border meetings through an API.
Google released Gemini 3.5 Live Translate, a speech-to-speech translation model that supports more than 70 languages, starts translating before the speaker finishes, uses streaming updates, and runs through Gemini Live API, Google Meet preview, and Google Translate apps on iOS and Android.
Why it matters: Google released Gemini 3.5 Live Translate, covering more than 70 languages and translating as it listens instead of waiting for a full sentence, with latency down to a few seconds.
Google DeepMind released Gemini 3.5 Live Translate, an audio model for near-real-time speech-to-speech translation across more than 70 languages. It detects the language automatically and preserves the speaker's intonation, rhythm and pitch.
Why it matters: Gemini 3.5 Live Translate does continuous speech-to-speech translation across 70-plus languages while keeping the speaker's tone, rhythm and pitch, unlike systems that wait for each sentence.
Google DeepMind released Gemma 4 12B, a multimodal model with a unified encoder-free architecture, native audio input, Apache 2.0 licensing, and local laptop runtime with 16GB of VRAM or unified memory.
Why it matters: Google DeepMind open-sourced Gemma 4 12B, dropping separate vision and audio encoders so one Transformer handles images, text and speech, and it runs on 16GB of VRAM.
OpenBMB released the VoxCPM2 technical report, covering a 2B-parameter speech generation model trained on more than 2 million hours of multilingual speech data, with support for 30 languages and 9 Chinese dialects.
Why it matters: ModelBest open-sourced VoxCPM2, a 2-billion-parameter model under Apache 2.0, trained on over 2 million hours of data covering 30 languages and 9 Chinese dialects, with voice design, cloning and continuation all released.
Victor M summarized 25+ open-weight model releases in one week, including NVIDIA Nemotron 3 Ultra, a 550B hybrid Mamba-MoE with 55B active parameters and a 1M-token context window.
Why it matters: More than 25 open-weight models shipped in a week across text, image and speech, with NVIDIA's Nemotron 3 Ultra at 550B parameters and a 1M token context.
RedNote released dots.tts, a 2B-parameter open-source TTS model under Apache 2.0. It uses a fully continuous architecture, supports 48 kHz synthesis and zero-shot voice cloning, and maps text directly to speech without a phoneme pipeline.
Why it matters: RedNote open-sourced dots.tts, a 2B-parameter TTS model under Apache 2.0, with a fully continuous text-to-speech architecture, 48kHz output and zero-shot voice cloning.
Google AI announced six updates: Nano Banana 2 is generally available, Gemma 4 12B can run fully offline on laptops, and Magenta RealTime 2 is open source.
Why it matters: Google shipped six AI updates in one week, including Nano Banana 2 and Pro plus the multi-agent research assistant Co-Scientist, covering multimodal generation and research hypothesis optimization.
Google AI for Developers released the open-weight Magenta RealTime 2 music model, supporting MIDI, live text prompts, and gestures, with native MacBook latency under 200 ms.
Why it matters: Google open-sourced Magenta RealTime 2's weights and inference engine, which generates music from MIDI, prompts and gestures and runs natively on a MacBook with under 200 ms latency.
Boson AI and LMSYS released the Higgs Audio v3 TTS service with about 4B parameters, a Qwen3-4B backbone, support for 100 languages, streaming synthesis, and text tags for controlling 20+ emotions plus style, rhythm, and sound effects.
Why it matters: Boson AI and LMSYS put the 4B-parameter Higgs Audio v3 TTS into SGLang-Omni for end-to-end serving, with 100 languages and tuning for streaming voice assistants that generate speech as they go.