Skip to content
AI HOT (Curated Pool)

ByteDance Seed launches SeedRealtime, a native audio-video full-duplex model, now live in Doubao

字节 Seed 发布 SeedRealtime 音视频全双工大模型,走向全模态自然交互

SeedRealtime fuses audio, video, and text into a single end-to-end model, ditching the cascaded ASR-VLM-TTS pipeline. It watches, listens, and speaks in a continuous stream, deciding in real time when to jump in and whom to track. Human evals show half the turn-taking issues vs. cascaded systems—fewer cut-offs, late replies, or false triggers from background chatter. It also acts proactively: it can alert you when a target exhibit appears in a museum or correct a coffee-making mistake on the spot. The model is now fully rolled out in Doubao's video call feature.

Why it matters: ByteDance Seed released SeedRealtime, putting voice, video and text in one model that judges turn-taking timing in continuous audio-video streams, with official end-to-end evals showing half as many interruptions and late replies as cascaded setups.

Read the original ↗Export Markdown