Skip to content

Multimodal

Beyond text: vision, mixed image-text, audio and video input and output in models and products.

Latest picks

341–360 of 592

May 20Wednesday

AI HOT (Curated Pool)

Google I/O Announces Multiple Gemini Updates

Google announced multiple Gemini updates at Google I/O, including a new experience design using neural expression technology, upcoming agent features with Daily Brief and Gemini Spark, plus Gemini Omni and 3.5 Flash; the RSS snippet does not disclose release dates, model parameters, pricing, or benchmark results.

Why it matters: Google used I/O to show where its Gemini line is heading, with design updates, agent features and the Omni and 3.5 Flash models.

r/LocalLLaMA

Nemotron-Labs-Diffusion from NVIDIA

NVIDIA released the Nemotron-Labs-Diffusion 3B, 8B, and 14B dense model family with AR decoding, diffusion parallel decoding, and self-speculation; the 8B model reaches 850 tok/s on GB200 at concurrency 1, compared with 253 tok/s for AR and 360 tok/s for Eagle3.

Why it matters: NVIDIA's Nemotron-Labs-Diffusion ships three dense models from 3B to 14B that decode both autoregressively and by diffusion, plus a self-speculation speedup.

AI HOT (Curated Pool)

Google Search gets its biggest redesign in 25 years with AI-driven interaction changes

Google announced at I/O 2026 the biggest Search redesign in 25 years, powered by Gemini 3.5 Flash, with AI Mode exceeding 1 billion monthly active users and query volume doubling each quarter.

Why it matters: Google is moving search from typed keywords to full spoken requests, with AI Mode already at 1 billion monthly users.

The Verge · AI

Gemini will use Volvo’s external cameras to interpret parking signs

Google and Volvo announced at I/O that Gemini will access external cameras on the upcoming EX60 SUV, with the first stated use case translating hard-to-understand parking signs for vehicle owners.

Why it matters: Gemini reaching Volvo's external cameras shows multimodal models moving from chat into the car itself.

The Verge · AI

The 13 Biggest Announcements at Google I/O 2026

Google announced Gemini 3.5 Flash at I/O 2026. It becomes the default model today for the Gemini app and AI Mode in Search, while Gemini 3.5 Pro follows next month; the RSS snippet also mentions Search, Gmail, and Project Aura smart glasses updates but does not disclose the full list of 13 announcements.

Why it matters: Google made Gemini 3.5 Flash the default model for its app and search AI Mode, with the stronger Pro version still to come.

AI HOT (Curated Pool)

Google releases Gemini 3.5 Flash with 55 intelligence score

Google released Gemini 3.5 Flash, raising its intelligence score by 9 points to 55, exceeding 280 output tokens per second, and increasing operating cost by 5.5 times versus the previous generation.

Why it matters: Gemini 3.5 Flash trades a higher intelligence score and faster output for running costs 5.5 times the previous generation.

TechCrunch · AI

Google’s Genie world model can now simulate real streets with Street View

Google DeepMind is integrating Street View with Project Genie for interactive street-level simulations in robotics, gaming, and travel; the post does not disclose model parameters, launch timing, or evaluation results.

Why it matters: Wiring Street View into Project Genie gives robotics and game teams interactive 3D scenes built from real streets.

TechCrunch · AI

OpenAI is making it easier to check if an image was made by its models

OpenAI announced two measures for detecting AI-generated images: it joined the open C2PA standard and added Google’s SynthID to its products. The RSS snippet does not disclose which OpenAI products include SynthID, whether the checks cover legacy images, or when the measures become available to users.

Why it matters: OpenAI now stamps its generated images with both C2PA metadata and Google's SynthID invisible watermark, running two provenance paths side by side.

TechCrunch · AI

Google's Gemini Omni turns images, audio, and text into video

Google's Gemini Omni generates and edits video through conversation, using text, images, audio, and video as inputs, with Omni Flash named as the starting version; the RSS snippet says the model reasons across modalities, but the post does not disclose launch date, pricing, context limits, benchmarks, or API availability.

Why it matters: Gemini Omni takes text, images, audio and video as input and generates or edits video through conversation, with the first release, Omni Flash, focused on cross-modal reasoning.

AI HOT (Curated Pool)

Google releases Gemini Omni for any-input-to-any-output generation and conversational video editing

Google released Gemini Omni and Omni Flash at I/O 2026, supporting text, image, audio, and video inputs and outputs, with conversational video editing; Omni Flash is available in Gemini App, Google Flow, and YouTube Shorts, while the post does not disclose the API launch date.

Why it matters: Google's Gemini Omni converts across text, images, audio and video, with a demo editing a video's character or background from one sentence.

AI HOT (Curated Pool)

Gemini Omni Released: New Progress in Multimodal Generation

Google DeepMind released Gemini Omni, starting with video generation; the post says it combines Gemini with its generative media systems, but does not disclose parameters, pricing, or availability.

Why it matters: Google DeepMind's Gemini Omni merges Gemini's understanding with its generative media stack, starting with video, aiming to turn any input into any output.

AI HOT (Curated Pool)

Google processes over 3,200 trillion tokens per month, up 7x year over year

Google said at I/O 2026 that it processed over 3,200 trillion tokens per month in May, while Gemini App exceeded 900 million monthly active users and the Nano Banana model generated more than 50 billion images cumulatively.

Why it matters: Google said at I/O that its platforms process over 3,200 trillion tokens a month, up 7x year over year, with the Gemini app past 900 million monthly users, a scale reference for its AI serving.

AI HOT (Curated Pool)

NVIDIA open-sources first 4-bit infrastructure for ultra-long video generation

NVIDIA researchers open-sourced LongLive 2.0, an end-to-end long-video generation infrastructure covering training and inference with 4-bit quantization, FP4 quantization, parallel acceleration, KV-cache optimization, and 45.7 FPS generation on a 5B model.

Why it matters: NVIDIA open-sourced all training and inference code for LongLive 2.0, hitting 45.7 fps at 4-bit quantization on a 5B-parameter model, a reusable path to cheaper long-video generation.

May 19Tuesday

r/LocalLLaMA

ByteDance released an open-source model that attempts broad multimodal tasks with 3B parameters

ByteDance released Lance, an open-source unified multimodal model with 3B active parameters that supports image and video understanding, generation, and editing, and the post says it was trained from scratch with a staged multi-task recipe under a 128-A100-GPU budget.

Why it matters: ByteDance open-sourced Lance, which puts image and video understanding, generation and editing in one model with 3B active parameters, plus the staged multi-task training recipe and 128-A100 setup.

AI HOT (Curated Pool)

Advancing content provenance for a safer, more transparent AI ecosystem

OpenAI launched an AI content provenance system that combines Content Credentials and SynthID with a verification tool; the post does not disclose supported media formats, rollout scope, or detection accuracy.

Why it matters: OpenAI is applying C2PA content credentials and Google DeepMind's SynthID invisible watermark together to generated images in DALL·E, Sora and more, with verification tools, so two provenance standards land side by side.

QbitAI · WeChat

Chinese GPU vendor Moore Threads releases MT Lambda for embodied AI simulation

Moore Threads released MT Lambda, an embodied AI simulation platform that combines physics, rendering, and AI engines, and demonstrated the robot dog “Xiaofei” executing a Sim-to-Real policy trained 100% in simulation on domestic hardware.

Why it matters: Moore Threads released the MT Lambda simulation platform, which combines physics, rendering and AI training on its own GPUs; the robot dog Xiaofei learned to walk in simulation and moved straight to hardware.

QbitAI · WeChat

World model supports multiplayer FPS gameplay before Fei-Fei Li

Odyssey released Agora-1, a world model that supports up to four human and AI players fighting in the same generated FPS world in real time. The system decouples simulation from rendering and trains on GoldenEye internal game states.

Why it matters: Odyssey released the Agora-1 world model, which puts four human or AI players in one FPS map, trains on internal game states from GoldenEye, and runs physics simulation separately from rendering.

New York Times Chinese

China’s AI Microdrama Boom Brings Job Anxiety and Tech Enthusiasm

Chinese companies are producing AI-generated microdramas for about $30 per minute without cameras, crews, or human actors; DataEye says nearly 50,000 new AI microdramas were uploaded to Douyin in March, almost matching the platform’s total uploads for all of 2025.

Why it matters: Chinese companies are mass-producing AI short dramas at about 200 yuan per minute, with nearly 50,000 uploaded to Douyin in March alone, close to the platform's total for all of 2025.

AI HOT (Curated Pool)

Qwen3.7 Preview lands on Arena; Alibaba rises to fifth in vision ranking

Alibaba says Qwen3.7-Plus-Preview has landed on Arena and that Alibaba now ranks fifth in vision; the post does not disclose benchmark scores, the number of competing models, or a release timeline for the Qwen3.7 series.

Why it matters: Alibaba put Qwen3.7-Plus-Preview on an arena and claims fifth place on a vision leaderboard, with no scores or launch date.

AI HOT (Curated Pool)

NVIDIA fine-tunes Cosmos Predict 2.5 with LoRA/DoRA for robot video generation

NVIDIA published a Hugging Face post on fine-tuning Cosmos Predict 2.5 with LoRA and DoRA to generate robot first-person videos from text prompts; the post does not disclose dataset size, training cost, or evaluation results.

Why it matters: NVIDIA's technical blog shows lightweight LoRA and DoRA fine-tuning of Cosmos Predict 2.5 to generate first-person robot footage like arm grasps from text prompts, a cheap path to training video for embodied AI.