Skip to content

#多模态

4 today

May 21Thursday

The Verge · AI

You can now remix other people’s YouTube Shorts with AI

Google added a “reimagine” option to YouTube Shorts Remix, letting users use Gemini Omni to restyle clips, alter contents, or insert themselves into other people’s videos, while creators can enable or disable reimagining for their uploads.

Why it matters: YouTube added an AI reimagine feature for Shorts remixes that can restyle someone else's video as anime or swap out the people in it, with uploaders deciding whether their clips can be altered.

May 20Wednesday

Hacker News front page

Show HN: Lance – Image/video generation and understanding in one model

ByteDance released Lance as a research project for image and video generation and understanding in one model; the RSS snippet states 3B active parameters, fewer than 128 GPUs used for training, and links to a homepage, arXiv paper, and Hugging Face model, while the post does not disclose benchmark results or licensing terms.

Why it matters: ByteDance open-sourced Lance, one model for image and video understanding, generation and editing, with 3B active parameters, under 128 GPUs to train, and code, paper and weights all public.

The Verge · AI

It’s Make-or-Break Time for AI Labeling Systems

Google announced at I/O an expanded ability to verify SynthID markers on AI-generated images, while C2PA Content Credentials also targets origin metadata for image, video, and audio files; the RSS snippet does not disclose the full rollout scope or verification limits.

Why it matters: Google widened SynthID watermark verification while C2PA pushed its Content Credentials provenance metadata standard, putting the two technical routes for tracing AI content side by side.

Xinzhiyuan · WeChat

UISEE Lists in Hong Kong as a Full-Scenario L4 Autonomous Driving Stock

UISEE listed on the Hong Kong Stock Exchange at HK$60.30 per share, with its public offering oversubscribed 6,777.29 times and a 90.5% share of the Greater China airport L4 commercial vehicle market in 2025.

Why it matters: UISEE listed on the Hong Kong exchange with 90.5% share of airport L4 commercial vehicles and 6,777x oversubscription, showing autonomous driving's progress in closed scenarios.

AI HOT (Curated Pool)

Kling AI Launches the First Native 4K Video Generation Model

Kling AI launched a native 4K video generation model on April 23, supporting one-click true 4K video generation; the post says Hollywood teams and Wonder Studios have adopted it, but does not disclose pricing, inference cost, or access limits.

Why it matters: Kling AI launched a native 4K video generation model that outputs 4K at generation rather than upscaling, with Hollywood teams and Wonder Studios said to use it in real workflows.

Synced · WeChat

After I/O, Google turns the search box into an agent entry point

Google announced Gemini 3.5 Flash at I/O and added AI Mode directly to Search; the company said its AI services now process over 3.2 quadrillion tokens per month, with more than 8.5 million developers using Gemini.

Why it matters: Google put Gemini 3.5 Flash and AI Mode inside the search box, turning search into an agent entry point, with AI services handling over 3.2 quadrillion tokens a month.

Latent Space

Google I/O 2026: Gemini 3.5 Flash, Omni, Spark, and Antigravity 2.0

Google announced Gemini 3.5 Flash at I/O 2026 with a 1M-token context window, 65k max output, four thinking levels, and pricing of $1.50 per 1M input tokens and $9.00 per 1M output tokens.

Why it matters: Gemini 3.5 Flash ships the same day as I/O, and its 1M-token context plus four thinking levels set the cost and latency for long documents and coding.

AI HOT (Curated Pool)

Qwen3.7: Agent Frontier

Qwen Studio released Qwen3.7 with chatbots, image and video understanding, and image generation. It also covers document processing, web search integration, tool calling, and artifact generation. The RSS snippet frames it as an agent-focused model, but the post does not disclose context length. It also omits benchmark scores, pricing, API limits, release schedule, and reproducible evaluation conditions.

Why it matters: Qwen launched Qwen3.7-Max, a closed model for agent work, demoing 35 hours of continuous operation and over a thousand tool calls for kernel optimization.

AI HOT (Curated Pool)

Gemini Omni Supports Video Creation With Personal Likeness and Voice

Gemini Omni lets users create digital-avatar videos using their personal likeness and voice, and the avatar can generate videos without uploading an image each time; the post does not disclose pricing, regions, or launch timing.

Why it matters: Gemini Omni lets users build a digital double from their own face and voice, then reuse it for on-camera videos without re-uploading photos each time.

AI HOT (Curated Pool)

ChatGPT Image Generation Surpasses 1.5 Billion Uses Per Week

OpenAI says users generate more than 1.5 billion images per week in ChatGPT, and the post discusses new use cases and trends since the release of Images 2.0.

Why it matters: The weekly image-generation volume shows how large image creation has become inside a chat product.

AI HOT (Curated Pool)

Google launches new AI search box with multimodal interactions

Google launched an AI search box based on Gemini 3.5, combining AI Overviews and AI Mode into one AI search experience that supports multimodal multi-turn queries across text, images, files, and video, with global availability on desktop and mobile.

Why it matters: Google merged AI Overviews and AI Mode into one search box that takes mixed text, image, file and video queries with follow-ups, live worldwide on desktop and mobile.

AI HOT (Curated Pool)

Google Tensor ML SDK Beta Released

Google released the Tensor ML SDK beta, letting developers convert, compile, and run PyTorch or TFLite models on Pixel 10 TPUs through LiteRT, with a model library containing more than 100 classic and generative AI models, including Gemma 3.

Why it matters: Developers can now run their own PyTorch or TFLite models on the Pixel 10's TPU, which makes on-device inference testable without Google's cloud.

AI HOT (Curated Pool)

Gemini Omni launches with physical reasoning and multimodal generation

Google launched Gemini Omni video generation for global AI Plus, Pro, and Ultra subscribers, integrating it with Gemini app, Google Flow, and YouTube Shorts, while the RSS snippet says the model combines intuitive physical reasoning with Gemini’s historical, scientific, and cultural knowledge.

Why it matters: Gemini Omni reasons about how objects fall and collide, so generated video holds together instead of just looking plausible frame by frame.

AI HOT (Curated Pool)

Gemini Omni: A new model for creating content from any input

Google AI published a Gemini Omni post, saying the model creates content from any input starting with video; the post does not disclose parameters, pricing, availability timing, or benchmark results.

Why it matters: Google teased a model that generates from any input and leads with video, but has published nothing beyond a tweet.

AI HOT (Curated Pool)

Google releases Gemini Omni multimodal generation model

Google released Gemini Omni, a multimodal generation model that combines image, video, and text inputs to generate videos grounded in Gemini’s real-world knowledge; the post does not disclose model size, pricing, or availability.

Why it matters: Google says Gemini Omni takes mixed image, video and text input and outputs video, with no model size or release date disclosed.

AI HOT (Curated Pool)

Google I/O Announces Multiple Gemini Updates

Google announced multiple Gemini updates at Google I/O, including a new experience design using neural expression technology, upcoming agent features with Daily Brief and Gemini Spark, plus Gemini Omni and 3.5 Flash; the RSS snippet does not disclose release dates, model parameters, pricing, or benchmark results.

Why it matters: Google used I/O to show where its Gemini line is heading, with design updates, agent features and the Omni and 3.5 Flash models.

r/LocalLLaMA

Nemotron-Labs-Diffusion from NVIDIA

NVIDIA released the Nemotron-Labs-Diffusion 3B, 8B, and 14B dense model family with AR decoding, diffusion parallel decoding, and self-speculation; the 8B model reaches 850 tok/s on GB200 at concurrency 1, compared with 253 tok/s for AR and 360 tok/s for Eagle3.

Why it matters: NVIDIA's Nemotron-Labs-Diffusion ships three dense models from 3B to 14B that decode both autoregressively and by diffusion, plus a self-speculation speedup.

AI HOT (Curated Pool)

Google Search gets its biggest redesign in 25 years with AI-driven interaction changes

Google announced at I/O 2026 the biggest Search redesign in 25 years, powered by Gemini 3.5 Flash, with AI Mode exceeding 1 billion monthly active users and query volume doubling each quarter.

Why it matters: Google is moving search from typed keywords to full spoken requests, with AI Mode already at 1 billion monthly users.

The Verge · AI

Gemini will use Volvo’s external cameras to interpret parking signs

Google and Volvo announced at I/O that Gemini will access external cameras on the upcoming EX60 SUV, with the first stated use case translating hard-to-understand parking signs for vehicle owners.

Why it matters: Gemini reaching Volvo's external cameras shows multimodal models moving from chat into the car itself.

The Verge · AI

The 13 Biggest Announcements at Google I/O 2026

Google announced Gemini 3.5 Flash at I/O 2026. It becomes the default model today for the Gemini app and AI Mode in Search, while Gemini 3.5 Pro follows next month; the RSS snippet also mentions Search, Gmail, and Project Aura smart glasses updates but does not disclose the full list of 13 announcements.

Why it matters: Google made Gemini 3.5 Flash the default model for its app and search AI Mode, with the stronger Pro version still to come.

AI HOT (Curated Pool)

Google releases Gemini 3.5 Flash with 55 intelligence score

Google released Gemini 3.5 Flash, raising its intelligence score by 9 points to 55, exceeding 280 output tokens per second, and increasing operating cost by 5.5 times versus the previous generation.

Why it matters: Gemini 3.5 Flash trades a higher intelligence score and faster output for running costs 5.5 times the previous generation.

TechCrunch · AI

Google’s Genie world model can now simulate real streets with Street View

Google DeepMind is integrating Street View with Project Genie for interactive street-level simulations in robotics, gaming, and travel; the post does not disclose model parameters, launch timing, or evaluation results.

Why it matters: Wiring Street View into Project Genie gives robotics and game teams interactive 3D scenes built from real streets.

TechCrunch · AI

OpenAI is making it easier to check if an image was made by its models

OpenAI announced two measures for detecting AI-generated images: it joined the open C2PA standard and added Google’s SynthID to its products. The RSS snippet does not disclose which OpenAI products include SynthID, whether the checks cover legacy images, or when the measures become available to users.

Why it matters: OpenAI now stamps its generated images with both C2PA metadata and Google's SynthID invisible watermark, running two provenance paths side by side.

TechCrunch · AI

Google's Gemini Omni turns images, audio, and text into video

Google's Gemini Omni generates and edits video through conversation, using text, images, audio, and video as inputs, with Omni Flash named as the starting version; the RSS snippet says the model reasons across modalities, but the post does not disclose launch date, pricing, context limits, benchmarks, or API availability.

Why it matters: Gemini Omni takes text, images, audio and video as input and generates or edits video through conversation, with the first release, Omni Flash, focused on cross-modal reasoning.

AI HOT (Curated Pool)

Google releases Gemini Omni for any-input-to-any-output generation and conversational video editing

Google released Gemini Omni and Omni Flash at I/O 2026, supporting text, image, audio, and video inputs and outputs, with conversational video editing; Omni Flash is available in Gemini App, Google Flow, and YouTube Shorts, while the post does not disclose the API launch date.

Why it matters: Google's Gemini Omni converts across text, images, audio and video, with a demo editing a video's character or background from one sentence.

AI HOT (Curated Pool)

Gemini Omni Released: New Progress in Multimodal Generation

Google DeepMind released Gemini Omni, starting with video generation; the post says it combines Gemini with its generative media systems, but does not disclose parameters, pricing, or availability.

Why it matters: Google DeepMind's Gemini Omni merges Gemini's understanding with its generative media stack, starting with video, aiming to turn any input into any output.

AI HOT (Curated Pool)

Google processes over 3,200 trillion tokens per month, up 7x year over year

Google said at I/O 2026 that it processed over 3,200 trillion tokens per month in May, while Gemini App exceeded 900 million monthly active users and the Nano Banana model generated more than 50 billion images cumulatively.

Why it matters: Google said at I/O that its platforms process over 3,200 trillion tokens a month, up 7x year over year, with the Gemini app past 900 million monthly users, a scale reference for its AI serving.

AI HOT (Curated Pool)

NVIDIA open-sources first 4-bit infrastructure for ultra-long video generation

NVIDIA researchers open-sourced LongLive 2.0, an end-to-end long-video generation infrastructure covering training and inference with 4-bit quantization, FP4 quantization, parallel acceleration, KV-cache optimization, and 45.7 FPS generation on a 5B model.

Why it matters: NVIDIA open-sourced all training and inference code for LongLive 2.0, hitting 45.7 fps at 4-bit quantization on a 5B-parameter model, a reusable path to cheaper long-video generation.

May 19Tuesday

r/LocalLLaMA

ByteDance released an open-source model that attempts broad multimodal tasks with 3B parameters

ByteDance released Lance, an open-source unified multimodal model with 3B active parameters that supports image and video understanding, generation, and editing, and the post says it was trained from scratch with a staged multi-task recipe under a 128-A100-GPU budget.

Why it matters: ByteDance open-sourced Lance, which puts image and video understanding, generation and editing in one model with 3B active parameters, plus the staged multi-task training recipe and 128-A100 setup.

AI HOT (Curated Pool)

Advancing content provenance for a safer, more transparent AI ecosystem

OpenAI launched an AI content provenance system that combines Content Credentials and SynthID with a verification tool; the post does not disclose supported media formats, rollout scope, or detection accuracy.

Why it matters: OpenAI is applying C2PA content credentials and Google DeepMind's SynthID invisible watermark together to generated images in DALL·E, Sora and more, with verification tools, so two provenance standards land side by side.

QbitAI · WeChat

Chinese GPU vendor Moore Threads releases MT Lambda for embodied AI simulation

Moore Threads released MT Lambda, an embodied AI simulation platform that combines physics, rendering, and AI engines, and demonstrated the robot dog “Xiaofei” executing a Sim-to-Real policy trained 100% in simulation on domestic hardware.

Why it matters: Moore Threads released the MT Lambda simulation platform, which combines physics, rendering and AI training on its own GPUs; the robot dog Xiaofei learned to walk in simulation and moved straight to hardware.

QbitAI · WeChat

World model supports multiplayer FPS gameplay before Fei-Fei Li

Odyssey released Agora-1, a world model that supports up to four human and AI players fighting in the same generated FPS world in real time. The system decouples simulation from rendering and trains on GoldenEye internal game states.

Why it matters: Odyssey released the Agora-1 world model, which puts four human or AI players in one FPS map, trains on internal game states from GoldenEye, and runs physics simulation separately from rendering.

New York Times Chinese

China’s AI Microdrama Boom Brings Job Anxiety and Tech Enthusiasm

Chinese companies are producing AI-generated microdramas for about $30 per minute without cameras, crews, or human actors; DataEye says nearly 50,000 new AI microdramas were uploaded to Douyin in March, almost matching the platform’s total uploads for all of 2025.

Why it matters: Chinese companies are mass-producing AI short dramas at about 200 yuan per minute, with nearly 50,000 uploaded to Douyin in March alone, close to the platform's total for all of 2025.

AI HOT (Curated Pool)

Qwen3.7 Preview lands on Arena; Alibaba rises to fifth in vision ranking

Alibaba says Qwen3.7-Plus-Preview has landed on Arena and that Alibaba now ranks fifth in vision; the post does not disclose benchmark scores, the number of competing models, or a release timeline for the Qwen3.7 series.

Why it matters: Alibaba put Qwen3.7-Plus-Preview on an arena and claims fifth place on a vision leaderboard, with no scores or launch date.

AI HOT (Curated Pool)

NVIDIA fine-tunes Cosmos Predict 2.5 with LoRA/DoRA for robot video generation

NVIDIA published a Hugging Face post on fine-tuning Cosmos Predict 2.5 with LoRA and DoRA to generate robot first-person videos from text prompts; the post does not disclose dataset size, training cost, or evaluation results.

Why it matters: NVIDIA's technical blog shows lightweight LoRA and DoRA fine-tuning of Cosmos Predict 2.5 to generate first-person robot footage like arm grasps from text prompts, a cheap path to training video for embodied AI.

May 18Monday

Latent Space

The Autonomous Drone Tech Stack and Economics of Drones — Yaroslav Azhnyuk

Latent Space interviewed The Fourth Law founder Yaroslav Azhnyuk for a two-hour episode covering FPV drones, five levels of autonomy, eight dimensions of the autonomous battlefield, and China’s manufacturing advantage; the transcript claims Ukraine produced 4 million FPV drones last year and discusses a hypothetical Chinese capacity of 4 billion.

Why it matters: The Fourth Law founder Yaroslav Azhnyuk explains on a podcast how FPV drones became a battlefield staple, and lays out autonomy levels and cost structure.

r/LocalLLaMA

Qwen 3.6 27B on 24GB VRAM: backend comparisons, quant choice, and settings

The author tested Qwen 3.6 27B on an RTX 3090 24GB and kept ik_llama.cpp with Qwen3.6-27B-MTP-IQ4_KS.gguf; at 156k context with q8_0 KV and MTP, a ~5.9k-token prompt plus 1024-token output reached about 1261 tok/s prefill and 72.9 tok/s decode, while vLLM lacked a clean single-card long-context run.

Why it matters: The author benchmarked several backends and quantization schemes for Qwen 3.6 27B on a single 24GB RTX 3090, settling on ik_llama.cpp with IQ4_KS, as a single-card comparison for local deployment.

AI HOT (Curated Pool)

Grok Now Supports Video Understanding and Analysis

Grok now supports full-video uploads for real-time analysis, summarization, translation, scene explanation, and context extraction; the post does not disclose duration limits, supported formats, or rollout scope.

Why it matters: Grok added video understanding, letting users upload a whole video for frame analysis, summarization, translation and scene explanation, extending its multimodal reach from images and text to full video.

AI HOT (Curated Pool)

Alibaba Cloud launches HappyHorse video generation model

Alibaba Cloud launched HappyHorse on Model Studio, with prompt-to-1080p multi-shot video generation in one workflow; the post lists a limited-time 20% discount but does not disclose pricing, model parameters, or availability terms.

Why it matters: Alibaba Cloud put the HappyHorse video model on Model Studio, generating 1080p multi-shot video straight from text, with a limited 20% discount, useful for anyone picking video tools and weighing cloud costs.

Google DeepMind

Google DeepMind releases Gemini Omni Flash video model

Google DeepMind released Gemini Omni Flash, the first model in the Gemini Omni family. It combines image, audio, video and text inputs to generate high-quality video, and supports multi-turn editing in natural language.

Why it matters: One model now handles image, audio, video and text input plus multi-turn editing, and it ships inside Gemini, Flow and Shorts.