Skip to content

Multimodal

Beyond text: vision, mixed image-text, audio and video input and output in models and products.

Latest picks

321–340 of 592

May 21Thursday

TechCrunch · AI

Hark raises $700M Series A for its secretive ‘universal’ AI interface

Hark raised a $700 million Series A and plans to release its first multimodal models this summer; the post does not disclose investors, valuation, model specifications, or a hardware launch schedule.

Why it matters: Hark raised a $700M Series A at a $6B valuation for a universal AI interface, starting with text, image and voice models this summer and hardware later.

Xinzhiyuan · WeChat

USTC Papers Study Lifelong Learning for LMMs via Multimodal Knowledge Injection

USTC researchers released MMEVOKE and KORE: MMEVOKE contains 9,422 samples across 159 subcategories, while KORE uses knowledge-tree augmentation and null-space constrained fine-tuning to reduce catastrophic forgetting during multimodal knowledge injection.

Why it matters: A USTC team's MMEVOKE benchmark and KORE fine-tuning method offer reusable evaluation and training ideas for forgetting in continual learning of multimodal models.

Synced · WeChat

VAST and Tsinghua propose density-controlled 3D Gaussian generation for SIGGRAPH 2026

VAST and Tsinghua propose DeG, a 3D Gaussian generation method that samples Gaussian centers from a learned density distribution and trains density control with a render loss contribution gradient; in some settings, it reaches TRELLIS-like visual quality with less than half the Gaussian count.

Why it matters: VAST and Tsinghua propose DeG, which allocates Gaussian points by object detail density and matches TRELLIS-level quality with under half the points.

Synced · WeChat

Xie Saining’s Team Releases Second-Generation Representation Autoencoder RAEv2

Xie Saining’s team, Adobe Research, and the Australian National University released RAEv2, which reaches gFID 1.06 after 80 epochs on ImageNet-256 and reduces EPFID@2 from 177 epochs to 35 epochs while keeping compute at 189 GFLOPs.

Why it matters: Xie Saining's team with Adobe Research and ANU released RAEv2, cutting ImageNet-256 convergence from 177 epochs to 35 while holding compute at 189 GFLOPs.

AI HOT (Curated Pool)

Tencent Launches OS-Level AI Assistant Mavis on Windows, Mac, and Android

Tencent launched the OS-level AI assistant Mavis on May 21 across Windows, Mac, and Android, with document parsing, image recognition, system maintenance, partial offline use, model dispatching, and desktop control of mobile apps listed as supported functions.

Why it matters: Tencent puts its AI assistant into the OS layer across Windows, Mac and Android, letting a desktop agent read files, images and control phone apps.

The Verge · AI

You can now remix other people’s YouTube Shorts with AI

Google added a “reimagine” option to YouTube Shorts Remix, letting users use Gemini Omni to restyle clips, alter contents, or insert themselves into other people’s videos, while creators can enable or disable reimagining for their uploads.

Why it matters: YouTube added an AI reimagine feature for Shorts remixes that can restyle someone else's video as anime or swap out the people in it, with uploaders deciding whether their clips can be altered.

May 20Wednesday

Hacker News front page

Show HN: Lance – Image/video generation and understanding in one model

ByteDance released Lance as a research project for image and video generation and understanding in one model; the RSS snippet states 3B active parameters, fewer than 128 GPUs used for training, and links to a homepage, arXiv paper, and Hugging Face model, while the post does not disclose benchmark results or licensing terms.

Why it matters: ByteDance open-sourced Lance, one model for image and video understanding, generation and editing, with 3B active parameters, under 128 GPUs to train, and code, paper and weights all public.

The Verge · AI

It’s Make-or-Break Time for AI Labeling Systems

Google announced at I/O an expanded ability to verify SynthID markers on AI-generated images, while C2PA Content Credentials also targets origin metadata for image, video, and audio files; the RSS snippet does not disclose the full rollout scope or verification limits.

Why it matters: Google widened SynthID watermark verification while C2PA pushed its Content Credentials provenance metadata standard, putting the two technical routes for tracing AI content side by side.

Xinzhiyuan · WeChat

UISEE Lists in Hong Kong as a Full-Scenario L4 Autonomous Driving Stock

UISEE listed on the Hong Kong Stock Exchange at HK$60.30 per share, with its public offering oversubscribed 6,777.29 times and a 90.5% share of the Greater China airport L4 commercial vehicle market in 2025.

Why it matters: UISEE listed on the Hong Kong exchange with 90.5% share of airport L4 commercial vehicles and 6,777x oversubscription, showing autonomous driving's progress in closed scenarios.

AI HOT (Curated Pool)

Kling AI Launches the First Native 4K Video Generation Model

Kling AI launched a native 4K video generation model on April 23, supporting one-click true 4K video generation; the post says Hollywood teams and Wonder Studios have adopted it, but does not disclose pricing, inference cost, or access limits.

Why it matters: Kling AI launched a native 4K video generation model that outputs 4K at generation rather than upscaling, with Hollywood teams and Wonder Studios said to use it in real workflows.

Synced · WeChat

After I/O, Google turns the search box into an agent entry point

Google announced Gemini 3.5 Flash at I/O and added AI Mode directly to Search; the company said its AI services now process over 3.2 quadrillion tokens per month, with more than 8.5 million developers using Gemini.

Why it matters: Google put Gemini 3.5 Flash and AI Mode inside the search box, turning search into an agent entry point, with AI services handling over 3.2 quadrillion tokens a month.

Latent Space

Google I/O 2026: Gemini 3.5 Flash, Omni, Spark, and Antigravity 2.0

Google announced Gemini 3.5 Flash at I/O 2026 with a 1M-token context window, 65k max output, four thinking levels, and pricing of $1.50 per 1M input tokens and $9.00 per 1M output tokens.

Why it matters: Gemini 3.5 Flash ships the same day as I/O, and its 1M-token context plus four thinking levels set the cost and latency for long documents and coding.

AI HOT (Curated Pool)

Qwen3.7: Agent Frontier

Qwen Studio released Qwen3.7 with chatbots, image and video understanding, and image generation. It also covers document processing, web search integration, tool calling, and artifact generation. The RSS snippet frames it as an agent-focused model, but the post does not disclose context length. It also omits benchmark scores, pricing, API limits, release schedule, and reproducible evaluation conditions.

Why it matters: Qwen launched Qwen3.7-Max, a closed model for agent work, demoing 35 hours of continuous operation and over a thousand tool calls for kernel optimization.

AI HOT (Curated Pool)

Gemini Omni Supports Video Creation With Personal Likeness and Voice

Gemini Omni lets users create digital-avatar videos using their personal likeness and voice, and the avatar can generate videos without uploading an image each time; the post does not disclose pricing, regions, or launch timing.

Why it matters: Gemini Omni lets users build a digital double from their own face and voice, then reuse it for on-camera videos without re-uploading photos each time.

AI HOT (Curated Pool)

ChatGPT Image Generation Surpasses 1.5 Billion Uses Per Week

OpenAI says users generate more than 1.5 billion images per week in ChatGPT, and the post discusses new use cases and trends since the release of Images 2.0.

Why it matters: The weekly image-generation volume shows how large image creation has become inside a chat product.

AI HOT (Curated Pool)

Google launches new AI search box with multimodal interactions

Google launched an AI search box based on Gemini 3.5, combining AI Overviews and AI Mode into one AI search experience that supports multimodal multi-turn queries across text, images, files, and video, with global availability on desktop and mobile.

Why it matters: Google merged AI Overviews and AI Mode into one search box that takes mixed text, image, file and video queries with follow-ups, live worldwide on desktop and mobile.

AI HOT (Curated Pool)

Google Tensor ML SDK Beta Released

Google released the Tensor ML SDK beta, letting developers convert, compile, and run PyTorch or TFLite models on Pixel 10 TPUs through LiteRT, with a model library containing more than 100 classic and generative AI models, including Gemma 3.

Why it matters: Developers can now run their own PyTorch or TFLite models on the Pixel 10's TPU, which makes on-device inference testable without Google's cloud.

AI HOT (Curated Pool)

Gemini Omni launches with physical reasoning and multimodal generation

Google launched Gemini Omni video generation for global AI Plus, Pro, and Ultra subscribers, integrating it with Gemini app, Google Flow, and YouTube Shorts, while the RSS snippet says the model combines intuitive physical reasoning with Gemini’s historical, scientific, and cultural knowledge.

Why it matters: Gemini Omni reasons about how objects fall and collide, so generated video holds together instead of just looking plausible frame by frame.

AI HOT (Curated Pool)

Gemini Omni: A new model for creating content from any input

Google AI published a Gemini Omni post, saying the model creates content from any input starting with video; the post does not disclose parameters, pricing, availability timing, or benchmark results.

Why it matters: Google teased a model that generates from any input and leads with video, but has published nothing beyond a tweet.

AI HOT (Curated Pool)

Google releases Gemini Omni multimodal generation model

Google released Gemini Omni, a multimodal generation model that combines image, video, and text inputs to generate videos grounded in Gemini’s real-world knowledge; the post does not disclose model size, pricing, or availability.

Why it matters: Google says Gemini Omni takes mixed image, video and text input and outputs video, with no model size or release date disclosed.