Skip to content

#多模态

1 today

Jun 3Wednesday

Synced · WeChat

RSS 2026: Ant Lingbo Proposes Autoregressive Causal World Model for Robot Manipulation with 50 Demos

Ant Lingbo and HKUST introduced LingBot-VA, an autoregressive video-action world model that unifies visual dynamics prediction and action inference, and the paper reports fine-tuning with 50 real-world demonstrations per task plus 92.0% and 91.1% success on RoboTwin 2.0 Easy and Hard settings.

Why it matters: HKR-H/K/R all pass: the hook is 50-demo robot control, with a concrete video-action world-model mechanism. Single-source coverage lacks code, benchmark detail, and deployment evidence, so it lands at 78.

Latent Space

[AINews] Microsoft Build: MAI-Thinking-1 and MAI Family Models

Microsoft announced seven MAI models at Build, with MAI-Thinking-1 described as a 35B-active-parameter MoE with a 256K context window, and released a 109-page technical report covering training, data lineage, and performance claims.

Why it matters: All HKR axes pass: Microsoft’s MAI family has concrete specs, a long technical report, and clear competitive stakes around its model stack. This clears the 85+ same-day bar, but no weights, pricing, or external evals are disclosed, so it lands at 87.

QbitAI · WeChat

Daxiao Robot and NTU Release PhysX-Omni for Unified Physical 3D Generation

Daxiao Robot and NTU introduced PhysX-Omni, a unified simulation-ready physical 3D generation framework for rigid, deformable, and articulated objects, with PhysXVerse covering 8.7K assets across 2.9K categories and PhysX-Bench evaluating six dimensions including geometry, scale, material, affordance, kinematics, and description.

Why it matters: HKR-H/K/R all pass: unified physical 3D generation is a clear hook, the dataset and benchmark numbers add substance, and robotics simulation data is a real practitioner pain. No open-source or product adoption is disclosed, so it stays at 78.

AI HOT (Curated Pool)

xAI releases Grok Imagine 1.5 preview image-to-video model

xAI released grok-imagine-video-1.5-preview via its API, letting users turn one still image into 720p video while controlling camera movement, pacing, and sound effects with natural-language prompts.

Why it matters: HKR-H/K/R all pass: xAI ships a named image-to-video API preview with 720p output and sound controls. It stays below 85 because this is a preview product update, not a flagship foundation-model release.

AI HOT (Curated Pool)

Runway API adds Aleph 2.0 video editing

Runway API now provides Aleph 2.0 video editing for integration into apps, products, and platforms, supporting precise edits on multi-shot videos up to 30 seconds at 1080p while changing only selected portions; the post does not disclose pricing, rate limits, latency, or model availability by region.

Why it matters: Runway is a core AI-video player, and Aleph 2.0 exposes partial video editing via API with 30s and 1080p limits. HKR-H/K/R all pass, but this is a mid-weight product update, not a model-class release.

r/LocalLLaMA

Using Gemma 4 E4B with LiteRT: about 2.4× faster text generation than Q4 GGUF

The author tested Gemma 4 E4B on an RTX 4060 Ti 16GB, where LiteRT averaged 157.2 tok/s for text generation versus 66.3 tok/s for llama.cpp Q4 GGUF; image captioning on 111 full-resolution images improved only 1.1×, at about 72 seconds versus 80 seconds.

Why it matters: HKR-H/K/R all pass, with a first-person benchmark including hardware, throughput, and sample count. Source authority is limited to one Reddit test, so it sits at the featured threshold rather than the 78+ band.

The Verge · AI

Microsoft’s Project Solara is an OS for AI agent gadgets

Microsoft announced Project Solara at Build 2026 as an Android-based OS for AI agent gadgets, not Windows, and the post discloses two concept devices: a desk device with facial recognition and a wearable badge with a camera and fingerprint scanner.

Why it matters: HKR-H/K/R all pass: Project Solara ties Microsoft, Android, and agent gadgets together, with two concrete hardware concepts. Score stays below P1 because shipping date, developer APIs, and pricing are not disclosed.

Jun 2Tuesday

AI HOT (Curated Pool)

StepFun releases Step 3.7 Flash as an open-weight model for agentic coding

StepFun released the open-weight Step 3.7 Flash model for fast agentic coding, with tool calling and multimodal understanding, and the model is already available in Kilo alongside MiniMax M3.

Why it matters: HKR-H/K/R pass on the open-weight agentic-coding angle and Kilo availability. Missing benchmarks, size, license, and pricing keep it at the lower featured threshold.

r/LocalLLaMA

NVIDIA releases Cosmos 3 Omnimodal world models on Hugging Face

NVIDIA released Cosmos 3 on Hugging Face with Nano at 16B parameters and Super at 64B parameters; the post says the models generate video, images, audio, and action commands from text, image, video, and action-trajectory inputs.

Why it matters: HKR-H/K/R all pass: NVIDIA world models on HF, concrete 16B/64B variants, and multimodal robotics relevance. Missing benchmarks, license, and training details keep it in the 78–84 band.

QbitAI · WeChat

Jensen Huang Brings NVIDIA CPUs Into the PC Market

NVIDIA RTX Spark will ship in Windows PCs this fall with 1 petaflop of AI compute and 128GB unified memory. The platform combines a Blackwell RTX GPU, a 20-core Arm-based Grace CPU, and NVLink-C2C, and NVIDIA says it can run 1-million-token-context, 120B-parameter language models locally.

Why it matters: HKR-H/K/R all pass: NVIDIA is moving RTX Spark into Windows PCs with concrete specs: 1 petaflop, 128GB unified memory, 1M context, and 120B local models. This is a strong hardware product update, not a foundation-model release, so it lands in 78–84.

Latent Space

[AINews] NVIDIA Cosmos 3, Nemotron 3 Ultra, and RTX Spark

NVIDIA released Cosmos 3 and Nemotron 3 Ultra; Cosmos 3 uses a Mixture-of-Transformers design with 16B Nano and 64B Super variants, while Nemotron 3 Ultra is described as a 550B-A55B open-weight model.

Why it matters: HKR-H/K/R all pass: NVIDIA ships Cosmos 3, Nemotron 3 Ultra, and RTX Spark with concrete MoT, 16B/64B, and 550B-A55B open-weight details. Impact is broad, but below a frontier-lab model release.

AI HOT (Curated Pool)

NVIDIA Cosmos 3 Tops Open-Weight Image and Video Generation Rankings

NVIDIA Cosmos 3 ranked first in Artificial Analysis’s open-weight text-to-image and image-to-video categories, with 16B Nano and 64B Super variants, and the release includes weights, code, curated datasets, and fine-tuning recipes under the OpenMDW 1.1 license.

Why it matters: HKR-H/K/R all pass: Cosmos 3 leads both Artificial Analysis open-weight image and video charts, with 16B/64B variants and OpenMDW 1.1 artifacts disclosed. Single-source benchmark news keeps it in the 78–84 featured band.

AI HOT (Curated Pool)

Gemini Omni Supports Creating Personal Digital Avatars

Gemini App says Gemini Omni can add users to video creation by generating a digital avatar that resembles their appearance and voice; the post does not disclose rollout scope, pricing, or safety mechanisms.

Why it matters: HKR-H/K/R all pass: the official Gemini App post has a strong multimodal avatar hook. Scope, pricing, consent, and safety controls are not disclosed, keeping it in the mid-weight product-update band.

Jun 1Monday

AI HOT (Curated Pool)

MiniMax Releases Open-Source M3 with Coding, Long-Context, and Multimodal Capabilities

MiniMax released the open-source M3 model with coding, a 1M-token context window, and native multimodal support; M3 scores 59.0% on SWE-Bench Pro, 83.5% on BrowseComp, and costs about one-twelfth per token versus GPT-5.5.

Why it matters: HKR-H/K/R all pass: M3 has open source, 1M context, multimodal support, and 59.0% on SWE-Bench Pro. A single X post without official docs or third-party tests keeps it in the 78–84 band.

Latent Space

Why Video Agent Models Are Next — Ethan He on xAI Grok Imagine

Ethan He says a small xAI team built Grok Imagine from zero to one in 3 months, and the episode discusses video agents, audio-video alignment, inference speedups, and the storage, egress, and GPU-hour costs behind large video datasets.

Why it matters: HKR-H/K/R all pass, but the body is interview-level signal: beyond the 3-month build and mechanism themes, it gives no benchmarks, cost figures, or reproducible test. Strong xAI video-agent context, not same-day must-write.

AI HOT (Curated Pool)

NVIDIA Open-Sources Cosmos 3, Its First Generalist Model for Physical AI

NVIDIA open-sourced Cosmos 3 at GTC Taipei, releasing two variants, Super 32B and Nano 8B, with model weights, code, and datasets made available.

Why it matters: HKR-H/K/R all pass: the concrete hook is NVIDIA opening Cosmos 3 with 32B/8B variants and released artifacts. The post is sparse and single-source, with no benchmarks or license details, so it stays in the 78–84 band.

Xinzhiyuan · WeChat

400 tokens/s: StepFun Step 3.7 Flash cuts Agent task costs

StepFun released Step 3.7 Flash, a sparse MoE model with 196B parameters plus a 1.8B ViT, activating 11B parameters per inference and reaching up to 400 tokens per second.

Why it matters: HKR-H/K/R all pass with concrete speed and parameter numbers. The feed does not disclose pricing, benchmark setup, or open-source terms, so this stays in the 78–84 quality update band.

Synced · WeChat

OpenAI recruits for robotics team led by Sora creator Aditya Ramesh

OpenAI has listed more than a dozen San Francisco robotics roles for OpenAI Robotics, a team that evolved from Aditya Ramesh’s Worldsim work, with the actuator design engineer role offering $342,000 to $445,000 in base cash pay plus PPU incentives.

Why it matters: HKR-H/K/R all pass: OpenAI robotics hiring adds a strong hook, plus concrete roles, leader, and salary range. This is still a hiring signal, not a model or product release, so it stays in the featured-threshold band.

Synced · WeChat

World models get a “save state”: VAST releases Project Eden

VAST released Project Eden, a three-layer world-model architecture that separates persistent state evolution from visual rendering, and disclosed nearly $200 million across its A+ and A++ funding rounds.

Why it matters: HKR-H/K/R all pass: Project Eden has a product hook, architecture detail, and funding scale. VAST is not a top foundation-model lab, and benchmarks or access terms are not disclosed, so this lands in 78–84.

QbitAI · WeChat

How Cloud Models Reach the Physical World: CMG Lion Rock AI Lab Uses LiOS for Embodied AI

CMG Lion Rock AI Lab released the LiOS edge-cloud architecture for embodied robotics, reporting about 30 ms one-way latency from local camera to cloud GPU memory in cross-machine tests, and open-sourced the low-latency video transmission module plus the LeFold laundry-folding dataset.

Why it matters: HKR-H/K/R pass: LiOS offers a concrete latency claim and open artifacts for embodied AI. Impact stays mid-tier because the lab is not a top platform vendor and no cross-source cluster is shown.

QbitAI · WeChat

VAST Raises Nearly $200M and Discloses Its Project Eden World Model Roadmap

VAST raised nearly $200 million in A+ and A++ rounds and disclosed Project Eden, a world model architecture that separates state evolution from visual rendering through a structured state layer, a conditional interface layer, and a generative rendering layer.

Why it matters: HKR-H/K/R all pass: the $200M A+/A++ financing is sizable, and Project Eden gives a concrete three-layer world-model mechanism. VAST is not a top-tier foundation-model lab and no metrics or release details are disclosed, so this stays in the 78–84 band.

AI HOT (Curated Pool)

Introducing Cosmos Coalition

Runway joined Cosmos Coalition as a founding member and will co-develop the first open world-model foundation model for physical AI with NVIDIA.

Why it matters: HKR-H/K/R all pass: Runway plus NVIDIA and an open physical-AI world model is strong. Details are thin—no params, license, or benchmarks—so it stays in the 78–84 band.

AI HOT (Curated Pool)

Cosmos 3 Released: First Open Physical AI Generalist Model

NVIDIA released Cosmos 3 as an open physical AI generalist model with native visual reasoning, world generation, and action generation, offering two variants: Super at 32B parameters and Nano at 8B parameters.

Why it matters: HKR-H/K/R all pass: NVIDIA names two Cosmos 3 variants and concrete physical-AI capabilities. Source is a single launch post with no benchmark or license detail, so it stays in the 78–84 band.

AI HOT (Curated Pool)

MiniMax M3: Frontier coding, 1M-token context, and native multimodal model

MiniMax released M3 as an open-source unified model with coding, agent, and native multimodal capabilities, supporting a 1M-token context window and using MiniMax Sparse Attention to cut per-token compute at 1M context to 1/20 of its predecessor, with over 9x faster prefill and over 15x faster decoding.

Why it matters: HKR-H/K/R all pass: MiniMax M3 has a 1M-token context hook, MSA with a claimed 20x cost cut, and open-source China-model resonance. Single official-source release keeps it in the 78–84 band, not P1.

AI HOT (Curated Pool)

Qwen3.7-Plus: Multimodal Agent Intelligence

Qwen Studio lists seven capability areas: chatbots, image and video understanding, image generation, document processing, web search integration, tool use, and artifact generation; the post does not disclose Qwen3.7-Plus parameters, pricing, or release timing.

Why it matters: HKR-H/K/R pass, but the facts are thin: 7 capability categories, no params, pricing, benchmarks, or launch terms. A Qwen flagship update clears featured, not p1.

Bloomberg Technology

Gen-Z Gamer’s 3D-Model Startup Becomes China’s Latest AI Unicorn

Vast raised nearly $200 million and reached a $1 billion valuation; the RSS snippet says the 3D-modeling startup was founded by a 29-year-old gamer but does not disclose investors or product specifications.

Why it matters: HKR-H/K/R pass: the founder angle is clickable, the funding and valuation are concrete, and China AI funding has resonance. Missing investors and product specs keep it in the 72–77 band.

OpenAI News

OpenAI bans PRC-linked accounts using ChatGPT to generate comments on US tech policy and tariffs

OpenAI's June 2026 threat report details a banned cluster of ChatGPT accounts likely originating in China. The operators used Simplified Chinese prompts and VPNs to generate English comments and political cartoons criticizing US tariffs, rare earths, AI, and 5G policy. They instructed the model to depict only Trump, not Xi Jinping or China. The same cluster produced Chinese-language water army content attacking the US and Israel, amplifying anti-Jewish tropes, and harassing dissidents. OpenAI also linked these accounts to a separate X network that falsely claimed ChatGPT user data was compromised. The post does not disclose the exact number of banned accounts or the operators' specific institutional affiliation.

Why it matters: OpenAI's official threat report names a PRC-origin AI influence operation with concrete details and high topic sensitivity. Hits all three HKR axes, but it's a security incident report rather than a product/tech breakthrough, placing it in the 78-84 band per policy.

May 31Sunday

Xinzhiyuan · WeChat

Fudan-Linked Team Releases STI-WM Spatiotemporally Integrated World Model

MouShen Intelligence released STI-WM, a spatiotemporally integrated world-action model for robotics, claiming support for RGB, point-cloud, and proprioceptive inputs, hundred-second task planning, and disclosing five funding rounds in six months plus a RMB 300 million Pre-A round.

Why it matters: HKR-H/K/R pass: STI-WM combines RGB, point clouds, and proprioception for 100-second planning, plus 5 funding rounds and a RMB300m Pre-A. Company-claim framing lacks public benchmarks or reproducible access, so it stays near the featured threshold.

QbitAI · WeChat

Robot-Native World Action Model Debuts With Spatiotemporal Architecture From Fudan-Linked Team

Moushen Intelligence released STI-WM, a spatiotemporally integrated world action model for robotics, with RGB, depth point cloud, and proprioceptive inputs; the post says it supports hundred-second-scale long-horizon task rollout and closed-loop replanning, but does not disclose benchmark scores or deployment costs.

Why it matters: HKR-H/K/R all pass: the STI-WM angle is novel, with concrete input modalities and hundred-second rollouts. Kept near the featured floor because public weights, benchmark results, and reproducible tests are not disclosed.

May 30Saturday

AI HOT (Curated Pool)

AI Scammers Create Fake Black Personas to Sell Low-Quality Shein Goods

Sellers use AI-generated Black personas on TikTok, Facebook, and Instagram to pose as handmade creators and sell mass-produced dropshipped goods; the snippet cites one fake persona, “Aliyah,” selling fictional handmade belt buckles.

Why it matters: HKR-H/K/R all pass: the story has a sharp synthetic-identity scam hook, a concrete cross-platform dropshipping mechanism, and clear safety resonance. No scale numbers are disclosed, so it stays in the 72–77 band.

AI HOT (Curated Pool)

Nano Banana Pro and Nano Banana 2 officially released

Google AI Developers released Nano Banana Pro and Nano Banana 2, mapped to gemini-3-pro-image and gemini-3.1-flash-image. The post says both are production-ready through the Gemini API, but does not disclose pricing, benchmarks, or runtime limits.

Why it matters: HKR-H/K/R all pass: Google names two image models and production Gemini API access. Missing pricing, benchmarks, and invocation limits keep it in the mid product-update band rather than a must-write release.

QbitAI · WeChat

Key Gemini IMO Gold Contributor Nearly Became a Professional Pianist

Yi Tay served as a modeling co-captain for Gemini Deep Think when it reached IMO gold-medal level, co-founded Reka AI in 2023, and returned to Google DeepMind after 639 days, while the article also notes his 2012 Trinity classical piano associate diploma.

Why it matters: HKR-H/K/R all pass, but this is a profile, not a Gemini capability launch. The concrete value is Yi Tay's role, Reka history, and 639-day return, so it sits in the 72–77 featured band.

Synced · WeChat

Apple Uses AI to Rework Image Compression: Same Visual Quality at One-Third the File Size

Apple’s team published PICO, a perceptual image codec that uses 57%-70% fewer bits than AV1, VVC, and JPEG AI at the same subjective visual quality, while encoding a 12MP photo in 230 ms and decoding it in 150 ms on an iPhone 17 Pro Max.

Why it matters: HKR-H/K/R all pass: Apple PICO has concrete 57%-70% bitrate savings and 230 ms on-device encoding data. It remains a research release, not a shipped platform feature, so it sits in the 78-84 band.

Synced · WeChat

NVIDIA and Tsinghua Team's Gamma-World Tops Hugging Face Daily Chart

NVIDIA, Tsinghua, University of Toronto, and Vector Institute released Gamma-World, a multi-agent world model using simplex-based positional encoding and hub tokens to cut interaction cost from quadratic to linear, with 8-player latency dropping from 17.6 ms to 4.5 ms.

Why it matters: HKR-H/K/R all pass: Gamma-World has a concrete mechanism and latency claim from NVIDIA/Tsinghua. Scope remains multi-agent world-model research, so it sits in the 78–84 good-quality band rather than must-write.

AI HOT (Curated Pool)

OpenAI launches real-time translation model with 70+ input languages

OpenAI launched gpt-realtime-translate, a speech translation model that accepts 70+ input languages and outputs speech in 13 target languages; the post says the feature is running on smart glasses.

Why it matters: HKR-H/K/R all pass: OpenAI has a concrete realtime-translation model with numbers and a wearable demo. Missing latency, pricing, and API availability keep it below P1.

The Verge · AI

Tech companies desperately want to film you doing chores

Shift said it would clean New Yorkers’ homes for free if it can film cleaners doing chores such as washing dishes, wiping counters, dusting tables, and mopping floors, creating domestic robot training data; the snippet does not disclose consent terms, data retention, pricing, or expansion timing for cities such as London.

Why it matters: HKR-H/K/R all pass: the odd trade is clickable, the post gives a concrete chore-video collection mechanism, and it hits robotics data plus privacy nerves. This is a strong industry feature, not a major model or platform release, so it sits in 72–77.

May 29Friday

The Verge · AI

This AI startup will clean your home for free to train future robots

Shift offers free home cleaning and records cleaners scrubbing, vacuuming, dusting, tidying, and washing to collect robot training footage; the RSS snippet does not disclose service cities, privacy terms, consent mechanics, or dataset scale.

Why it matters: HKR-H and HKR-R are strong: Shift turns home cleaning into robot-training data collection. HKR-K has a clear mechanism, but city scope, privacy terms, and dataset scale are not disclosed, so this stays low-featured.

The Verge · AI

Adobe’s Conversational AI Agent Is a Mediocre Design Intern

The Verge tested Adobe Firefly AI Assistant in beta. It can operate Adobe design apps as a conversational middleman, rather than only generating images or video. The post says it explains edit steps clearly, but the results were not impressive. The RSS snippet does not disclose pricing, release timing, or the full list of supported apps.

Why it matters: HKR-H/K/R all pass because this is a Verge hands-on of Adobe’s Firefly AI Assistant beta with a clear negative usability hook. Missing pricing, launch timing, and supported-app details keep it in the 72–77 featured-threshold band.

AI HOT (Curated Pool)

Xiaomi Open-Sources Controllable Video Foley Model ControlFoley

Xiaomi’s large model application team open-sourced ControlFoley, a controllable video Foley model supporting three tasks: text-guided video dubbing, text-controlled video dubbing, and reference-audio-controlled video dubbing, with code, model weights, and an online demo released.

Why it matters: ControlFoley clears HKR-H/K/R with controllable video Foley plus code, weights, and demo. It is a useful multimodal-audio release from Xiaomi, but not a flagship foundation-model launch, so it sits near the featured threshold.

AI HOT (Curated Pool)

Google DeepMind CEO Demis Hassabis Says AGI Could Arrive Within Three Years

Demis Hassabis predicts AGI could arrive around 2029 to 2030, with mature multimodal capabilities and autonomous decision-making as key conditions, while warning that society remains underprepared and needs rules and safeguards before deployment.

Why it matters: HKR-H/K/R all pass: Hassabis gives a 2029-2030 AGI window and names multimodal plus autonomous decision-making as conditions. High-interest commentary, but thinner than a model release or major product update.