Skip to content

#多模态

4 today

Jun 10Wednesday

AI HOT (Curated Pool)

Anthropic launches safety-treated Mythos-class model Claude Fable 5

Anthropic released Claude Fable 5, a safety-treated Mythos-class model; in high-risk cyber, biochemistry, and distillation domains, it automatically falls back to Opus 4.8, with one trigger per 20 conversations on average.

Why it matters: Anthropic shipped its strongest model, Claude Fable 5, which automatically falls back to Opus 4.8 in sensitive areas like cybersecurity and biochemistry, triggering about once every 20 conversations.

AI HOT (Curated Pool)

Claude Fable 5 and Claude Mythos 5

Anthropic launched Claude Fable 5 and Claude Mythos 5 at $10 per million input tokens and $50 per million output tokens. Fable 5 leads FrontierCode among frontier models, while Mythos 5 reports about 10x acceleration in drug design and about 80% scientist preference in blinded molecular biology hypothesis tests.

Why it matters: Anthropic's two new models split consumer and defense access, and Stripe's one-day migration shows what the consumer model can do.

The Verge · AI

Anthropic releases its first Mythos-class model Claude Fable 5

Anthropic launched Claude Fable 5, calling it the most capable model it has ever released widely. It excels at software engineering, knowledge work, and vision, with its lead growing on longer, more complex tasks. This is the first broad release from the Mythos family, previously deemed too dangerous because of cybersecurity capabilities. New safeguards that block responses in specific high-risk areas made the release possible. The post doesn't disclose benchmarks, pricing, or a launch date.

Why it matters: Anthropic released Claude Fable 5, the first Mythos-class model to ship widely, after the line was held back over its cybersecurity strength, and paired the launch with safeguards that block answers in high-risk areas.

TechCrunch · AI

Anthropic releases Claude Fable 5, a public version of its top Mythos model with hard safety limits

Anthropic opened its most powerful model family to the public for the first time with Claude Fable 5, a version of Mythos. It excels at software engineering, knowledge work, and vision, but blocks responses in high-risk areas like cybersecurity, biology, chemistry, and distillation, falling back to Claude Opus 4.8. Mythos was previewed in April for select partners only due to cybersecurity concerns. The post doesn't spell out Fable 5's parameter count, pricing, or regional availability.

Why it matters: Anthropic opened its strongest internal model, Mythos, to the public as Claude Fable 5, but it refuses high-risk requests in cybersecurity, biology, chemistry and model distillation and falls back to Claude Opus 4.8.

Jun 9Tuesday

AI HOT (Curated Pool)

Google Releases Gemini 3.5 Live Translate for Real-Time Speech Translation

Google released Gemini 3.5 Live Translate, a speech-to-speech translation model that supports more than 70 languages, starts translating before the speaker finishes, uses streaming updates, and runs through Gemini Live API, Google Meet preview, and Google Translate apps on iOS and Android.

Why it matters: Google released Gemini 3.5 Live Translate, covering more than 70 languages and translating as it listens instead of waiting for a full sentence, with latency down to a few seconds.

AI HOT (Curated Pool)

Google DeepMind Releases Gemma 4 12B, a Unified Encoder-Free Multimodal Model

Google DeepMind released Gemma 4 12B, a multimodal model with a unified encoder-free architecture, native audio input, Apache 2.0 licensing, and local laptop runtime with 16GB of VRAM or unified memory.

Why it matters: Google DeepMind open-sourced Gemma 4 12B, dropping separate vision and audio encoders so one Transformer handles images, text and speech, and it runs on 16GB of VRAM.

AI HOT (Curated Pool)

GPT-5.5 Replaces OCR as ChinaRxiv Papers Become Freely Available

A developer replaced a complex OCR pipeline with GPT-5.5, making 23,000+ ChinaRxiv papers freely available with more complete English translations.

Why it matters: A developer replaced a conventional OCR pipeline with GPT-5.5 to open up more than 23,000 ChinaRxiv papers for free with fuller English translations, a transferable option for bulk Chinese-paper workflows.

AI HOT (Curated Pool)

Tencent Hunyuan Releases UniRL, a Unified Multimodal RL Infrastructure

Tencent Hunyuan released UniRL, using one post-training loop to cover diffusion and flow-matching models, LLM/VLM systems, and unified multimodal models, while open-sourcing two algorithms, DRPO and Flow-DPPO.

Why it matters: Tencent Hunyuan open-sources UniRL, putting RL training for diffusion, flow matching, language and vision-language models into one post-training loop, with models and algorithms decoupled for free combination.

AI HOT (Curated Pool)

How an Agent Chains Two HuggingFace Spaces to Build a 3D Paris Gallery

A coding agent chained ideogram-ai/ideogram4 and VAST-AI/TripoSplat to generate Paris monument images, reconstruct single-image 3D Gaussian splats as .ply files, convert them to .ksplat with about 3× smaller size, and deploy a static Three.js Space using APIs exposed through agents.md.

Why it matters: A coding agent chains ideogram4 and TripoSplat HuggingFace Spaces into a text-to-3D scene pipeline, a transferable pattern for agents orchestrating multiple tools.

Jun 8Monday

AI HOT (Curated Pool)

Runway Aleph 2.0 Editing Model Adapts Videos to Any Format

Runway introduced the Aleph 2.0 video editing model, letting users upload an existing video in its desktop web app, choose an aspect ratio, and have the model fill the remaining scene area for the selected format.

Why it matters: Runway put Aleph 2.0 on its desktop web app: upload an existing video, pick an aspect ratio, and the model fills in the extra frame area so the result looks shot that way.

AI HOT (Curated Pool)

Microsoft AI CEO: Superintelligence Is Coming, but It Won’t Replace Your Job

Mustafa Suleyman said superintelligence is coming without causing mass unemployment; Microsoft signed a new OpenAI contract last October and released seven omnimodal models at Build this week.

Why it matters: Microsoft AI chief Mustafa Suleyman argued on a podcast that superintelligence will not cause mass unemployment, while Microsoft has secured permission to pursue superintelligence independently and is training frontier models.

r/LocalLLaMA

Been Watching Real Adversarial Input Hit My Detection API for Six Months

Bordair’s author says six months of detection-API traffic showed three recurring attack patterns: multi-turn setup, forward-momentum exploitation, and role redefinition; the public adversarial game produced roughly 6,700 attacks last month.

Why it matters: Bordair's author ran a detection API against live traffic for six months and sorted the attacks into three recurring patterns, with about 6,700 hits in last month's adversarial game.

AI HOT (Curated Pool)

Amap Releases 3D-Native City World Model ABot-Earth0.5

Amap released ABot-Earth0.5, a 3D-native city world model covering more than 190 countries and regions, generating kilometer-scale 3D cities from satellite images or text within 10 minutes on consumer GPUs.

Why it matters: Amap released ABot-Earth0.5, which turns one satellite image or a text prompt into a kilometer-scale 3D city scene in about 10 minutes on a consumer GPU, exported as 3DGS for Unity and Unreal.

Financial Times · Technology

The AI Spying Breakthrough That Spooked the Kremlin

FT says AI can use CCTV data to identify targets, and Russia paused a surveillance system after the killing of Iran’s Supreme Leader; the RSS snippet does not disclose the system name, model mechanism, vendor, or timeline.

Why it matters: The FT reports AI can identify targets from CCTV footage, and Russia paused one surveillance system after Iran's supreme leader was assassinated, though the system name and model details can't be verified.

Jun 7Sunday

AI HOT (Curated Pool)

A Hokkaido Broccoli Farmer’s 8 Real AI Uses with ChatGPT and Codex

Hokkaido farmer Hiroki Tomiyasu uses ChatGPT and Codex for 8 farm tasks, including broccoli disease recognition, NDVI monitoring, ESP32 greenhouse control, LINE chatbots, sowing-count tracking, RTK-GPS steering study, and an Airtable farm database.

Why it matters: Hokkaido farmer Hiroki Tomiyasu built 8 working field tools with ChatGPT and Codex, no outsourcing and no programming study, a still-rare case of a non-programmer using AI to write code for physical-world work.

QbitAI · WeChat

Kuaishou Kling Proposes VLM-as-Teacher for Test-Time Video Reasoning Optimization

City University and Kuaishou Kling proposed VLM-as-Teacher, which uses VLM feedback to optimize VGM LoRA at test time, reporting a 16.7-point average gain and raising VBVR-Bench from 0.666 to 0.781.

Why it matters: Kuaishou Kling and CityU use a vision-language model as a test-time teacher, feeding LoRA updates to a video generator so it follows text rules while it generates.

QbitAI · WeChat

Chinese open-source framework targets stable 5-minute AI long-video generation

JD open-sourced JoyAI-Echo, a long audio-video generation framework for 5-minute consistent videos, using cross-modal memory, DMD post-training for about 7.5x faster inference, and real-time upscaling from 720P to 1K or 2K output.

Why it matters: JD's open-source JoyAI-Echo uses a cross-modal memory module to keep characters and scenes consistent across 5-minute videos, with roughly 7.5x faster inference.

Jun 6Saturday

AI HOT (Curated Pool)

OpenCV 5 Released with New DNN Engine and Native LLM Support

OpenCV 5 introduces a graph-based DNN engine, raising ONNX operator coverage from under 23% in 4.x to over 80%, with native support for Transformer, VLM, and LLM workloads.

Why it matters: OpenCV 5 moves the DNN engine to a compute graph with operator fusion, lifting ONNX operator coverage from under 23% in 4.x to over 80%, so models that previously would not import now run directly.

r/LocalLLaMA

Big week for open AI, with 25+ notable open-weight drops across every modality

Victor M summarized 25+ open-weight model releases in one week, including NVIDIA Nemotron 3 Ultra, a 550B hybrid Mamba-MoE with 55B active parameters and a 1M-token context window.

Why it matters: More than 25 open-weight models shipped in a week across text, image and speech, with NVIDIA's Nemotron 3 Ultra at 550B parameters and a 1M token context.

Synced · WeChat

Daxiao Robotics and NTU Release PhysX-Omni for Simulation-Ready Physical 3D Generation

PhysX-Omni models rigid, deformable, and articulated objects in one simulation-ready 3D generation framework, while PhysXVerse contains over 8.7K physical 3D assets across more than 2.9K categories.

Why it matters: Daxiao Robotics and NTU's PhysX-Omni generates 3D objects with physics properties that run directly in simulators, backed by 8,700+ assets in PhysXVerse.

Synced · WeChat

Video AI Moves to 5 Minutes: Fully Open Source, One-Pass Generation, No Blind-Box Sampling

JD open-sourced JoyAI-Echo, a long audio-video generation framework that supports up to 5 minutes of cross-shot audiovisual consistency, local repainting, 8-step DMD distillation, and output up to 1472×2560 resolution.

Why it matters: JD open-sourced JoyAI-Echo, which generates video with audio up to five minutes long and keeps visuals and sound consistent across shots, giving long-video generation a reusable open path.

AI HOT (Curated Pool)

Google AI weekly product updates: Nano Banana 2, Co-Scientist, dreambeans, Gemma 4, and more

Google AI announced six updates: Nano Banana 2 is generally available, Gemma 4 12B can run fully offline on laptops, and Magenta RealTime 2 is open source.

Why it matters: Google shipped six AI updates in one week, including Nano Banana 2 and Pro plus the multi-agent research assistant Co-Scientist, covering multimodal generation and research hypothesis optimization.

AI HOT (Curated Pool)

Gemini Live supports real-time image creation and editing

Gemini App adds real-time image creation and editing inside Live; users must open Live, share the camera, and tell Gemini what they want to see.

Why it matters: Live mode in the Gemini app now generates and edits images in real time, so users can point a camera, describe a change and see it applied on the spot, from wall colors to memes.

Hacker News front page

Launch HN: General Instinct (YC P26) – Frontier Models on Edge Devices

General Instinct open-sourced InstinctRazor, compressing Qwen3.5-122B-A10B from a roughly 245GB BF16 MoE model into a 48GiB GGUF, with a small-GPU mode that streams experts from system RAM and uses about 7.6–8GB peak VRAM at an 8k context window.

Why it matters: General Instinct open-sourced InstinctRazor, a compression method that shrinks the 245GB Qwen3.5-122B-A10B mixture-of-experts model to 48GB for edge devices, a path worth studying for teams running large models locally.

Jun 5Friday

AI HOT (Curated Pool)

Meta Smart Glasses App Contains Face Recognition Code, NameTag Pushed to Over 50 Million Devices

Meta pushed face-recognition code named NameTag into its smart-glasses companion app, which has more than 50 million downloads; the feature uses three AI models to convert faces into local face templates and match them against a phone database.

Why it matters: A researcher pulled unused face-recognition code, NameTag, from Meta's smart glasses app, and its core components already shipped silently to devices with over 50 million downloads.

r/LocalLLaMA

Microsoft released MAI models instead of something like Qwen3.6-27B or Gemma-4-31B

Microsoft AI released seven MAI models, with MAI-Thinking-1 listed as 1T A35B with a 256K context window and MAI-Code-1-Flash listed as 137B A5B with a 256K context window.

Why it matters: Microsoft released seven MAI models at once, including a 1T A35B reasoning version and a 137B A5B code version, both with 256K context, against community hopes for mid-size open models.

Synced · WeChat

MetaFine proposes a diagnostic meta-evaluation framework for fine-grained robot manipulation

Southeast University and Peking University researchers introduced MetaFine, a diagnostic meta-evaluation framework that tests fine-grained robot manipulation across understanding, perception, and behavior, and the article says traditional binary success metrics can overestimate fine-manipulation capability by up to 70%.

Why it matters: Southeast University and Peking University researchers propose MetaFine, a meta-evaluation framework that diagnoses robot fine manipulation through understanding, perception and action, and finds success-rate-only evaluation overstates ability by up to 70%.

QbitAI · WeChat

Yao Shunyu Responds to Whether Tencent Is Behind in AI

Yao Shunyu said at Tencent Cloud’s AI industry application conference that Hunyuan 3 rebuilt pretraining and reinforcement-learning infrastructure, changed data and evaluation, and assigned its strongest post-training staff to improve Yuanbao first; he named coding agents, multimodality, and embodied AI as Tencent’s next focus areas.

Why it matters: Tencent's response to claims it lags in AI, plus how Hunyuan 3 rebuilt pretraining and RL and where post-training staff were reassigned.

AI HOT (Curated Pool)

Google Magenta RealTime 2 (MRT2) real-time music model released

Google AI for Developers released the open-weight Magenta RealTime 2 music model, supporting MIDI, live text prompts, and gestures, with native MacBook latency under 200 ms.

Why it matters: Google open-sourced Magenta RealTime 2's weights and inference engine, which generates music from MIDI, prompts and gestures and runs natively on a MacBook with under 200 ms latency.

AI HOT (Curated Pool)

Boson AI and LMSYS Release Higgs Audio v3 TTS End-to-End Service Based on SGLang-Omni

Boson AI and LMSYS released the Higgs Audio v3 TTS service with about 4B parameters, a Qwen3-4B backbone, support for 100 languages, streaming synthesis, and text tags for controlling 20+ emotions plus style, rhythm, and sound effects.

Why it matters: Boson AI and LMSYS put the 4B-parameter Higgs Audio v3 TTS into SGLang-Omni for end-to-end serving, with 100 languages and tuning for streaming voice assistants that generate speech as they go.

Jun 4Thursday

AI HOT (Curated Pool)

Nex-N2-Pro launches as a 397B MoE reasoning model based on Qwen3.5

neolab released Nex-N2-Pro, a 397B-parameter MoE reasoning model based on Qwen3.5-397B-A17B, with 262K context, VLM support, claimed GPT-5.5 and Claude Opus 4.7-level performance, 30–50% fewer thinking tokens, SOTA results on Terminal Bench 2.1, GDPVal, and SWE-Verified, plus free access for the first two weeks via SiliconFlow.

Why it matters: neolab released a 397B-parameter MoE reasoning model built on Qwen3.5, with 260k-token context and image recognition, claiming benchmark scores on par with GPT-5.5.

Xinzhiyuan · WeChat

MoleculeMind releases MMDesign, claims over 90% target hit rate

MoleculeMind released MMDesign, an AI platform for de novo biologics design. In tests across 12 therapeutic targets, it validated specific binding on 11 targets, sending only 14 to 50 molecules per target into wet-lab assays and reporting a target success rate above 90%.

Why it matters: MoleculeMind's MMDesign platform ran wet-lab tests on 14 to 50 molecules per target across 12 therapeutic targets, with specific binding measured on 11 of them.

Xinzhiyuan · WeChat

Silicon Valley CEO backs MiniMax M3 as it tops open-source rankings amid Chinese community debate

MiniMax M3 ranks first among open-source models on Artificial Analysis, and the article says it supports a 1M-token context window, used 100T-scale pretraining, and will open-source its weights and full technical report within 10 days.

Why it matters: MiniMax M3 tops Artificial Analysis's open-source ranking with a 1M token context and hundreds of trillions of pretraining tokens, and the weights and tech report are promised within 10 days.

Synced · WeChat

Google releases Gemma 4 12B for 16GB laptops

Google released Gemma 4 12B, a medium-size model that runs locally with 16GB VRAM or unified memory. It uses an encoder-free multimodal architecture, supports native audio input, ships under Apache 2.0, and includes an MTP draft model for lower latency.

Why it matters: Gemma 4's new 12B member runs locally on a 16GB laptop and takes audio input natively, giving developers a fresh open option for on-device deployment.

QbitAI · WeChat

CVPR 2026: NVIDIA, Tesla, and Waymo hear Xpeng present physical AI

Xpeng presented its world-model stack at CVPR 2026, covering X-World, X-Foresight, and X-Cache; the article says X-Cache cuts about 70% of repeated computation, the second-generation VLA used over 4 trillion training tokens, and the in-car stack reduced inference latency to 80 ms.

Why it matters: XPeng's CVPR 2026 world-model stack cuts redundant compute by about 70% with X-Cache and trains its second-gen VLA on over 4 trillion tokens.

AI HOT (Curated Pool)

Ideogram 4.0 Open-Source Text-to-Image Model Released

Ideogram released Ideogram 4.0, an open-source text-to-image model with a 9.3B-parameter core, a single-stream DiT architecture, Qwen3-VL-8B-Instruct text encoder, and a No. 4 ranking in DesignArena human evaluation.

Why it matters: Ideogram 4.0 ships open source at 9.3B parameters, running text and images through one pipeline, with long-text rendering and prompt-specified layout as its main tricks.

Financial Times · Technology

MP sues Musk’s xAI in UK test case over fake sexual images

UK MP Jess Asato sued Musk’s xAI over fake sexual images, using the claim to test whether AI model makers are liable for system outputs; the post does not disclose the model, generation mechanism, damages sought, or court timetable.

Why it matters: UK Labour MP Jess Asato is suing Musk's xAI over fake sexual images of her, a test case on whether model developers are liable for what their models output.

Hacker News front page

Gemma 4 12B: A Unified, Encoder-Free Multimodal Model

Google’s title introduces Gemma 4 12B as a unified, encoder-free multimodal model; the RSS snippet only lists 137 Hacker News points and 48 comments, and the post does not disclose architecture details, training setup, pricing, release terms, or benchmark results.

Why it matters: Google released Gemma 4 12B with a unified multimodal design that drops the separate vision encoder, letting one model handle text and images directly.

Jun 3Wednesday

r/LocalLLaMA

google/gemma-4-12B on Hugging Face

Google DeepMind released Gemma 4 open-weight models in five sizes, with the 12B variant supporting text, image, and audio input, instruction-tuned and pre-trained variants, native system prompts, function calling, and a context window of up to 256K tokens.

Why it matters: Google DeepMind posted open weights for five Gemma 4 sizes on Hugging Face, with the 12B version taking text, images and audio and a context window up to 256K tokens.

MIT Technology Review · AI

The Download: Trump’s New AI Order, and Smart Glasses for Warfare

President Donald Trump signed a new AI order asking companies to voluntarily submit frontier models for government review 30 days before release, without mandatory licensing; the newsletter also says Anduril and Meta are prototyping a military AR headset that envisions drone-strike orders through eye tracking and voice commands.

Why it matters: Trump signed a new AI executive order requiring tech companies to voluntarily submit frontier models for government review 30 days before release, shorter than the shelved 90-day version.