Skip to content

Multimodal

Beyond text: vision, mixed image-text, audio and video input and output in models and products.

Latest picks

201–220 of 592

Jun 11Thursday

AI HOT (Curated Pool)

Runway and Lionsgate expand partnership with equity stake and joint IP development

Lionsgate has taken an equity interest in Runway and the two will co-develop new IP, starting with a short-form episodic series that blends Lionsgate's existing IP with Runway's generative models. Lionsgate will also be a presenting partner at the Runway AI Festival. The deal builds on their first-of-its-kind partnership from September 2024, where Runway's tools were used for pre-visualization, storyboarding, and final-frame production. Lionsgate was the first Hollywood studio to partner with an applied AI research company, hire a Chief AI Officer, and build out AI infrastructure. Runway co-CEO Cristóbal Valenzuela stressed that studios serious about AI see it as a creative resource, not a cost-cutting tool.

Why it matters: Lionsgate takes a stake in Runway, and the two will co-develop new IP, starting with short dramas built from Lionsgate's existing IP and Runway's video models.

AI HOT (Curated Pool)

Xiaomi open-sources MiMo Code terminal AI coding assistant, beats Claude Code on SWE-Bench Pro

Xiaomi open-sourced MiMo Code V0.1.0 under MIT license. The built-in MiMo-V2.5 multimodal model is free for a limited time and claims performance on par with Claude Sonnet 4.6; it also supports DeepSeek, Kimi, and GLM. Two standout features: a persistent memory system (project memory, session checkpoints, task progress) to avoid forgetting in long sessions, and a Compose mode for model-agent collaboration that hits 62% on SWE-Bench Pro (Claude Code scored 57%) and 73% on Terminal Bench 2. The post doesn't disclose how long the free period lasts or MiMo-V2.5's parameter count. Type `mimo` in the terminal to start; the UI is fully localized in Chinese.

Why it matters: Xiaomi open-sourced terminal coding assistant MiMo Code under MIT, with a multimodal model free for a limited time and support for external models like DeepSeek and Kimi.

Jun 10Wednesday

OpenAI News

OpenAI banned PRC-linked ChatGPT accounts running covert influence ops on US AI debates

OpenAI published a threat report on June 10 detailing two clusters of ChatGPT accounts likely originating from China, both banned for covert influence operations. One cluster, named 'Data Center Bandwagon,' generated posts claiming AI data centers were raising household electricity prices. The other, 'Tech and Tariffs,' criticized US tariffs as tech competition tactics and instructed outputs to mention only President Trump, not Xi Jinping. That second cluster also spread false claims of a ChatGPT user data breach, which OpenAI calls entirely fabricated. OpenAI found no evidence the operations shifted public opinion, but sees them as testing narratives against US AI infrastructure. The post does not disclose account counts, target platforms, or reach metrics.

Why it matters: OpenAI's threat report names two China-linked account clusters posting about data center power bills and tech tariffs, a concrete case of covert influence in AI policy talk.

AI Chat-Group Daily (群聊日报)

Anthropic drops Claude Fable 5 / Mythos 5, hits 80.3% on SWE-bench Pro, but safety classifier misfires badly

Anthropic launched two models: Fable 5 for everyone and the full Mythos 5 for trusted partners only. SWE-bench Pro hit 80.3%, well above Opus 4.8's 69.2% and GPT 5.5's 58.6%. It beat Pokémon FireRed using only screenshots. Pricing is double Opus 4.8 at $10/M input and $50/M output. Early testers burned through quota 2–3x faster than Opus; one user drained 73% of a 5-hour allowance in under two hours. The safety classifier became the day's biggest complaint—asking '9.9−9.11=?' triggered a downgrade, and writing an analysis of Anthropic's own safety report got the request blocked entirely. The article had to be finished by DeepSeek V4 Pro. One member pegged the $200 Coding Plan as roughly $5K–10K in API value, calling it a short-lived arbitrage. GitHub Copilot added Fable 5 the same day but requires dropping zero data retention, a dealbreaker for some enterprises. Anthropic's April advisor tool—where a cheap model calls an expensive one for advice—turns out to be the right cost fix for Fable 5. A rice-blast experiment in the safety report also surfaced a shift: AI is flattening domain expertise, but the people who can spot when its answers are wrong are becoming more valuable.

Why it matters: Anthropic shipped Fable 5 and a restricted Mythos 5 at once, with Fable 5 scoring 80.3% on SWE-bench Pro against Opus 4.8's 69.2% and GPT 5.5's 58.6%.

AI HOT (Curated Pool)

Google Gemini 3.5 Live Translate enters public preview with 70+ languages

Google released Gemini 3.5 Live Translate in public preview through the Gemini API, offering low-latency speech-to-speech translation across 70+ languages and 2,000 language pairs.

Why it matters: Google opened Gemini 3.5 live speech translation to public beta with 70-plus languages and 2,000 possible pairs, and developers can wire it into live chat, support, streaming and cross-border meetings through an API.

AI HOT (Curated Pool)

Anthropic launches safety-treated Mythos-class model Claude Fable 5

Anthropic released Claude Fable 5, a safety-treated Mythos-class model; in high-risk cyber, biochemistry, and distillation domains, it automatically falls back to Opus 4.8, with one trigger per 20 conversations on average.

Why it matters: Anthropic shipped its strongest model, Claude Fable 5, which automatically falls back to Opus 4.8 in sensitive areas like cybersecurity and biochemistry, triggering about once every 20 conversations.

AI HOT (Curated Pool)

Claude Fable 5 and Claude Mythos 5

Anthropic launched Claude Fable 5 and Claude Mythos 5 at $10 per million input tokens and $50 per million output tokens. Fable 5 leads FrontierCode among frontier models, while Mythos 5 reports about 10x acceleration in drug design and about 80% scientist preference in blinded molecular biology hypothesis tests.

Why it matters: Anthropic's two new models split consumer and defense access, and Stripe's one-day migration shows what the consumer model can do.

The Verge · AI

Anthropic releases its first Mythos-class model Claude Fable 5

Anthropic launched Claude Fable 5, calling it the most capable model it has ever released widely. It excels at software engineering, knowledge work, and vision, with its lead growing on longer, more complex tasks. This is the first broad release from the Mythos family, previously deemed too dangerous because of cybersecurity capabilities. New safeguards that block responses in specific high-risk areas made the release possible. The post doesn't disclose benchmarks, pricing, or a launch date.

Why it matters: Anthropic released Claude Fable 5, the first Mythos-class model to ship widely, after the line was held back over its cybersecurity strength, and paired the launch with safeguards that block answers in high-risk areas.

TechCrunch · AI

Anthropic releases Claude Fable 5, a public version of its top Mythos model with hard safety limits

Anthropic opened its most powerful model family to the public for the first time with Claude Fable 5, a version of Mythos. It excels at software engineering, knowledge work, and vision, but blocks responses in high-risk areas like cybersecurity, biology, chemistry, and distillation, falling back to Claude Opus 4.8. Mythos was previewed in April for select partners only due to cybersecurity concerns. The post doesn't spell out Fable 5's parameter count, pricing, or regional availability.

Why it matters: Anthropic opened its strongest internal model, Mythos, to the public as Claude Fable 5, but it refuses high-risk requests in cybersecurity, biology, chemistry and model distillation and falls back to Claude Opus 4.8.

Jun 9Tuesday

AI HOT (Curated Pool)

Google Releases Gemini 3.5 Live Translate for Real-Time Speech Translation

Google released Gemini 3.5 Live Translate, a speech-to-speech translation model that supports more than 70 languages, starts translating before the speaker finishes, uses streaming updates, and runs through Gemini Live API, Google Meet preview, and Google Translate apps on iOS and Android.

Why it matters: Google released Gemini 3.5 Live Translate, covering more than 70 languages and translating as it listens instead of waiting for a full sentence, with latency down to a few seconds.

AI HOT (Curated Pool)

Google DeepMind Releases Gemma 4 12B, a Unified Encoder-Free Multimodal Model

Google DeepMind released Gemma 4 12B, a multimodal model with a unified encoder-free architecture, native audio input, Apache 2.0 licensing, and local laptop runtime with 16GB of VRAM or unified memory.

Why it matters: Google DeepMind open-sourced Gemma 4 12B, dropping separate vision and audio encoders so one Transformer handles images, text and speech, and it runs on 16GB of VRAM.

AI HOT (Curated Pool)

GPT-5.5 Replaces OCR as ChinaRxiv Papers Become Freely Available

A developer replaced a complex OCR pipeline with GPT-5.5, making 23,000+ ChinaRxiv papers freely available with more complete English translations.

Why it matters: A developer replaced a conventional OCR pipeline with GPT-5.5 to open up more than 23,000 ChinaRxiv papers for free with fuller English translations, a transferable option for bulk Chinese-paper workflows.

AI HOT (Curated Pool)

Tencent Hunyuan Releases UniRL, a Unified Multimodal RL Infrastructure

Tencent Hunyuan released UniRL, using one post-training loop to cover diffusion and flow-matching models, LLM/VLM systems, and unified multimodal models, while open-sourcing two algorithms, DRPO and Flow-DPPO.

Why it matters: Tencent Hunyuan open-sources UniRL, putting RL training for diffusion, flow matching, language and vision-language models into one post-training loop, with models and algorithms decoupled for free combination.

AI HOT (Curated Pool)

How an Agent Chains Two HuggingFace Spaces to Build a 3D Paris Gallery

A coding agent chained ideogram-ai/ideogram4 and VAST-AI/TripoSplat to generate Paris monument images, reconstruct single-image 3D Gaussian splats as .ply files, convert them to .ksplat with about 3× smaller size, and deploy a static Three.js Space using APIs exposed through agents.md.

Why it matters: A coding agent chains ideogram4 and TripoSplat HuggingFace Spaces into a text-to-3D scene pipeline, a transferable pattern for agents orchestrating multiple tools.

Jun 8Monday

AI HOT (Curated Pool)

Runway Aleph 2.0 Editing Model Adapts Videos to Any Format

Runway introduced the Aleph 2.0 video editing model, letting users upload an existing video in its desktop web app, choose an aspect ratio, and have the model fill the remaining scene area for the selected format.

Why it matters: Runway put Aleph 2.0 on its desktop web app: upload an existing video, pick an aspect ratio, and the model fills in the extra frame area so the result looks shot that way.

AI HOT (Curated Pool)

Microsoft AI CEO: Superintelligence Is Coming, but It Won’t Replace Your Job

Mustafa Suleyman said superintelligence is coming without causing mass unemployment; Microsoft signed a new OpenAI contract last October and released seven omnimodal models at Build this week.

Why it matters: Microsoft AI chief Mustafa Suleyman argued on a podcast that superintelligence will not cause mass unemployment, while Microsoft has secured permission to pursue superintelligence independently and is training frontier models.

r/LocalLLaMA

Been Watching Real Adversarial Input Hit My Detection API for Six Months

Bordair’s author says six months of detection-API traffic showed three recurring attack patterns: multi-turn setup, forward-momentum exploitation, and role redefinition; the public adversarial game produced roughly 6,700 attacks last month.

Why it matters: Bordair's author ran a detection API against live traffic for six months and sorted the attacks into three recurring patterns, with about 6,700 hits in last month's adversarial game.

AI HOT (Curated Pool)

Amap Releases 3D-Native City World Model ABot-Earth0.5

Amap released ABot-Earth0.5, a 3D-native city world model covering more than 190 countries and regions, generating kilometer-scale 3D cities from satellite images or text within 10 minutes on consumer GPUs.

Why it matters: Amap released ABot-Earth0.5, which turns one satellite image or a text prompt into a kilometer-scale 3D city scene in about 10 minutes on a consumer GPU, exported as 3DGS for Unity and Unreal.

Financial Times · Technology

The AI Spying Breakthrough That Spooked the Kremlin

FT says AI can use CCTV data to identify targets, and Russia paused a surveillance system after the killing of Iran’s Supreme Leader; the RSS snippet does not disclose the system name, model mechanism, vendor, or timeline.

Why it matters: The FT reports AI can identify targets from CCTV footage, and Russia paused one surveillance system after Iran's supreme leader was assassinated, though the system name and model details can't be verified.

Jun 7Sunday

AI HOT (Curated Pool)

A Hokkaido Broccoli Farmer’s 8 Real AI Uses with ChatGPT and Codex

Hokkaido farmer Hiroki Tomiyasu uses ChatGPT and Codex for 8 farm tasks, including broccoli disease recognition, NDVI monitoring, ESP32 greenhouse control, LINE chatbots, sowing-count tracking, RTK-GPS steering study, and an Airtable farm database.

Why it matters: Hokkaido farmer Hiroki Tomiyasu built 8 working field tools with ChatGPT and Codex, no outsourcing and no programming study, a still-rare case of a non-programmer using AI to write code for physical-world work.