Skip to content

Multimodal

Beyond text: vision, mixed image-text, audio and video input and output in models and products.

Latest picks

21–40 of 592

Nov 6Friday

Latent Space

Thinking Machines releases Inkling 2 Small: 68-hour pretrain, leads web dev evals over Muse Spark Open

Thinking Machines released Inkling 2 Small, a multimodal MoE with 594B total parameters and 17B active. It is available on Tinker for fine-tuning and inference.

Why it matters: Inkling 2 Small's higher AI benchmark scores come with heavier output token use, but its low unit price keeps per-task cost below the comparison model.

Hacker News front page

Tencent releases Hy4 with vision understanding and computer operation, plans to open model weights

Tencent released Hy4, a new large language model that adds vision understanding and computer operation. The company says it will publish the model weights and a system card in the coming days. Hy4 improves instruction following, long-context understanding and long-horizon agent tasks, and is already live in WorkBuddy, CodeBuddy and Tencent Cloud TokenHub.

Why it matters: Hy4 adds vision and computer operation while keeping Hy4 Preview pricing, so the wider task range comes without a higher standard call price.

Google Blog · Gemini

Gemini Omni 1.2 Flash: faster, cheaper generation with longer video

Google released Gemini Omni 1.2 Flash, now generally available in the Gemini API and Gemini for business. Native video generation and editing now runs up to 15 seconds, up from 10.

Why it matters: Gemini Omni 1.2 Flash lets users keep editing the same video in successive passes, so ad variants no longer need a full regeneration.

Google DeepMind

Google DeepMind ships Gemini Omni 1.2 Flash with 15-second video and a 30% price cut

Google DeepMind released Gemini Omni 1.2 Flash, fully available in the Gemini API and Gemini for business. It natively generates and edits video up to 15 seconds long, and the price drops 30%.

Why it matters: Gemini Omni 1.2 Flash supports repeated local edits to one video, cutting the cost of regenerating a whole clip to make ad variants.

The Decoder

Tencent releases Hunyuan Hy4 with image understanding and computer control, ranks second among Chinese models in independent test

Tencent released the full version of Hy4, adding image understanding and the ability to operate software on its own. It is available through Tencent Cloud, OpenRouter and the Yuanbao app, with model weights to be released on an undecided date. Tencent says its search hallucination rate fell from nearly 16% to about 5% in internal tests, and that the model was trained for Blender, CAD and game engines.

Why it matters: Tencent says Hy4 leads Kimi K3.1 Pro on finance tasks, while an independent overall review ranks it behind that model, so the two tests disagree on which leads.

Nov 5Thursday

Hacker News front page

Kimi K3.1 Pro releases open model weights with 1M-token context

Kimi K3.1 Pro is now open-weight: a native multimodal agent model for text and images with a 1-million-token context window. It uses a MoE architecture with 2.8T total parameters and 104B active, post-trained from Kimi K3 with large-scale joint reinforcement learning. Moonshot AI says coding, 3D creation, financial research and factual accuracy improved.

Why it matters: The release sets out what multi-turn tool calling must send back, so integrations need to keep full reasoning content and tool-call records to hold the conversation context.

Nov 4Wednesday

OpenAI News

OpenAI uses AI to speed design, simulation and manufacturing of physical products

OpenAI published research on models helping engineer physical products, covering mechanical, electrical and systems design, and announced a research partnership with Mazda. Two team members used Astra to design a device that talks to Codex in under a week of spare time, and a manufacturer built a small prototype batch in under a month. Multiple review rounds and iteration are still needed before manufacturing to handle production limits, tolerances and assembly details.

Why it matters: OpenAI used Astra to link a device's mechanical, circuit and software design, but manufacturing still needs review rounds for production limits, tolerances and assembly details.

Nov 3Tuesday

Google Blog · Gemini

Google Recaps October 2026 AI Updates, Covering Gemini 4 and Genie 4

Google's October 2026 AI recap covers the global rollout of Gemini 4 Argon, the announcement of Gemini 4 Carbon, and the world model Genie 4. Argon goes out worldwide while Carbon stays in limited testing.

Why it matters: Google is running Argon's global release and Carbon's limited test on separate tracks, so the two frontier models differ in access and safety-testing stage.

Oct 30Friday

Oct 29Thursday

AI HOT · Models

Mistral Large 4 (Le Chonk) lands on Hugging Face with open weights for a ~1T-parameter multimodal model

Mistral Large 4 (Le Chonk) is now on Hugging Face with open weights. It uses a multimodal, multilingual MoE architecture with text and image input and text output. The model has about 1T total parameters, 49B active parameters and a 1M-token context window, ships in official FP8 and NVFP4 versions, and its license restricts model-as-a-service businesses.

Why it matters: Open weights and several deployment paths let security teams set their own usage policy and runtime for vulnerability reproduction and patching work.

Mistral AI

Mistral releases open weights for Mistral Large 4 (Le Chonk), a 1-trillion-parameter multimodal model

Mistral AI released the open weights of an improved Mistral Large 4 (Le Chonk). The 1-trillion-parameter native multimodal model improves coding, defensive cybersecurity and reasoning efficiency. Self-hosting and customization are allowed, but companies running model-as-a-service need a separate commercial license.

Why it matters: The open weights allow self-hosting and customization, while commercial model-as-a-service use needs a separate license, so the boundary between self-deployment and commercial use is explicit.

AI HOT · Tips & opinions

OpenRouter tutorial: extracting tables from PDFs with an LLM

An OpenRouter tutorial sends a PDF plus a strict JSON schema to pull tables into rows with explicit data types. Field descriptions handle negative numbers in parentheses, footnotes and merged cells. Across 5 test PDFs, 2 of them scans, models that read the PDF directly extracted all 644 cells correctly, a result the post limits to this test set.

Why it matters: It pairs a strict row schema with field-level cleanup rules and catches dropped rows in otherwise normal responses using empty-result and truncation checks.

Google Blog · Gemini

Google and XREAL launch XREAL AURA, a wired Android XR glasses for work, video and games

Google and XREAL launched XREAL AURA, a wired XR headset running Android XR. Gemini can read the real-world view and on-screen content and help with it. The glasses weigh under 95 grams with a 70-degree field of view, connect by cable to a portable compute module, support multi-window apps and USB-C laptop screen mirroring, and Gemini can highlight objects in view.

Why it matters: AURA puts Gemini into the real-world view and laptop windows, so users can ask about what is in front of them while working across apps.

Oct 28Wednesday

Google DeepMind

Google DeepMind releases Genie 4 world model with native audio and real-time interactive simulation

Google DeepMind released Genie 4, a world model with native audio, interactive dialogue and real-time scene edits in natural language. It is in research preview for trusted testers. In simulations, Gemini 3.8 Flash keeps observing the scene, breaking down goals and checking progress to hold multi-step events together. The model still drifts on object persistence, complex physical interactions and long-term consistency.

Why it matters: Genie 4 puts native audio and live scene control into world simulation, so creators can adjust camera, dialogue and action to try out ideas in a moving scene.

Oct 27Tuesday

Google Blog · Gemini

Google shows 8 Gemini 4 Argon use cases, from sorting archives to playable 3D scenes

Google demonstrated eight applications of Gemini 4 Argon, including complex document sorting, interactive tools, playable 3D scenes and animation generation. In Antigravity, the model turned more than 80,000 raw NASA files from 72 Mars flights into a presentation. It also coordinated sub-agents, Blender MCP and Nano Banana to turn a real desk photo into a playable 3D track.

Why it matters: Google shows how Gemini 4 Argon builds a playable 3D scene from a photo, chaining sub-agent coordination and modeling tool calls in one task.

The Decoder

OpenAI releases GPT-6.1 Terra with cheaper API and a smaller gap to larger models

OpenAI released GPT-6.1 Terra, cutting API prices and improving results on reasoning, coding and computer-control benchmarks. Input and output cost $1 and $5 per million tokens, down from $2 and $12 for GPT-5.6 Terra. Artificial Analysis measured a 6-point intelligence index gain at its highest reasoning effort, with cost per task falling from $1.40 to $0.40.

Why it matters: Independent testing puts GPT-6.1 Terra 6 index points above its predecessor, with cost per task down from $1.40 to $0.40.

OpenAI News

OpenAI releases GPT-6.1 Terra with better visual reasoning and computer use

OpenAI released GPT-6.1 Terra, which combines visual reasoning, computer operation and natural writing. Standard API pricing is 50% lower than GPT-5.6 Terra and GPT-6.1 Sol.

Why it matters: OpenAI cut the standard API price of GPT-6.1 Terra by 50%, and its computer-use benchmark score is 15 percentage points higher than GPT-5.6 Terra.

AI HOT · Models

OpenAI releases GPT-6.1 Terra, focused on computer use and writing

OpenAI has released GPT-6.1 Terra, pitched on writing, personality, close reading of requests and computer use. The release post calls it the company's first model that is clearly better at writing, personality and fine-grained request understanding, and says it can read what is on screen and act across apps. It offers twice the usage of 6.1 Sol in the API and subscriptions, at a lower price.

Why it matters: GPT-6.1 Terra gives twice the usage of 6.1 Sol in the API and subscriptions, and costs less.

AI HOT · Models

OpenAI releases GPT-6.1 Terra for Plus, Pro, Enterprise and Edu users

OpenAI released GPT-6.1 Terra, rolling it out in ChatGPT Work and Codex to Plus, Pro, Enterprise and Edu users starting today. The model is pitched at speed and efficiency, with stronger visual reasoning, precise computer control and clear, natural writing. OpenAI lists reading technical drawings, drafting proposals, filling in forms and editing video among its work uses.

Why it matters: The model ships straight into ChatGPT Work and Codex, so existing paid users can test it on drawing review, forms and video editing.

Oct 24Saturday

Latent Space

Moonshot AI releases Kimi K3.1 Pro, plans open weights, Highspeed mode 2–3× faster

Moonshot AI released Kimi K3.1 Pro, available now through the API, with weights promised for November 4, 2026. The MoE model has 2.8T total parameters and 104B active, and a 1-million-token context window. Moonshot says the Highspeed version keeps the same intelligence while outputting 2–3× faster, at twice the standard price.

Why it matters: The per-token price is a third lower than K3, but independent tests show per-task cost flat or higher because the model uses more tokens.