Skip to content

Multimodal

Beyond text: vision, mixed image-text, audio and video input and output in models and products.

Latest picks

41–60 of 592

Oct 24Saturday

Hacker News front page

Kimi ships K3.1 Pro and a Highspeed variant on Kimi Code

Kimi made K3.1 Pro generally available on Kimi Code and released K3.1 Pro Highspeed, which has the same capabilities and outputs about 2–3× faster. K3.1 Pro has 3T parameters and a 1M context window, accepts image and video input, and runs only in thinking mode. Kimi says coding, 3D creation and financial research and modeling are notably improved.

Why it matters: The Highspeed variant trades about 2× the quota for roughly 2–3× faster output, while tool calls and script execution do not speed up.

Oct 23Friday

TechCrunch · AI

OpenAI opens Decisions API to all customers, adding voice and vision

OpenAI opened its Decisions API to all customers on Thursday and added voice and vision support for the public version. The service is a reconfigured ChatGPT Luna that handles decision tasks with faster inference and lower cost. OpenAI says response time drops from one to three seconds to 100, 120 and 180 milliseconds. Language tutoring product Speak cut its action interval from 1.4 seconds to .13 seconds using the API.

Why it matters: OpenAI turned Luna into a low-latency decision service, and Speak cut its action interval and interaction wait after swapping out its existing LLM.

Oct 20Tuesday

The Decoder

MiniMax M3.1 Flash scores 42 on Artificial Analysis index at under $0.22 per task

MiniMax released the reasoning model M3.1 Flash. Its Artificial Analysis Intelligence Index rose to 42 from 29 on the previous M3, while cost per task fell to under half, about $0.22.

Why it matters: M3.1 Flash costs less per task than DeepSeek and leads on hard Q&A and factual accuracy tests, though its overall intelligence index is slightly lower.

Oct 17Saturday

Hacker News front page

DeepSeek releases V4.1 Flash 1017 with CED architecture and native image understanding

DeepSeek V4.1 Flash 1017 is a model snapshot dated October 17, 2026, served by DeepSeek under the API model name deepseek-flash. It uses a CED architecture and native image understanding, and cuts cache memory to roughly a quarter of the previous generation.

Why it matters: The snapshot cuts cache memory to about a quarter of the previous generation, lowering cache overhead for multi-step agent tasks.

Oct 16Friday

AI HOT · Products

SGLang adds Day-0 support for Muse Spark Open, an 816B open-weight multimodal model

SGLang shipped Day-0 support for Muse Spark Open, an 816B open-weight multimodal model. The release adds sequence parallelism, NVFP4 MegaMoE, multimodal processing optimizations and DFlash V2 speculative decoding. Across seven concurrency levels, combining sequence parallelism with MegaMoE for long-prompt prefill cut p90 time to first token by 28.3% to 41.9%.

Why it matters: It pairs sequence parallelism with MegaMoE for long-prompt prefill and reports p90 time-to-first-token cuts of 28.3% to 41.9% across seven concurrency levels.

AI HOT · Products

Meta's Muse Spark Open goes live on Together AI

Meta's open-weight model Muse Spark Open launched on Together AI today, aimed at long-running agentic coding workflows. It offers a 1M-token context window and supports sub-agent collaboration, tool calls, computer use and web browsing, and accepts text, image, audio and audio-video input.

Why it matters: Together AI serves Muse Spark Open on launch day and publishes per-item pricing, giving a clear basis for both access and call cost on a long-task model.

AI HOT · Products

Meta releases Muse Spark Open weights, with token-priced shared endpoint on Modal

Meta released the Muse Spark Open weights, and Modal Auto Endpoints now serves a shared endpoint billed per token. The model targets agentic coding and long-horizon tasks, with native multimodal understanding and a 1M-token context window. It handles code writing and debugging, multi-step planning, sequential tool calls and recovery from failures in long workflows.

Why it matters: Meta lists the agents, test harness and reasoning effort behind two Muse Spark Open benchmark scores, so comparisons have to account for those conditions.

AI HOT · Models

Meta releases open-weight Muse Spark Open, with Baseten serving it on day one

Meta released the Muse Spark Open weights, and Baseten is serving the model the same day through Model APIs and Dedicated Inference, aimed at coding agent workflows. Baseten's NVFP4 deployment cuts the weight footprint from about 1.6 TB to 540 GB, freeing VRAM for concurrent agent sessions.

Why it matters: Baseten's NVFP4 deployment shrinks Muse Spark Open from roughly 1.6 TB to 540 GB, freeing VRAM for concurrent agent sessions.

The Verge · AI

Meta and Apple team up to run Muse AI models better on Mac

Meta released Muse Spark Open with open weights and worked with Apple to run it through the latest MLX framework on two Apple M5 Ultra Mac Studios. Meta says the model is natively multimodal, has 816 billion total parameters, and handles long-horizon tasks, complex software engineering and multi-step reasoning. The two companies worked together for months, and Apple published a technical article covering MLX, Muse Spark Open and two other open models.

Why it matters: A months-long Meta and Apple collaboration lands as model and framework tuning that runs a large open-weight model on two desktop machines.

AI HOT · Products

vLLM ships day-one support for Muse Spark Open

vLLM worked with Meta Superintelligence Labs to add day-one inference and LoRA RL support for Muse Spark Open. The open-weight MoE model targets long-horizon agentic coding workflows, with 816B total parameters, 42B activated per token, a 1M context window, and image, video and audio input. vLLM runs it across several hardware platforms and offers prebuilt images, so deployers can serve the model without waiting for the usual package merge.

Why it matters: Deployers can serve Muse Spark Open on day one through vLLM's prebuilt images instead of waiting for a standard package release.

The Decoder

Meta answers Qwen, GLM and Kimi with open-weight Muse Spark Open

Meta released Muse Spark Open, an open-weight model for coding and agent tasks with 816 billion total parameters and 42 billion active, a context window up to 1 million tokens, and text, image, video and audio input. Meta says it leads some open models on agent, knowledge reasoning and multimodal benchmarks, while trailing some competitors on coding.

Why it matters: Meta is pitching an open-weight model at the agent and coding workloads where Qwen, GLM and Kimi have been gaining ground.

AI HOT · Products

Meta releases open-weight Muse Spark Open, live on OpenRouter

Meta released the open-weight Muse Spark Open, now available on OpenRouter and positioned as the strongest US open-weight model for coding and agent work. It has 816B total parameters, 42B active, a 1M token context window and native multimodal input covering images, video, audio and PDF. OpenRouter prices it at $1.25 per million input tokens and $4.25 per million output tokens.

Why it matters: OpenRouter gives teams a pay-per-token entry point to Meta's open-weight Muse Spark Open for coding and agent work.

Hacker News front page

Meta releases Muse Spark Open weights, runs locally on two Mac Studios

Meta released the Muse Spark Open model weights with native multimodal support, 816B total parameters, 42B active parameters and a 1M-token context window, aimed at coding and agent tasks. The weights run locally on two Mac Studios.

Why it matters: Meta's open weights and two-Mac-Studio local run put coding and multimodal agent workflows on the desktop.

AI HOT · Models

NVIDIA releases open Nemotron 3.5 Super VL and two Bolt edge models

NVIDIA released Nemotron 3.5 Super VL and two Bolt edge models, covering agent deployment from enterprise servers down to local devices. Super VL is a 120-billion-parameter multimodal model with open weights, datasets and training recipe; it reads images, web pages and PDFs, and can be post-trained on an organization's own data.

Why it matters: NVIDIA's open models for servers and edge devices let organizations pick a deployment tier by hardware and tune agent tasks on their own data.

Oct 14Wednesday

Google DeepMind

Gemini 4 Argon targets complex engineering, professional workflows and research

Google DeepMind opened Gemini 4 Argon worldwide today, aimed at complex multi-step tasks in coding, finance, law, cybersecurity and science. Access runs through the API, Google Antigravity, the Gemini app and AI Mode in Search.

Why it matters: Google says Argon cut a Chrome architecture refactor across hundreds of files from months to weeks, speeding up work on large codebases.

Google DeepMind

Google DeepMind shows Gemini 4 Argon's robot reasoning and control

Google DeepMind detailed how Gemini 4 Argon is used for robot control, Real2Sim, physical understanding and self-improvement, reporting an 87% score on the pure-reasoning ERQA benchmark.

Why it matters: DeepMind rebuilt simulations from real scenes to generate training data, lifting robot task success in its example from 56% to 75%.

Google Blog · Gemini

Gemini 4 Argon launches for hard coding, finance, legal and science tasks

Google opened Gemini 4 Argon worldwide today for complex coding, finance, legal, cybersecurity and science work, through the Gemini API and subscription tiers. The API takes a unified 1M token limit across input and output, priced at $2 per million input tokens and $10 per million output tokens, with cached input tokens discounted 95%.

Why it matters: Google used Gemini 4 Argon to refactor Chrome's architecture across hundreds of files, cutting months of engineering work to weeks.

Oct 13Tuesday

Latent Space

Meta releases Muse Wonder and Muse Wonder Full, independent tests show agent gains

Meta Superintelligence Labs released its second-generation model series, Muse Wonder and Muse Wonder Full, positioned as a fast frontier model and a full version respectively.

Why it matters: Meta's main gains in independent testing land on agent tasks, and both models use about 10% fewer output tokens per evaluation task than the previous generation.