Skip to content

#多模态

4 today

Oct 28Wednesday

AI HOT · Models

Google 发布世界模型 Genie 4,支持实时操控与原生音频

Google 发布下一代世界模型 Genie 4,支持实时操控,并同步生成环境音与人物实时对话。相比 Genie 3,其照片级真实感和物体碰撞等物理模拟有明显进步。用户可用 WASD 和双摇杆控制角色或镜头,也可在运行中用自然语言修改天气、加入物体。

Hacker News front page

Introducing LFM3: Every Modality for Specialized Intelligence

Liquid AI 发布 LFM3,首批包含 6 款 2B 级模型,以共享骨干覆盖文本、视觉、音频、全模态和决策任务。新骨干采用短卷积、滑动窗口注意力与全局注意力的三混合架构,经过 22T tokens 预训练,文本模型提供 256K tokens 上下文窗口。

The Verge · AI

Google’s next Genie AI model generates more realistic experiences

Google 今天宣布世界模型 Genie 4,可生成更逼真的交互体验,支持用自然语言提示词实时修改体验并生成音频。模型使用 Gemini 3.8 Flash 辅助模拟,体验时长从 Genie 3 的一分钟增至约两分钟,Google 提醒较长模拟中的细节和物体持续性可能发生变化。

TechCrunch · AI

Google’s Genie 4 world model adds audio, more realistic worlds, and real-time steering

Google DeepMind 于周二发布 Genie 4 研究预览,新增实时音频与模拟中的提示词编辑,生成更逼真、可交互的世界。模型可实时改变天气、镜头角度或添加人物与物体,保持场景一致性最长两分钟,是前代的两倍,但仍存在细节漂移、音频准确性和场景文字可读性问题。

Google DeepMind

Google DeepMind releases Genie 4 world model with native audio and real-time interactive simulation

Google DeepMind released Genie 4, a world model with native audio, interactive dialogue and real-time scene edits in natural language. It is in research preview for trusted testers. In simulations, Gemini 3.8 Flash keeps observing the scene, breaking down goals and checking progress to hold multi-step events together. The model still drifts on object persistence, complex physical interactions and long-term consistency.

Why it matters: Genie 4 puts native audio and live scene control into world simulation, so creators can adjust camera, dialogue and action to try out ideas in a moving scene.

Oct 27Tuesday

Google Blog · Gemini

Google shows 8 Gemini 4 Argon use cases, from sorting archives to playable 3D scenes

Google demonstrated eight applications of Gemini 4 Argon, including complex document sorting, interactive tools, playable 3D scenes and animation generation. In Antigravity, the model turned more than 80,000 raw NASA files from 72 Mars flights into a presentation. It also coordinated sub-agents, Blender MCP and Nano Banana to turn a real desk photo into a playable 3D track.

Why it matters: Google shows how Gemini 4 Argon builds a playable 3D scene from a photo, chaining sub-agent coordination and modeling tool calls in one task.

Simon Willison

GPT-6.1 Terra

OpenAI 发布 GPT-6.1 Terra,强调细致的视觉推理、精准的计算机操作,以及更清晰自然的写作。OpenAI 的 Ted Sanders 表示,Terra 的技术沟通可能优于 Astra 和 Sol,视觉与计算机操作能力相近且速度更快,多数其他能力略弱。

OpenAI News

Greptile takes bug detection beyond code review with GPT-6 Astra

Greptile 用 GPT-6 Astra 的 computer use 能力自动化应用测试:为 pull request 启动开发服务器、把浏览器调整为 iPhone 尺寸视口并模拟用户操作,靠模型的视觉理解发现代码审查看不出的问题。Greptile 还通过 MCP server 把代码库知识库接入 Codex,数千客户已连接,AI 生成代码的回退次数随之减少。

The Decoder

OpenAI releases GPT-6.1 Terra with cheaper API and a smaller gap to larger models

OpenAI released GPT-6.1 Terra, cutting API prices and improving results on reasoning, coding and computer-control benchmarks. Input and output cost $1 and $5 per million tokens, down from $2 and $12 for GPT-5.6 Terra. Artificial Analysis measured a 6-point intelligence index gain at its highest reasoning effort, with cost per task falling from $1.40 to $0.40.

Why it matters: Independent testing puts GPT-6.1 Terra 6 index points above its predecessor, with cost per task down from $1.40 to $0.40.

OpenAI News

OpenAI releases GPT-6.1 Terra with better visual reasoning and computer use

OpenAI released GPT-6.1 Terra, which combines visual reasoning, computer operation and natural writing. Standard API pricing is 50% lower than GPT-5.6 Terra and GPT-6.1 Sol.

Why it matters: OpenAI cut the standard API price of GPT-6.1 Terra by 50%, and its computer-use benchmark score is 15 percentage points higher than GPT-5.6 Terra.

Hacker News front page

GPT 6.1 Terra

GPT-6.1 Terra 可将产品照片匹配到目录条目、解读技术图纸、操作应用屏幕,以及起草和修改文本。reasoning.effort 支持 none、low、medium(默认)、high、xhigh 和 max。工具调用要求使用 Responses API,提示词与迁移指导见 GPT-6 指南。

AI HOT · Models

OpenAI releases GPT-6.1 Terra, focused on computer use and writing

OpenAI has released GPT-6.1 Terra, pitched on writing, personality, close reading of requests and computer use. The release post calls it the company's first model that is clearly better at writing, personality and fine-grained request understanding, and says it can read what is on screen and act across apps. It offers twice the usage of 6.1 Sol in the API and subscriptions, at a lower price.

Why it matters: GPT-6.1 Terra gives twice the usage of 6.1 Sol in the API and subscriptions, and costs less.

AI HOT · Models

OpenAI releases GPT-6.1 Terra for Plus, Pro, Enterprise and Edu users

OpenAI released GPT-6.1 Terra, rolling it out in ChatGPT Work and Codex to Plus, Pro, Enterprise and Edu users starting today. The model is pitched at speed and efficiency, with stronger visual reasoning, precise computer control and clear, natural writing. OpenAI lists reading technical drawings, drafting proposals, filling in forms and editing video among its work uses.

Why it matters: The model ships straight into ChatGPT Work and Codex, so existing paid users can test it on drawing review, forms and video editing.

Google Blog · Gemini

15 college students share their favorite Gemini features

Google 邀请 15 名 Google Student Ambassadors 分享他们最常用的 Gemini 功能,涵盖 Study notebooks、Gemini Live、Guided Learning、学习指南生成、自定义测验、无限上传、Audio Overviews、Nano Banana 图像生成和 Chrome 中的 Gemini。

Oct 26Monday

Hacker News front page

New iPad mini

苹果发布新款 iPad mini,搭载 A20 Pro 芯片,配备 8.5 英寸 OLED 屏,峰值亮度较上代提升 2 倍以上,并新增 IP67 防尘抗水。新品 10 月 28 日起在 36 个国家和地区开启预购,11 月 6 日到货,Wi-Fi 版起售价 699 美元,提供 128GB、256GB、512GB 三种容量。

AI HOT · Products

Kling 4.0 上线 Runware API,支持 30 秒 1080p 原生音频视频

Runware 在 Kling 4.0 发布首日将其接入 API,支持生成最长 30 秒的 1080p 视频及原生音频。功能包括首、中、尾多关键帧、单请求最多 15 个输入,以及基于提示词的已有片段编辑;输入可包含关键帧、参考图、参考视频与元素。

Oct 24Saturday

Latent Space

Moonshot AI releases Kimi K3.1 Pro, plans open weights, Highspeed mode 2–3× faster

Moonshot AI released Kimi K3.1 Pro, available now through the API, with weights promised for November 4, 2026. The MoE model has 2.8T total parameters and 104B active, and a 1-million-token context window. Moonshot says the Highspeed version keeps the same intelligence while outputting 2–3× faster, at twice the standard price.

Why it matters: The per-token price is a third lower than K3, but independent tests show per-task cost flat or higher because the model uses more tokens.

AI HOT · Products

月之暗面 Kimi K3.1 Pro 上线 OpenRouter,支持 1M 上下文

OpenRouter 上线月之暗面的 Kimi K3.1 Pro,这是一款面向长程编码和智能体任务、支持 1M 上下文的多模态开源权重模型。该模型基于 Kimi K3 后训练,定价为 $2/M input tokens、$10/M output tokens,可在 OpenRouter 直接试用。

Google Blog · Gemini

See what 5 builders are making with Gemini 4 Argon

Google 展示了社区开发者使用 Gemini 4 Argon 构建的 5 个项目,涵盖三维模拟、实时数据可视化和多人浏览器游戏。案例包括水上飞机模拟、结合 NASA 野火数据与美国地质调查局地震数据的交互地球仪、喷气发动机模拟、由单张图像生成的交互式马车,以及多人夺旗游戏 Backyard Rascals。

Hacker News front page

Kimi ships K3.1 Pro and a Highspeed variant on Kimi Code

Kimi made K3.1 Pro generally available on Kimi Code and released K3.1 Pro Highspeed, which has the same capabilities and outputs about 2–3× faster. K3.1 Pro has 3T parameters and a 1M context window, accepts image and video input, and runs only in thinking mode. Kimi says coding, 3D creation and financial research and modeling are notably improved.

Why it matters: The Highspeed variant trades about 2× the quota for roughly 2–3× faster output, while tool calls and script execution do not speed up.

AI HOT · Products

Kling 4.0 在 fal 上线,向所有客户开放 API 访问

fal 宣布 Kling 4.0 正式向公众开放,所有客户均可通过 API 访问。该模型支持最长 30 秒带音频的原生视频生成、最多 15 个图像/视频/元素参考,以及最多 10 个关键帧的精确控制。运动、角色一致性和电影感叙事表现也得到提升。

Oct 23Friday

Hacker News front page

How does Fable 5.1 hide messages in images?

研究者发现,Fable 5.1 能在 SVG 图像中隐藏消息,新会话仅凭渲染后的截图、无需预先约定编码方案即可恢复 78% 的消息。测试包含 15 种语言的 50 条短消息,其中 33 张图像采用高度编码,解码模型通过 Python 工具测量视觉元素并推断规则。

TechCrunch · AI

OpenAI opens Decisions API to all customers, adding voice and vision

OpenAI opened its Decisions API to all customers on Thursday and added voice and vision support for the public version. The service is a reconfigured ChatGPT Luna that handles decision tasks with faster inference and lower cost. OpenAI says response time drops from one to three seconds to 100, 120 and 180 milliseconds. Language tutoring product Speak cut its action interval from 1.4 seconds to .13 seconds using the API.

Why it matters: OpenAI turned Luna into a low-latency decision service, and Speak cut its action interval and interaction wait after swapping out its existing LLM.

Oct 22Thursday

AI HOT · Products

Kling 4.0 已在 OnSolo 上线,支持单次生成 30 秒原生视频

可灵(Kling)宣布 Kling 4.0 已在 OnSolo 上线,支持单次生成 30 秒原生视频。模型支持在快速动作和大运镜下保持稳定,提供立体声、更准确的口型同步及 21:9 宽屏。单个任务可叠加最多 15 个参考图和 10 个关键帧,以保持角色、镜头与剧情一致。

Oct 21Wednesday

Hacker News front page

Show HN: Penmentor – Claude marks up your handwritten math like a teacher

Penmentor 将 Claude、Gemini 或 GPT 接入 xournal++,按键即可在手写数学页面上标注错误、给出提示并生成交互动画。它通过 Claude Code、Codex 或 Antigravity CLI 使用已有订阅,支持整页读取、分级提示和基于 manim 的动画;演示视频使用脚本控制笔迹及固定模型回答。

Hacker News front page

Show HN: Jev Cards, Can you beat a vision model at a picture quiz?

JMS Code 在 GitHub 发布 Jev Cards,一款让玩家与视觉模型 Jev 1.14 同图竞答的看图问答游戏,覆盖水果、国旗、地图、国际象棋和视错觉等 490 张卡片。Jev 1.14 是决策模型,一次调用即读取图片与问题,为每个选项返回概率,约四分之一秒作答且不生成文本。游戏提供限时冲刺、10 秒一题的 Versus、连胜和好友同题实时对战模式。

Oct 20Tuesday

The Decoder

MiniMax M3.1 Flash scores 42 on Artificial Analysis index at under $0.22 per task

MiniMax released the reasoning model M3.1 Flash. Its Artificial Analysis Intelligence Index rose to 42 from 29 on the previous M3, while cost per task fell to under half, about $0.22.

Why it matters: M3.1 Flash costs less per task than DeepSeek and leads on hard Q&A and factual accuracy tests, though its overall intelligence index is slightly lower.

Google Blog · Gemini

4 tips for styling outfits with Gemini

造型师 Sydney Bordonaro 用 Gemini 为分散各地的职业运动员客户预览整套穿搭:上传衣物图片即可合成上身效果图,再通过对话单独替换靴子、外套等单品。她还会把成图发给客户争取确认,并在活动前拍下衣物污渍照片,让 Gemini 给出用现场物品处理的步骤。

Oct 19Monday

AI HOT · Tips & opinions

n8n 教程:在 NVIDIA DGX Spark 上离线运行全套 AI 工作流

n8n 教程展示如何在一台 NVIDIA DGX Spark 上部署七个模型,通过 LiteLLM 的统一接口运行不调用云端 API 的 AI 工作流。实测模型栈占用 108GB 内存,发票字段提取关闭思考后从 12.1s 降至 0.59s,并提供模型版本锁定、服务配置与 n8n 接入步骤。并行生成图像时,单用户聊天速度下降 69%,四用户场景下降 65%,共享 GPU 的任务需要安排调度。

Oct 17Saturday

Hacker News front page

DeepSeek releases V4.1 Flash 1017 with CED architecture and native image understanding

DeepSeek V4.1 Flash 1017 is a model snapshot dated October 17, 2026, served by DeepSeek under the API model name deepseek-flash. It uses a CED architecture and native image understanding, and cuts cache memory to roughly a quarter of the previous generation.

Why it matters: The snapshot cuts cache memory to about a quarter of the previous generation, lowering cache overhead for multi-step agent tasks.