Skip to content

#多模态

1 today

Today · Nov 17Tuesday · 1 item

OpenAI News

OpenAI releases CSAM image classifier with ChatGPT safeguards and law enforcement support

OpenAI released a child sexual abuse material (CSAM) image classifier, along with ChatGPT interventions, developer guidance and support for law enforcement investigations. The classifier detects potential CSAM, including AI-generated material, and is offered as free API access to vetted organizations. Early evaluations estimate it flags 48% fewer images while finding roughly the same number of abuse images.

Why it matters: In early evaluations the classifier found a similar number of abuse images while cutting flagged images by 48%, easing the human review load.

Nov 13Friday

DeepSeek · API updates

DeepSeek adds web search, file input and link reading to its API

DeepSeek released a full-suite app API. Developers turn on the matching parameters in the existing API to get web search, file input, link reading and safety checks. deepseek-flash supports these across the Messages, Responses and Chat Completions interfaces, with tool calls and context assembly handled server-side. Search works in both thinking and non-thinking modes.

Why it matters: DeepSeek moves search, file parsing and link reading into its existing API, with the server handling tool calls and context assembly so developers skip that orchestration work.

Google DeepMind

Google DeepMind releases Gemini 4 Hydrogen for everyday coding and agent workflows

Google DeepMind released Gemini 4 Hydrogen, available worldwide from today through the Gemini API, AI Studio, the Gemini app and Google Search. It targets fast coding and agent task execution.

Why it matters: Google routes tasks across models dynamically, reaching task success close to Carbon while cutting quota use 24% on average and shortening completion time 19%.

Google Blog · Gemini

Google releases Gemini 4 Hydrogen for everyday coding and agent workflows

Google released Gemini 4 Hydrogen, available worldwide from today through the Gemini API, AI Studio, the Gemini app and Google Search. It focuses on fast coding and agent execution.

Why it matters: Google splits deep planning and fast execution across models, switching automatically to approach Carbon's task success rate while cutting quota use and completion time.

Google Blog · Gemini

Gemini 4 Hydrogen opens to developers for everyday coding and agent workflows

Gemini 4 Hydrogen is open to developers from today, aimed at fast-iterating everyday coding and agent workflows with an emphasis on speed and efficiency. It handles repo coding and debugging, interactive web development and multimodal workflows. It runs on its own with four configurable thinking levels, or alongside Gemini 4 Carbon and Gemini 4 Argon. Google says it follows instructions more strictly and fabricates less, helping ship cleaner production-ready code faster.

Why it matters: Four configurable thinking levels and pairing with frontier models give everyday coding and agent work a separate model configuration to choose from.

Nov 11Wednesday

Google DeepMind

Google DeepMind releases Gemini 4 Carbon for complex coding, cybersecurity and scientific reasoning

Google DeepMind has released Gemini 4 Carbon to developers, enterprises, scientists and consumers. It targets complex knowledge work, long-horizon agent workflows, cybersecurity and scientific reasoning. Google prices Carbon at the same entry rate as Argon, but Carbon spends more tokens on deeper exploration and verification.

Why it matters: Google positions Carbon for complex multi-step tasks, charging the same entry price as Argon while spending more tokens to explore and verify.

Google Blog · Gemini

Google releases Gemini 4 Carbon for complex agent tasks and scientific reasoning

Google has released Gemini 4 Carbon to developers, enterprises, scientists and consumers, targeting complex knowledge work, agentic coding, cybersecurity and scientific reasoning. Carbon ranks first on CursorBench 4.0, WANDR and AutomationBench, and Google says it costs more than 2x less per task than the next-best external model.

Why it matters: Google sets Carbon at the same entry price as Argon, with Carbon spending more tokens on reasoning and verification for complex multi-step tasks.

Nov 10Tuesday

Google DeepMind

Gemini Robotics 2.5 boosts general dexterity in real-world robot tasks

Google DeepMind released Gemini Robotics 2.5, a vision-language-action model it says improves how fast robots learn skills, along with dexterity and safety. The model is being opened gradually to robotics partners.

Why it matters: DeepMind is testing Gemini Robotics 2.5 on sorting car parts, moving robot reliability checks onto a real production line.

Nov 7Saturday

OpenAI News

Measuring how AI agents handle everyday wet-lab science

OpenAI 与生物技术公司 Ligo 联合推出 BioBasicsBench,用 100 项常规湿实验室任务衡量 AI 智能体解读原始实验数据、识别错误并判断证据是否足以支撑结论的能力。

Nov 6Friday

Google Blog · Gemini

Transform a quick drawing into a live app with Gemini.

Gemini 支持上传应用草图照片,选中 Canvas 工具后输入「Can you code this app?」,即可读取图像并生成代码,在预览窗口中测试。生成的应用还能实时调整颜色、字体或功能。

Google Blog · Gemini

Gemini Omni 1.2 Flash: faster, cheaper generation with longer video

Google released Gemini Omni 1.2 Flash, now generally available in the Gemini API and Gemini for business. Native video generation and editing now runs up to 15 seconds, up from 10.

Why it matters: Gemini Omni 1.2 Flash lets users keep editing the same video in successive passes, so ad variants no longer need a full regeneration.

Google DeepMind

Google DeepMind ships Gemini Omni 1.2 Flash with 15-second video and a 30% price cut

Google DeepMind released Gemini Omni 1.2 Flash, fully available in the Gemini API and Gemini for business. It natively generates and edits video up to 15 seconds long, and the price drops 30%.

Why it matters: Gemini Omni 1.2 Flash supports repeated local edits to one video, cutting the cost of regenerating a whole clip to make ad variants.

Nov 4Wednesday

OpenAI News

OpenAI uses AI to speed design, simulation and manufacturing of physical products

OpenAI published research on models helping engineer physical products, covering mechanical, electrical and systems design, and announced a research partnership with Mazda. Two team members used Astra to design a device that talks to Codex in under a week of spare time, and a manufacturer built a small prototype batch in under a month. Multiple review rounds and iteration are still needed before manufacturing to handle production limits, tolerances and assembly details.

Why it matters: OpenAI used Astra to link a device's mechanical, circuit and software design, but manufacturing still needs review rounds for production limits, tolerances and assembly details.

Nov 3Tuesday

Google Blog · Gemini

Google Recaps October 2026 AI Updates, Covering Gemini 4 and Genie 4

Google's October 2026 AI recap covers the global rollout of Gemini 4 Argon, the announcement of Gemini 4 Carbon, and the world model Genie 4. Argon goes out worldwide while Carbon stays in limited testing.

Why it matters: Google is running Argon's global release and Carbon's limited test on separate tracks, so the two frontier models differ in access and safety-testing stage.

Oct 29Thursday

Mistral AI

Mistral releases open weights for Mistral Large 4 (Le Chonk), a 1-trillion-parameter multimodal model

Mistral AI released the open weights of an improved Mistral Large 4 (Le Chonk). The 1-trillion-parameter native multimodal model improves coding, defensive cybersecurity and reasoning efficiency. Self-hosting and customization are allowed, but companies running model-as-a-service need a separate commercial license.

Why it matters: The open weights allow self-hosting and customization, while commercial model-as-a-service use needs a separate license, so the boundary between self-deployment and commercial use is explicit.

Google Blog · Gemini

Google and XREAL launch XREAL AURA, a wired Android XR glasses for work, video and games

Google and XREAL launched XREAL AURA, a wired XR headset running Android XR. Gemini can read the real-world view and on-screen content and help with it. The glasses weigh under 95 grams with a 70-degree field of view, connect by cable to a portable compute module, support multi-window apps and USB-C laptop screen mirroring, and Gemini can highlight objects in view.

Why it matters: AURA puts Gemini into the real-world view and laptop windows, so users can ask about what is in front of them while working across apps.

Oct 28Wednesday

Google DeepMind

Google DeepMind releases Genie 4 world model with native audio and real-time interactive simulation

Google DeepMind released Genie 4, a world model with native audio, interactive dialogue and real-time scene edits in natural language. It is in research preview for trusted testers. In simulations, Gemini 3.8 Flash keeps observing the scene, breaking down goals and checking progress to hold multi-step events together. The model still drifts on object persistence, complex physical interactions and long-term consistency.

Why it matters: Genie 4 puts native audio and live scene control into world simulation, so creators can adjust camera, dialogue and action to try out ideas in a moving scene.

Oct 27Tuesday

Google Blog · Gemini

Google shows 8 Gemini 4 Argon use cases, from sorting archives to playable 3D scenes

Google demonstrated eight applications of Gemini 4 Argon, including complex document sorting, interactive tools, playable 3D scenes and animation generation. In Antigravity, the model turned more than 80,000 raw NASA files from 72 Mars flights into a presentation. It also coordinated sub-agents, Blender MCP and Nano Banana to turn a real desk photo into a playable 3D track.

Why it matters: Google shows how Gemini 4 Argon builds a playable 3D scene from a photo, chaining sub-agent coordination and modeling tool calls in one task.

OpenAI News

Greptile takes bug detection beyond code review with GPT-6 Astra

Greptile 用 GPT-6 Astra 的 computer use 能力自动化应用测试:为 pull request 启动开发服务器、把浏览器调整为 iPhone 尺寸视口并模拟用户操作,靠模型的视觉理解发现代码审查看不出的问题。Greptile 还通过 MCP server 把代码库知识库接入 Codex,数千客户已连接,AI 生成代码的回退次数随之减少。

OpenAI News

OpenAI releases GPT-6.1 Terra with better visual reasoning and computer use

OpenAI released GPT-6.1 Terra, which combines visual reasoning, computer operation and natural writing. Standard API pricing is 50% lower than GPT-5.6 Terra and GPT-6.1 Sol.

Why it matters: OpenAI cut the standard API price of GPT-6.1 Terra by 50%, and its computer-use benchmark score is 15 percentage points higher than GPT-5.6 Terra.

Google Blog · Gemini

15 college students share their favorite Gemini features

Google 邀请 15 名 Google Student Ambassadors 分享他们最常用的 Gemini 功能,涵盖 Study notebooks、Gemini Live、Guided Learning、学习指南生成、自定义测验、无限上传、Audio Overviews、Nano Banana 图像生成和 Chrome 中的 Gemini。

Oct 24Saturday

Google Blog · Gemini

See what 5 builders are making with Gemini 4 Argon

Google 展示了社区开发者使用 Gemini 4 Argon 构建的 5 个项目,涵盖三维模拟、实时数据可视化和多人浏览器游戏。案例包括水上飞机模拟、结合 NASA 野火数据与美国地质调查局地震数据的交互地球仪、喷气发动机模拟、由单张图像生成的交互式马车,以及多人夺旗游戏 Backyard Rascals。

Oct 20Tuesday

Google Blog · Gemini

4 tips for styling outfits with Gemini

造型师 Sydney Bordonaro 用 Gemini 为分散各地的职业运动员客户预览整套穿搭:上传衣物图片即可合成上身效果图,再通过对话单独替换靴子、外套等单品。她还会把成图发给客户争取确认,并在活动前拍下衣物污渍照片,让 Gemini 给出用现场物品处理的步骤。

Oct 14Wednesday

Google DeepMind

Gemini 4 Argon targets complex engineering, professional workflows and research

Google DeepMind opened Gemini 4 Argon worldwide today, aimed at complex multi-step tasks in coding, finance, law, cybersecurity and science. Access runs through the API, Google Antigravity, the Gemini app and AI Mode in Search.

Why it matters: Google says Argon cut a Chrome architecture refactor across hundreds of files from months to weeks, speeding up work on large codebases.

Google DeepMind

Google DeepMind shows Gemini 4 Argon's robot reasoning and control

Google DeepMind detailed how Gemini 4 Argon is used for robot control, Real2Sim, physical understanding and self-improvement, reporting an 87% score on the pure-reasoning ERQA benchmark.

Why it matters: DeepMind rebuilt simulations from real scenes to generate training data, lifting robot task success in its example from 56% to 75%.

Google Blog · Gemini

Gemini 4 Argon launches for hard coding, finance, legal and science tasks

Google opened Gemini 4 Argon worldwide today for complex coding, finance, legal, cybersecurity and science work, through the Gemini API and subscription tiers. The API takes a unified 1M token limit across input and output, priced at $2 per million input tokens and $10 per million output tokens, with cached input tokens discounted 95%.

Why it matters: Google used Gemini 4 Argon to refactor Chrome's architecture across hundreds of files, cutting months of engineering work to weeks.

Oct 8Thursday

OpenAI News

OpenAI brings GPT-6 and Intelligent UI to more ChatGPT users

OpenAI released GPT-6 to more ChatGPT users, adding Intelligent UI that combines text, graphics, buttons, forms and interactive tools inside answers. The model can answer first and keep thinking to add more, and in internal evals GPT-6 Instant started answering an average 44% earlier on questions needing web search, compared with GPT-5.6 Instant.

Why it matters: OpenAI folded interface generation into GPT-6's answer flow, so users adjust inputs, explore diagrams and use throwaway tools right in the chat.

Oct 7Wednesday

Google DeepMind

Google DeepMind releases EmbeddingGemma 2 for on-device multimodal embeddings

Google DeepMind released EmbeddingGemma 2, built on the Gemma 4 architecture, which maps text, code, images, video and audio into one shared embedding space. The model has 740 million parameters, ships under the Apache 2.0 license, and supports an 8K token context window for fully offline cross-modal search and RAG. Text-only tasks need just 270M parameters, and output vectors can be cut from 768 dimensions to 128.

Why it matters: EmbeddingGemma 2 runs cross-modal retrieval on local devices, so text, image, audio and video search never has to send data to the cloud.

Oct 6Tuesday

Mistral AI

Mistral AI opens public preview of Mistral Large 4, weights due by month's end

Mistral AI has put Mistral Large 4 (ML4), its native multimodal model, into public preview. It can be tried now through the Mistral Studio API, and the company plans to release the weights by the end of this month.

Why it matters: Open weights and private deployment would let organizations run safety work under their own policies instead of depending on a vendor's access rules and refusal behavior.

Oct 2Friday

Google Blog · Gemini

Google launches Gemini Live Guided Vision as an accessibility aid on Android

Google launched Guided Vision in Gemini Live, which uses real-time visual description and spoken framing prompts to help blind and low-vision users and anyone who needs visual assistance.

Why it matters: Google adds real-time visual description and spoken framing prompts to Gemini Live, letting blind and low-vision users get everyday visual information through conversation.

Oct 1Thursday

Google DeepMind

Google DeepMind releases Gemini 4 Argon frontier model

Google DeepMind released Gemini 4 Argon, its new frontier model. It goes first to trusted cyber-defense teams through the Fairwind Program, then widens to developers, enterprises and consumers. The release notes list an output cap, pricing and several benchmark scores.

Why it matters: Gemini 4 Argon opens first to trusted cyber defenders, with pricing of $2 per million input tokens and $10 per million output tokens, and an output cap raised from 64K to 1M.

Google Blog · Gemini

Google releases Gemini 4 Argon, first to trusted cyber defense teams

Google announced a new model, Gemini 4 Argon, rolling out gradually through the Fairwind Program to selected trusted cyber defense teams. It targets coding, enterprise knowledge work and cyber defense.

Why it matters: Google raised Gemini 4 Argon's output limit from 64K to 1M tokens, giving complex tasks more room for long single-pass reasoning.

Sep 25Friday

Google DeepMind

Google DeepMind releases Gemini 3.8 Live with Live Avatar

Google DeepMind released Gemini 3.8 Live with Live Avatar, adding near-real-time video generation to its native real-time conversation model. The result is a dynamic visual avatar with lip sync, natural expressions and smooth turn-taking.

Why it matters: Gemini 3.8 Live adds near-real-time video generation to a live conversation model, with lip sync, switching across 97 languages and asynchronous tool calls mid-dialogue, showing what enterprise multimodal interaction looks like now.

Sep 24Thursday

Google Blog · Gemini

Google launches Gemini 3.8 Live with Live Avatar in Gemini Enterprise

Google launched Gemini 3.8 Live with Live Avatar, pairing near-real-time video generation with native live conversation, available now in Gemini Enterprise. It handles visual and audio input at once, calls tools asynchronously during an ongoing conversation, and syncs lip and facial movement while switching across 97 languages. Enterprises can use preset avatars or customize one from a reference image, though custom creation is limited to an enterprise allowlist. Generated audio and video carry SynthID watermarks.

Why it matters: Google combines live voice conversation with a dynamic avatar and background tool calls, so enterprise support and guided flows don't have to interrupt the conversation to fetch data.

Sep 10Thursday

DeepSeek · API updates

DeepSeek-V4.1-Flash ships with native vision and a lower API price

DeepSeek released DeepSeek-V4.1-Flash, the smallest model in its new architecture series, with native multimodal vision understanding. It is live on the DeepSeek API under deepseek-flash, and API prices dropped at the same time. The older V4 Flash and V4 Flash Vision Exp are retired, with their call names routed to V4.1 Flash for now.

Why it matters: DeepSeek routes the old model names to V4.1 Flash and cuts API prices, so existing calls keep their names but switch models.

Sep 8Tuesday

OpenAI News

OpenAI launches ChatGPT Images 2.5 with faster generation and sharper editing

OpenAI released Images 2.5, a new image model that cuts generation latency by up to 50% and improves lighting, textures, and multi-turn editing consistency. Over 3 billion images are already created weekly across ChatGPT and the API. A new Sketch feature lets users draw directly in ChatGPT as a reference. API availability is confirmed, but the post does not disclose pricing details.

Why it matters: ChatGPT Images 2.5 cuts image generation latency by up to 50% versus 2.0 and adds sketch input from a drawing tablet.

Sep 2Wednesday

Google Blog · Gemini

Gemini adds agentic video understanding, cutting token use by up to 88%

Google launched agentic video understanding, supported on Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite. Video analysis costs drop by up to 66%, token use by up to 88%, and accuracy rises by up to 7%.

Why it matters: Gemini retrieves video segments on demand instead of processing at a fixed frame rate, cutting token use and missed detail so long video analysis balances cost and accuracy.