Skip to content

#多模态

1 today

Aug 25Tuesday

OpenAI News

OpenAI bans Russian accounts behind a covert influence campaign posing as an Israel-based think tank

OpenAI banned a cluster of Russia-based ChatGPT accounts used to promote the International Burke Institute (IBI), a fake think tank claiming to be in Israel. The site copied academic work, used machine translation, and published a sovereignty index favoring Russia. Operators prompted the model in Russian to generate English social media posts while hiding linguistic clues. OpenAI calls this the most elaborate Russia-linked IO they've disrupted since the Ukraine war began, though it reached relatively small audiences.

Why it matters: OpenAI says it banned Russian accounts that used Russian prompts to generate English posts and comments for a fake Israel-based think tank pushing a pro-Russia, anti-West sovereignty index.

Aug 21Friday

DeepSeek · API updates

DeepSeek-V4-Flash-Vision-Exp released and live on the API platform

DeepSeek released DeepSeek-V4-Flash-Vision-Exp, an experimental multimodal vision understanding model, available on the DeepSeek API platform by setting model='deepseek-v4-flash-vision-exp'.

Why it matters: DeepSeek's vision experiment keeps the official version's text-only ability in its own benchmarks while vision agent ability rises close to Opus-4.8.

Aug 12Wednesday

Google DeepMind

Google DeepMind releases SL2T sign language-to-text model, first in Pixel 11 Gboard and Live Transcribe

Google DeepMind released SL2T, a multilingual sign language-to-text model, bringing sign language AI into consumer products for the first time. On Pixel 11, Gboard and Live Transcribe support American Sign Language (ASL) to English dictation, with more devices and languages to follow.

Why it matters: Google DeepMind put its multilingual sign language to text model SL2T into Gboard and Live Transcribe on Pixel 11, supporting American Sign Language dictation in English.

Jul 21Tuesday

Google DeepMind

Google DeepMind releases Gemini 3.6 Flash, 3.5 Flash-Lite and 3.5 Flash Cyber

Google DeepMind released three new models: Gemini 3.6 Flash, 3.5 Flash-Lite, and the security-focused 3.5 Flash Cyber.

Why it matters: Gemini 3.6 Flash cuts output token use by 17% against 3.5 Flash at $7.50 per million output tokens, with better scores on several benchmarks.

Jun 10Wednesday

OpenAI News

OpenAI banned PRC-linked ChatGPT accounts running covert influence ops on US AI debates

OpenAI published a threat report on June 10 detailing two clusters of ChatGPT accounts likely originating from China, both banned for covert influence operations. One cluster, named 'Data Center Bandwagon,' generated posts claiming AI data centers were raising household electricity prices. The other, 'Tech and Tariffs,' criticized US tariffs as tech competition tactics and instructed outputs to mention only President Trump, not Xi Jinping. That second cluster also spread false claims of a ChatGPT user data breach, which OpenAI calls entirely fabricated. OpenAI found no evidence the operations shifted public opinion, but sees them as testing narratives against US AI infrastructure. The post does not disclose account counts, target platforms, or reach metrics.

Why it matters: OpenAI's threat report names two China-linked account clusters posting about data center power bills and tech tariffs, a concrete case of covert influence in AI policy talk.

Jun 1Monday

OpenAI News

OpenAI bans PRC-linked accounts using ChatGPT to generate comments on US tech policy and tariffs

OpenAI's June 2026 threat report details a banned cluster of ChatGPT accounts likely originating in China. The operators used Simplified Chinese prompts and VPNs to generate English comments and political cartoons criticizing US tariffs, rare earths, AI, and 5G policy. They instructed the model to depict only Trump, not Xi Jinping or China. The same cluster produced Chinese-language water army content attacking the US and Israel, amplifying anti-Jewish tropes, and harassing dissidents. OpenAI also linked these accounts to a separate X network that falsely claimed ChatGPT user data was compromised. The post does not disclose the exact number of banned accounts or the operators' specific institutional affiliation.

Why it matters: OpenAI's threat report says it banned accounts likely from China that used Simplified Chinese prompts to mass-produce English comments and cartoons aimed at US tariff and tech policy debates.

May 28Thursday

NVIDIA Blog

NVIDIA Research Advances Robotics From Simulation to the Real World

NVIDIA Research presented 8 ICRA papers on sim-to-real robotics: ScheduleStream delivered a 3x speedup for multi-arm planning, COMPASS reached about 80% success across 20 real-world navigation trials, and Grasp-MPC achieved about 75% real-robot grasping success.

Why it matters: NVIDIA's COMPASS navigates real robots after simulation-only training, hitting roughly 80% success across 20 trials, 4.5x a pure imitation baseline.

May 26Tuesday

Alibaba Technology · WeChat

Nearly 9x training speedup: residual streams in DiT are becoming a convergence bottleneck

Nanjing University LAMDA and Alibaba Intelligent Engine proposed DAR, a timestep-aware cross-layer routing method that replaces fixed residual accumulation in DiT; on ImageNet 256x256, it reduced SiT-XL/2 FID from 9.67 to 7.56 and reached baseline convergence quality with 8.75x fewer training iterations.

Why it matters: Nanjing University's LAMDA lab and Alibaba replace DiT's fixed residual accumulation with per-timestep cross-layer routing, reaching equal convergence on ImageNet in about one-ninth the training steps.

May 18Monday

Google DeepMind

Google DeepMind releases Gemini Omni Flash video model

Google DeepMind released Gemini Omni Flash, the first model in the Gemini Omni family. It combines image, audio, video and text inputs to generate high-quality video, and supports multi-turn editing in natural language.

Why it matters: One model now handles image, audio, video and text input plus multi-turn editing, and it ships inside Gemini, Flow and Shorts.

May 17Sunday

Google DeepMind

Google expands content provenance and verification tools across Search, Gemini, Chrome and Pixel

Google is widening its content transparency and verification tools across Search, Gemini, Chrome, Pixel and Cloud, and deepening industry partnerships. SynthID has watermarked over 100 billion images and videos plus 60,000 years of audio. SynthID verification in the Gemini app has been used 50 million times, and the capability reaches Search today, with Chrome in the coming weeks.

Why it matters: SynthID verification now reaches Search and Chrome, plus C2PA checks, so AI content labels cover more of the browsing path.

May 16Saturday

Google DeepMind

Google DeepMind releases Gemini 3.5 Flash

Google DeepMind released the Gemini 3.5 model family, with the first model, Gemini 3.5 Flash, available the same day in the Gemini app, Google Search AI Mode, Google Antigravity, the Gemini API and Gemini Enterprise.

Why it matters: Gemini 3.5 Flash beats Gemini 3.1 Pro on coding and agent benchmarks and outputs 4x faster than other frontier models, shipping the same day in the Gemini app, Search AI Mode and the Gemini API.

Apr 30Thursday

Google DeepMind

Google DeepMind announces AI co-clinician medical research program

Google DeepMind announced an AI co-clinician research program, exploring how AI agents can assist patient care under a doctor's clinical supervision. In a blinded evaluation of 98 real primary care queries, the system made no critical errors in 97 cases, and doctors preferred its answers over mainstream evidence synthesis tools. On 140 consultation skills, it matched or beat primary care physicians on 68, but expert physicians were still better overall at spotting red flags and key physical exams.

Why it matters: Google DeepMind details its AI co-clinician research program: in a blinded review of 98 real primary care queries, 97 had no critical errors, and doctors preferred its answers over mainstream evidence synthesis tools.

Apr 29Wednesday

NVIDIA Blog

NVIDIA Launches Nemotron 3 Nano Omni for Vision, Audio, and Language Agents

NVIDIA launched Nemotron 3 Nano Omni, claiming up to 9x higher throughput at the same interactivity. It uses a 30B-A3B hybrid MoE with Conv3D, EVS, and 256K context, taking text, images, audio, video, documents, charts, and GUIs as input. Open weights, datasets, and training methods arrive April 28, 2026 on Hugging Face, OpenRouter, build.nvidia.com, and 25+ platforms.

Why it matters: NVIDIA open-sourced Nemotron 3 Nano Omni, one model handling image, text, audio and video with 3B active parameters and 256K context, giving teams building multimodal agents an open path.

Apr 22Wednesday

X · @OpenAI

Introducing ChatGPT Images 2.0

OpenAI introduced ChatGPT Images 2.0 as an image model for complex visual tasks and directly usable visuals. The RSS snippet cites sharper editing, richer layouts, and “thinking-level intelligence,” but the post does not disclose model size, pricing, latency, or rollout scope.

Why it matters: OpenAI's ChatGPT Images 2.0 announcement claims finer edits, richer layouts and thinking-level intelligence, but gives no model size, pricing or rollout details.

Apr 21Tuesday

OpenAI News

Introducing ChatGPT Images 2.0

OpenAI introduced ChatGPT Images 2.0 as a new image generation model, highlighting better text rendering, multilingual support, and visual reasoning. The RSS snippet names only these three upgrades; the post does not disclose architecture, resolution, pricing, latency, or availability. What matters is whether text fidelity and multilingual consistency improve in real use; for now, only headline-level details are disclosed.

Why it matters: OpenAI released ChatGPT Images 2.0, claiming gains in text accuracy, multilingual layout and visual reasoning on complex prompts, with sample posters, comics and magazine pages.

Apr 17Friday

X · @claudeai

Introducing Claude Design by Anthropic Labs: make prototypes, slides, and one-pagers by talking to Claude

Anthropic Labs launched Claude Design in research preview for Pro, Max, Team, and Enterprise plans, letting users create prototypes, slides, and one-pagers by talking to Claude. The post says it runs on Claude Opus 4.7, Anthropic’s most capable vision model; the post does not disclose pricing, output constraints, or a detailed rollout schedule. The thing to watch is the interactive design workflow, not just another writing surface.

Why it matters: Anthropic Labs released Claude Design as a research preview for Pro, Max, Team and Enterprise users, generating prototypes, slides and one-pagers from conversation and running on Opus 4.7.

Apr 3Friday

Google DeepMind

Google DeepMind releases the Gemma 4 open model family

Google DeepMind released Gemma 4, which it calls its most intelligent open model yet, aimed at advanced reasoning and agentic workflows under an Apache 2.0 license. The family comes in four sizes: E2B, E4B, 26B MoE and 31B Dense. The 31B ranks 3rd among open models on the Arena AI text leaderboard, and the 26B ranks 6th.

Why it matters: Gemma 4 ships under Apache 2.0 in four sizes, with 31B ranked 3rd and 26B 6th among open models on the Arena AI text board, a reference for deployment and fine-tuning choices.

Mar 24Tuesday

Mistral AI

Mistral AI releases Voxtral TTS, a 4B-parameter speech model

Mistral AI released Voxtral TTS, its first text-to-speech model. It has 4B parameters and supports nine languages: English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi and Arabic. It handles emotional expression and zero-shot cross-lingual voice adaptation.

Why it matters: A 4B open TTS model covering 9 languages, with a head-to-head against ElevenLabs as a reference point.

Mar 17Tuesday

OpenAI News

Introducing GPT-5.4 mini and nano

OpenAI released GPT-5.4 mini and nano on March 17, 2026 for coding and subagents; mini runs over 2x faster than GPT-5 mini. In the API, mini has a 400k context window and costs $0.75/$4.50 per 1M input/output tokens, while nano is API-only at $0.20/$1.25. The key signal is performance per latency: mini scores 54.4% on SWE-Bench Pro versus GPT-5.4 at 57.7%.

Why it matters: OpenAI released GPT-5.4 mini and nano for high-throughput, low-latency work, with mini beating the prior generation on coding, reasoning, vision and tool use at more than double the speed.

Mistral AI

Mistral releases Mistral Small 4, unifying reasoning, multimodal and coding

Mistral AI released Mistral Small 4, the first Mistral model to unify Magistral reasoning, Pixtral multimodal and Devstral coding-agent abilities in a single model. It ships under the Apache 2.0 license.

Why it matters: Merging reasoning, multimodal and coding into one open model, with latency and throughput numbers against Mistral Small 3.

Feb 13Friday

OpenAI News

Beyond rate limits: scaling access to Codex and Sora

OpenAI says in the headline it will scale access to Codex and Sora beyond current rate limits. The body is empty and does not disclose quota changes, eligible users, pricing, or rollout timing. The key missing fact is the access mechanism, not the headline claim.

Why it matters: OpenAI's engineering post explains how Codex and Sora merged rate limits and prepaid credits into one access system, where requests draw on free rate quota first and then the credit balance.

Jan 6Tuesday

NVIDIA Blog

NVIDIA RTX Accelerates 4K AI Video Generation on PC With LTX-2 and ComfyUI Upgrades

NVIDIA said GeForce RTX and related devices can run LTX-2 and updated ComfyUI for local AI video generation up to 3x faster with up to 60% lower VRAM use. The post attributes this to PyTorch-CUDA optimizations, native NVFP4/FP8 support in ComfyUI, and an RTX Video 4K upscaling node due next month; LTX-2 open weights are available now and the workflow ships next month. The real signal for AI builders is that local 4K video is shifting from VRAM-bound demos to usable RTX workflows.

Why it matters: NVIDIA's CES push for local AI video generation shows how much speed and VRAM headroom RTX cards gain from low-precision work.

NVIDIA Blog

NVIDIA unveils new open models, data and tools across agents, robotics, AVs and biomedicine

NVIDIA released open models, datasets and training tools spanning Nemotron, Cosmos, Alpamayo, Isaac GR00T and Clara, plus 10T language tokens, 500K robotics trajectories, 455K protein structures and 100TB of vehicle sensor data. Newly disclosed items include Nemotron Speech/RAG/Safety, Cosmos Reason 2, Transfer 2.5, Predict 2.5, GR00T N1.6 and Alpamayo 1; the key signal is that NVIDIA is opening the data stack across agents, physical AI, AVs and biomedicine.

Why it matters: NVIDIA's open release spans agents, robotics, autonomous driving and biotech, with new Nemotron models for speech, RAG and safety alignment.

Dec 17, 2025Wednesday

Mistral AI

Mistral releases OCR 3 with better forms and handwriting, plus Document AI Playground

Mistral released Mistral OCR 3, which wins 74% of head-to-head comparisons against Mistral OCR 2 on forms, scanned documents, complex tables and handwriting. Mistral says its accuracy beats enterprise document-processing tools and AI-native OCR options.

Why it matters: Mistral OCR 3's upgrades on forms, handwriting and complex tables, plus its $2 per 1,000 pages pricing, are useful when evaluating document parsing options.

Dec 16, 2025Tuesday

OpenAI News

The new ChatGPT Images is here

OpenAI says the new ChatGPT Images is now available, and the only confirmed fact is a product availability update. The body is empty; the post does not disclose model name, quality, pricing, quotas, or rollout scope.

Why it matters: OpenAI launched a new ChatGPT image feature, claiming 4x faster generation and edits that change only the specified part while keeping the original lighting, composition and face consistency.

Dec 11, 2025Thursday

OpenAI News

The Walt Disney Company and OpenAI reach agreement to bring beloved characters to Sora

The Walt Disney Company and OpenAI reached an agreement to bring Disney characters to Sora; only the title is available and the body is empty. The title confirms the parties and Sora as the target, but the post does not disclose scope, character list, launch timing, or licensing terms.

Why it matters: Disney signed a three-year licensing deal with OpenAI, bringing more than 200 Disney, Marvel, Pixar and Star Wars characters into Sora and ChatGPT image generation for user-made clips and images.

Dec 3, 2025Wednesday

Mistral AI

Mistral releases the Mistral 3 family, including 675B-parameter Mistral Large 3

Mistral AI released the Mistral 3 family: three dense models at 14B, 8B and 3B, plus Mistral Large 3, which uses a sparse MoE architecture with 41B active and 675B total parameters. All are open-sourced under Apache 2.0.

Why it matters: Mistral open-sources the Mistral 3 family under Apache 2.0, from 3B to 14B dense models up to a sparse MoE model with 675B total parameters, covering on-device through frontier scale.

Oct 21, 2025Tuesday

Hugging Face Blog

Unlock the power of images with AI Sheets

Hugging Face added vision support to its open-source AI Sheets, letting users analyze images, extract data, generate visuals, and edit images inside a spreadsheet. The post says AI Sheets uses Inference Providers to access thousands of open models, and manual edits plus thumbs-up feedback become few-shot examples; outputs can be exported as CSV or Parquet. What matters is the unified data workflow, not a standalone demo.

Why it matters: Hugging Face added vision to its open-source spreadsheet tool AI Sheets, so users can drop in receipts, documents or product images and extract or edit with natural language.

Sep 30, 2025Tuesday

OpenAI News

Sora 2 System Card

OpenAI published the Sora 2 System Card on September 30, 2025, and said the video-audio generation model will launch first via limited invites on sora.com and a standalone iOS app. The post confirms no video uploads and no image uploads with photorealistic people at launch; API timing, pricing, and benchmark scores are not disclosed.

Why it matters: The Sora 2 system card details gains in physics, realism and audio sync, plus the invite-only launch and the initial ban on uploading real people.

OpenAI News

Sora 2 is here

OpenAI released Sora 2 on September 30, 2025 and launched a social iOS app called Sora built on the model. The post says it generates video with synced dialogue and sound effects, and its “characters” feature uses a one-time video and audio recording to verify identity and insert a real person’s likeness; pricing, generation limits, and rollout regions are not disclosed. The key shift is from model demo to a consumer app with a feed, teen limits, and parental controls.

Why it matters: OpenAI shipped Sora 2 and a matching iOS social app the same day, with synced dialogue and sound, and verified users can put their own likeness and voice into scenes.

Sep 29, 2025Monday

OpenAI News

Introducing parental controls

OpenAI launched parental controls for all ChatGPT users on September 29, 2025, letting parents link with teen accounts and manage usage settings from their own account. Linked teen accounts get stronger content safeguards by default, and parents can set quiet hours, disable voice, memory, image generation, and opt out of model training. The key mechanism is the alert flow: suspected self-harm signals trigger human review, and acute distress leads to email, SMS, and push notifications to parents.

Why it matters: Parental controls are now open to all ChatGPT users, letting parents set blackout hours, disable voice and memory, block image generation and tighten teen filtering by default.

OpenAI News

Combating online child sexual exploitation & abuse

OpenAI said on September 29, 2025 it bans any sexualized content involving people under 18, and reports accounts that generate or upload CSAM/CSEM to NCMEC. The post names hash matching, Thorn’s CSAM classifier, and OpenAI models for monitoring text, image, audio, video, and uploads; the key signal is that OpenAI says it has observed users uploading abusive material and asking for detailed descriptions.

Why it matters: OpenAI lays out how it blocks child sexual abuse material through hash matching, Thorn classifiers and cross-modal scanning, and names an abuse pattern it has seen.

Aug 6, 2025Wednesday

OpenAI News

Providing ChatGPT to the Entire U.S. Federal Workforce

OpenAI partnered with the U.S. General Services Administration to offer ChatGPT Enterprise to the full federal executive workforce for $1 per agency for 1 year. Participating agencies also get 60 days of unlimited advanced models and features, including Deep Research and Advanced Voice Mode; federal business data will not be used for training. The key signal is centralized procurement access, while the post does not disclose agency count, budget size, or exact model list.

Why it matters: OpenAI's deal with the U.S. General Services Administration gives federal civilian agencies ChatGPT Enterprise for all staff at $1 for a year, plus 60 days of unlimited advanced features.

Jul 17, 2025Thursday

Mistral AI

Mistral adds Deep Research, voice mode and more to Le Chat

Mistral rolled out a batch of new Le Chat features: a preview Deep Research mode, a voice mode powered by the new Voxtral speech model, a multilingual thinking mode backed by the Magistral reasoning model, Projects for organizing conversations, and advanced image editing built with Black Forest Labs.

Why it matters: Le Chat ships five features at once, including Deep Research, voice, multilingual reasoning, Projects and image editing, with Deep Research driven by a tool-augmented agent that cites sources.

Jun 1, 2025Sunday

OpenAI News

OpenAI bans China-origin accounts using ChatGPT to generate US polarization content

OpenAI banned a set of China-origin ChatGPT accounts, dubbed 'Uncle Spam,' after a tip from Meta. The accounts used models to generate pro- and anti-tariff posts, create fake US veteran profile images, and write code to scrape user data from X and Bluesky. The content pushed both sides of divisive topics but got almost no real engagement—most posts had zero likes or reposts. OpenAI rates the impact as Category 2 on the Brookings Breakout Scale: multi-platform activity with no breakout.

Why it matters: Acting on a tip from Meta, OpenAI banned a set of China-based ChatGPT accounts that used AI to write pro- and anti-tariff posts and fake veteran avatars, stoking US polarization on X and Bluesky.

May 8, 2025Thursday

OpenAI News

Introducing data residency in Asia

OpenAI launched data residency on May 7, 2025 in Japan, India, Singapore, and South Korea for ChatGPT Enterprise, ChatGPT Edu, and the API Platform. Eligible API customers must create a new Project and pick a country; new Enterprise and Edu workspaces can store customer content at rest in-region, including chats, uploads, and text, vision, and image data. The key limit: the post only states at-rest storage and does not disclose whether inference stays fully local.

Why it matters: Shows how OpenAI is answering data sovereignty demands in four Asian markets by keeping enterprise data in-country.

May 7, 2025Wednesday

Mistral AI

Mistral AI releases Mistral Medium 3, targeting low cost and enterprise deployment

Mistral AI released Mistral Medium 3, which it says reaches or exceeds 90% of Claude Sonnet 3.7 across benchmarks. Pricing is $0.4 per million input tokens and $2 per million output tokens.

Why it matters: Mistral Medium 3 benchmarks against Claude Sonnet 3.7 at lower cost, and the post gives a path to private enterprise deployment and customization.

Apr 23, 2025Wednesday

OpenAI News

Introducing our latest image generation model in the API

OpenAI added gpt-image-1 to the Images API on April 23, 2025, after ChatGPT image generation reached 130 million users and 700 million images in its first week. Pricing is token-based: $5 per 1M text input tokens, $10 per 1M image input tokens, and $40 per 1M image output tokens, or about $0.02, $0.07, and $0.19 per square image by quality. The part to watch is operational: it keeps 4o image safety guardrails, adds C2PA metadata, and does not train on customer API data by default.

Why it matters: Developers can now call the image model behind ChatGPT's 700 million weekly images directly through the API.

Apr 16, 2025Wednesday

OpenAI News

Introducing OpenAI o3 and o4-mini

OpenAI released o3 and o4-mini on April 16, 2025, and said its reasoning models can now use ChatGPT tools together, including web search, Python, files, and images. The post says o3 makes 20% fewer major errors than o1 in expert evals, while o4-mini reaches 99.5% pass@1 and 100% consensus@8 on AIME 2025 with Python. The real shift is RL-trained tool use, not just two new model names.

Why it matters: Covers OpenAI's o3 and o4-mini release, which pairs reasoning with tool use and cuts major errors by 20% versus o1.

OpenAI News

Thinking with images

OpenAI said on April 16, 2025 that o3 and o4-mini can process user images inside their internal reasoning chain, with native crop, zoom, and rotation actions. The post shows o3 taking 20 seconds to read upside-down handwriting and 1m44s to solve a maze and draw a path; it claims strong multimodal benchmark results, but the provided body does not disclose the scores. The key point is that image manipulation is folded into the same reasoning stack, not handed off to a separate vision model.

Why it matters: Shows how o3 and o4-mini crop, rotate and zoom images inside the reasoning chain instead of relying on a separate vision model.