Skip to content

#数据/训练

6 today

Feb 12Thursday

MIT Technology Review · AI

What’s next for Chinese open-source AI

MIT Technology Review says that after DeepSeek released R1 in January 2025, Chinese firms kept shipping open-weight models near top Western systems; Moonshot AI’s Kimi K2.5 was close to Anthropic Claude Opus on early benchmarks at about one-seventh the price. The post also says Qwen took over 30% of Hugging Face downloads in 2024 and surpassed Meta Llama in cumulative downloads by 2025–2026; the key shift is from a few general models to many fine-tunable, distillable variants.

Why it matters: MIT Technology Review traces where Chinese open-source models went after DeepSeek R1, citing Moonshot AI's Kimi K2.5 early scores near Claude Opus at roughly a seventh of the price.

Jan 31Saturday

MIT Technology Review · AI

Inside the marketplace powering bespoke AI deepfakes of real women

Researchers from Stanford and Indiana University found that on Civitai, 90% of deepfake bounty requests targeted women and 86% asked for custom LoRAs between mid-2023 and late 2024. Bounties paid $0.50 to $5 and nearly 92% were fulfilled; MIT Technology Review confirmed that even after Civitai's May 2025 deepfake ban, many older requests and purchasable outputs remained live. The key point is that the platform hosts tutorials, payment rails, and matching infrastructure, not just user uploads.

Why it matters: Researchers at Stanford and Indiana University analyzed Civitai data and found that from mid-2023 to the end of 2024, nine in ten custom deepfake requests named real women, mapping demand concentration in that marketplace.

Jan 6Tuesday

NVIDIA Blog

NVIDIA DGX Spark and DGX Station power the latest open-source and frontier models from the desktop

NVIDIA showed at CES that DGX Spark and DGX Station can run 100B to 1T-parameter models locally on deskside systems. The post cites a 35% average llama.cpp speedup, up to 70% NVFP4 compression, 775GB coherent memory on DGX Station, and a 250,000 token/sec pretraining demo. The real signal is the local dev loop: fine-tuning, inference, RAG, coding assistants, and robotics demos all target replacing some cloud iteration with deskside compute.

Why it matters: DGX Spark and DGX Station show what desktop hardware is needed to run 100B to 1T parameter open models locally.

Jan 3Saturday

TechCrunch · AI

How AI is reshaping work and who gets to do it, according to Mercor's CEO

Mercor reached a $10 billion valuation in 3 years and acts as a talent middleman in AI's data boom. The RSS snippet says it connects labs such as OpenAI and Anthropic with former Goldman Sachs, McKinsey, and elite law firm employees, paying up to $200 an hour to provide domain expertise and train models. The real signal is the labor pipeline: experts from automatable fields are helping build these systems; the post does not disclose scale, contract terms, or task allocation.

Why it matters: Three-year-old Mercor places former Goldman Sachs, McKinsey and top-law-firm staff as data labelers for labs like OpenAI and Anthropic at up to $200 an hour, and is already valued at $10 billion.

Aug 5, 2025Tuesday

OpenAI News

Estimating Worst-Case Frontier Risks of Open-Weight LLMs

OpenAI says malicious fine-tuning tests on gpt-oss informed its decision to release the model. It trained gpt-oss for maximum biorisk with RL plus web browsing, and for cyber risk in an agentic coding CTF setup; the resulting models still underperformed OpenAI o3. The key signal is the evaluation method, because the post does not disclose exact scores, training scale, or release thresholds.

Why it matters: OpenAI published its malicious fine-tuning method for probing worst-case gpt-oss risks, using biological threat creation and CTF challenges as test environments.

Jun 16, 2025Monday

OpenAI News

Introducing OpenAI for Government

OpenAI launched OpenAI for Government on June 16, 2025, consolidating its existing US public-sector work under one program for federal, state, and local agencies. Its first partnership is a pilot with the US Department of Defense CDAO under a contract capped at $200 million, offering ChatGPT Enterprise, ChatGPT Gov, secure environments, and limited custom national-security models. The practical signal is deployment: a Pennsylvania pilot reported about 105 minutes saved per employee per day, while the post does not disclose model versions, pricing, or rollout scale.

Why it matters: OpenAI folded its federal, state and local public-sector work into a government unit, and signed a pilot contract with the US Defense Department's CDAO worth up to $200 million for administrative workflow work.

Apr 9, 2025Wednesday

OpenAI News

OpenAI Pioneers Program

OpenAI announced the Pioneers Program on April 9, 2025, selecting a handful of startups to build domain-specific evals and custom models for each company’s top three use cases. The program includes public industry evals and reinforcement fine-tuning with OpenAI researchers; the post does not disclose pricing, cohort size, base models, or rollout dates. The key signal is public eval creation, not model specs.

Why it matters: OpenAI's Pioneers program builds and publishes domain benchmarks with law, finance and healthcare firms, giving industry teams a view of how models are judged in their fields.

Mar 4, 2025Tuesday

OpenAI News

Introducing NextGenAI: A consortium to advance research and education with AI

OpenAI launched NextGenAI and committed $50M in grants, compute funding, and API access to support 15 research institutions using AI in research and education. The post lists 16 founding members including OpenAI; MIT can train and fine-tune models, and Oxford’s Bodleian Library uses the API to transcribe rare texts. The real signal is not a single product, but OpenAI tying universities, hospitals, and libraries into its tooling stack.

Why it matters: OpenAI puts $50 million into a 15-partner university, hospital and library alliance, giving members research funding, compute and API credits.

Dec 17, 2024Tuesday

OpenAI News

OpenAI o1 and new tools for developers

OpenAI released o1 in the API, updated the Realtime API, added Preference Fine-Tuning, and shipped beta Go/Java SDKs; o1 is rolling out first to usage tier 5 developers. Disclosed details include 60% fewer reasoning tokens than o1-preview on average, and a 60% GPT-4o audio price cut in Realtime API to $40/1M input and $80/1M output tokens. The key shift is production support for function calling, Structured Outputs, developer messages, vision, and a reasoning_effort parameter; the post is truncated, so some GPT-4o mini realtime pricing details are not disclosed here.

Why it matters: OpenAI put the o1 model into its API with function calling, structured outputs and image understanding, and says it uses about 60% fewer reasoning tokens on average than the preview.

Oct 3, 2024Thursday

OpenAI News

Introducing canvas, a new way to write and code with ChatGPT

OpenAI launched the canvas beta on October 3, 2024 for ChatGPT Plus and Team users, adding a GPT-4o-based workspace for writing and coding beyond chat. The post says canvas can auto-trigger or open via “use canvas,” supports targeted edits, version restore, and shortcuts like code review and bug fixing. The key signal is model training: across 20+ internal evals, trigger accuracy reached 83% for writing and 94% for coding, targeted edits beat baseline by 18%, and comment accuracy and quality improved by 30% and 16%.

Why it matters: OpenAI launches Canvas in beta, a separate window for writing and coding where the model opens on its own and offers inline edits.

Oct 1, 2024Tuesday

OpenAI News

Introducing vision to the fine-tuning API

OpenAI launched GPT-4o vision fine-tuning on Oct 1, 2024, letting paid-tier developers train with images plus text, starting from as few as 100 images. The post cites Grab improving lane-count accuracy by 20% and speed-limit sign localization by 13%, while Automat raised RPA success from 16.60% to 61.67%. The notable shift is multimodal customization in the main API; the pricing section is truncated, so full price details are not disclosed.

Why it matters: Lets teams fine-tune on images, with a concrete accuracy gain from a small sample.

OpenAI News

Model Distillation in the API

OpenAI launched an API distillation workflow on October 1, 2024, letting developers use outputs from GPT-4o and o1-preview to fine-tune cheaper models such as GPT-4o mini. The suite includes Stored Completions, Evals in beta, and fine-tuning; setting store:true auto-saves input-output pairs with no added latency, per the post. Pricing includes 2M free GPT-4o mini training tokens per day and 1M for GPT-4o through October 31; Evals are free up to 7 runs per week through year-end if shared with OpenAI.

Why it matters: Turns distillation into a built-in API step instead of a pipeline teams build themselves.

Aug 20, 2024Tuesday

OpenAI News

Fine-tuning now available for GPT-4o

OpenAI has opened GPT-4o fine-tuning to developers on all paid tiers, with 1M free training tokens per org per day through September 23. Training costs $25 per 1M tokens, and inference costs $3.75 per 1M input tokens and $15 per 1M output tokens on gpt-4o-2024-08-06. The signal for practitioners: partners reported 43.8% on SWE-bench Verified and 71.83% on BIRD-SQL with fine-tuned GPT-4o.

Why it matters: OpenAI opens GPT-4o fine-tuning to all paying developers at $25 per million training tokens, with 1 million free tokens per organization per day until September 23.

Jul 24, 2024Wednesday

OpenAI News

Improving Model Safety Behavior with Rule-Based Rewards

OpenAI said on July 24, 2024 it uses Rule-Based Rewards in the RLHF pipeline to reduce repeated human feedback for safety alignment. The post defines three response types—hard refusal, soft refusal, and comply—and says the method has been part of OpenAI’s safety stack since GPT-4, including GPT-4o mini. The key point is maintainability when policies change; the post excerpt does not disclose quantitative gains.

Why it matters: Replacing part of human feedback with rule-based scores means safety policy changes become a rule edit instead of a fresh labeling round, which changes the cost of iterating on alignment.