OpenAI NewsAug 20, 2024, 18:00 UTC+8

Fine-tuning now available for GPT-4o

OpenAI has opened GPT-4o fine-tuning to developers on all paid tiers, with 1M free training tokens per org per day through September 23. Training costs $25 per 1M tokens, and inference costs $3.75 per 1M input tokens and $15 per 1M output tokens on gpt-4o-2024-08-06. The signal for practitioners: partners reported 43.8% on SWE-bench Verified and 71.83% on BIRD-SQL with fine-tuned GPT-4o.

Why it matters: This is a substantive OpenAI developer release with concrete details: temporary free training quota, train/inference prices, base model version, and two benchmark datapoints. HKR-H/K/R all pass, but this is an API capability expansion, not a new frontier-model launch or platform-

Read the original ↗Export Markdown

Take

GPT-4o fine-tuning is a pricing move before it is a capability story. Training costs $25 per million tokens, with inference at $3.75 input and $15 output. That forces application teams to price their private data, output format constraints, and domain behavior against a higher serving bill.

The benchmark hooks are strong: Cosine reports 43.8% on SWE-bench Verified, and Distyl reports 71.83% execution accuracy on BIRD-SQL. But both are partner cases, not a general transfer curve. Fine-tuning shines when the target is narrow: patch formatting, SQL generation, intent routing, self-correction loops. The article does not give ablations for broad agent behavior. I’d treat the SOTA claims as proof that curated task data still matters, not evidence that every GPT-4o wrapper should fine-tune next week.

Source: OpenAI News · openai.com
Published: Aug 20, 2024, 18:00 UTC+8 · Aug 20, 2024