DeepSeek's model releases, open weights and technical reports — the bellwether for open-model price and performance.
The deepseek-chat model has been upgraded to DeepSeek-V2-0628. Reasoning improved, and role-play got a clear boost. HumanEval Pass@1 rose from 79.88% to 84.76%, MATH ACC@1 from 55.02% to 71.02%, and BBH from 78.56% to 83.40%.
Why it matters: The math benchmark gain is larger than the code and reasoning gains, and the win rate against GPT-4-0314 on Arena-Hard also improved.
The deepseek-coder model has been upgraded to DeepSeek-Coder-V2-0614, with a clear gain in coding ability. The company says its code generation, code understanding, code repair and code completion reach the level of GPT-4-Turbo-0409, with strong math and reasoning, while general ability matches DeepSeek-V2-0517.
Why it matters: DeepSeek upgrades its code model and benchmarks code generation, understanding, repair and completion against GPT-4-Turbo-0409.