Benchmarking code generation, code understanding, code repair, and code completion directly against GPT-4-Turbo-0409 is a bold stance. That takes serious confidence.
The team pinned their performance target specifically to the 0409 build. They locked onto it across all four core capabilities, and they matched it on mathematics and reasoning as well. Seeing that kind of detailed matchup makes me believe they have genuine engineering chops. When a specialized code model challenges GPT-4 this directly, the intent is clear. It is aiming to replace general frontier models entirely across developer workflows. If its repair and completion abilities truly hit this level, trusting it to carry real code generation tasks holds up completely.