Skip to content
Hacker News front page

CodeRabbit evaluates GPT-6 Astra: 20% more cross-file bugs caught than Sol

GPT-6 Astra in code review: Gains, privacy, and cost

CodeRabbit benchmarked OpenAI's GPT-6 Astra on code review. It caught ~4% more actionable bugs overall vs GPT-5.6 Sol, and 20% more on hard cross-file reviews. API pricing is steep: $10/1M input tokens, $50/1M output—roughly 2.5× Sol's cost for a 100K-input-token task. The post doesn't disclose benchmark size, bug-type breakdown, or false-positive rate, so treat the absolute numbers as directional.

Why it matters: CodeRabbit benchmarked GPT-6 Astra on code review with its own tests, finding it caught 20% more bugs than GPT-5.6 Sol and 33% more than Opus 5 in cross-file review, alongside API pricing and privacy handling.

Read the original ↗Export Markdown