Recreating Minecraft Is Not a Benchmark

After GPT Astra launched, feeds filled with the same demo-benchmarks: one-prompt Minecraft clones, MS Paint, SVG animations. Kuber Mehta argues these tests are broken—visually impressive and easy to grasp, but trivial for labs to overfit by the next release, so they no longer measure real capability.

Why it matters: An opinion piece, but it offers an actionable framework ('demo benchmarks') that's directly useful for practitioners tired of seeing the same Minecraft demos. Score capped because it lacks experimental data — it's experiential observation, not empirical research.