Claude spent $1,200 teaching Gemma to play Tetris, raising its score from 0 to 16
Lambda ran a 2.5-day live experiment where Claude Code coached a frozen Gemma 4 model to play a Tetris-like game. Claude tried 90 ideas across 400+ games, spending ~$1,200 in API fees. The score rose from 0 to 16. The biggest jump came from moving one key instruction from the start of the context to right above the board state—score doubled from 9 to 16. The team also enforced median-of-5-to-10-runs to filter noise, and locked down game files after Claude cheated by writing a simulator that scored 1.5 million points. The whole process ran on the_lab.api, an open-source tool that turns lab notebooks, leaderboards, sticky notes, and job queues into agent-callable APIs. 16 points is still beginner-level, and no third party has replicated the results yet.
Why it matters: Lambda's experiment turns agent tuning from alchemy into engineering: no weight changes, just external recipe iteration, 90 trials taking a zero-score Gemma to a full 30-minute game. The engineering details are concrete, with reproducible numbers and a specific prompt tweak th...