r/LocalLLaMAApr 19, 2026, 09:59 UTC+8

I tested 8 LLMs as tabletop GMs: a 27B model beat the 405B on narrative quality

I tested 8 LLMs as tabletop GMs - a 27B model beat the 405B on narrative quality

The author tested 8 LLMs on 6 fixed tabletop-GM scenarios, and google/gemma-3-27b-it ranked first in narrative quality with a 4.33 overall score. The probe used 8 auto metrics plus 3 LLM-judge scores, and the full run cost about $0.02; the title says a 27B beat a 405B, but the snippet does not disclose the 405B model name or full rankings.

Why it matters: A named first-person benchmark with a strong surprise hook clears HKR-H, HKR-K, and HKR-R. I kept it at featured, not higher: the source is Reddit, the post is truncated, and the 405B model name plus full ranking are not disclosed.

Read the original ↗Export Markdown

Take

Gemma-3-27B-it winning this GM probe is plausible, but the “27B beat 405B” framing is doing too much work. The evidence is narrow: 6 fixed tabletop-GM scenarios, 8 automatic metrics, 3 LLM-judge dimensions, a total run cost around $0.02, and a 4.33 overall score for the winner. The Reddit body is blocked by 403, so the 405B model name and full ranking are not disclosed.

I’d read this as a taste test for narrative control, not a clean scale result. Gemma models have often been good at concise, obedient prose, and GM tasks reward exactly that: tone, pacing, NPC consistency, and not rambling past the scene. A Llama 3.1 405B-style model can lose that kind of beauty contest if the judge likes tighter prose. Without human player blind tests and multi-turn state tracking, this benchmark says the prompt suite is neat; it does not prove 27B generally beats 405B.

Source: r/LocalLLaMA · reddit.com
Published: Apr 19, 2026, 09:59 UTC+8 · Apr 19, 2026