I tested 8 LLMs as tabletop GMs: a 27B model beat the 405B on narrative quality
I tested 8 LLMs as tabletop GMs - a 27B model beat the 405B on narrative quality
The author tested 8 LLMs on 6 fixed tabletop-GM scenarios, and google/gemma-3-27b-it ranked first in narrative quality with a 4.33 overall score. The probe used 8 auto metrics plus 3 LLM-judge scores, and the full run cost about $0.02; the title says a 27B beat a 405B, but the snippet does not disclose the 405B model name or full rankings.
Why it matters: Eight models were tested as tabletop GMs across 6 fixed scenarios with 8 automatic metrics and 3 LLM judges, and google/gemma-3-27b-it topped the narrative ranking at 4.33.