Skip to content
r/LocalLLaMA

I tested 8 LLMs as tabletop GMs: a 27B model beat the 405B on narrative quality

I tested 8 LLMs as tabletop GMs - a 27B model beat the 405B on narrative quality

The author tested 8 LLMs on 6 fixed tabletop-GM scenarios, and google/gemma-3-27b-it ranked first in narrative quality with a 4.33 overall score. The probe used 8 auto metrics plus 3 LLM-judge scores, and the full run cost about $0.02; the title says a 27B beat a 405B, but the snippet does not disclose the 405B model name or full rankings.

Why it matters: Eight models were tested as tabletop GMs across 6 fixed scenarios with 8 automatic metrics and 3 LLM judges, and google/gemma-3-27b-it topped the narrative ranking at 4.33.

Read the original ↗Export Markdown