Skip to content
Hacker News front page

Regression to the Mean: LLMs and the quiet death of the new

Regression to the Mean: on LLMs and the quiet death of the new

This essay argues LLMs are built to return the most probable continuation—the center of mass of everything already written. Ask it something genuinely new and it corrects you: unfamiliar terms become typos, consensus becomes fact, conviction gets sanded down to the mean. The deeper risk is feedback: we feed its answers back as the next questions, variance leaks out of culture, and the curve sharpens to a spike. Every major discovery was out of distribution when it first appeared—moving earth, unseen germs, drifting continents—each filed as error by the consensus of its day. A model of consensus is, by construction, a machine for telling you the new thing is wrong. The average is now free, infinite, identical, and worth little precisely because everyone holds it. What is priceless is the deviation: the position the model marks as wrong, kept anyway.

Why it matters: Using corrected new words and dissent flattened into consensus as examples, the author examines how LLMs favor common phrasing and squeeze the space for new concepts and minority views.

Read the original ↗Export Markdown