TokenTown: A live, step-by-step isometric city that visualizes Transformer inference in your browser

TokenTown: A visual way to understand how LLMs work

An interactive browser demo that maps a Transformer into an isometric city. Each token is split at the docks, embedded at the foundry, stamped with position, then driven through attention, residual, and feed-forward stages per layer before sampling. The vector bars and softmax beams are genuinely computed live—just scaled down to 12 dims and a few hundred vocab entries. Weights are random, but output is blended with a bigram prior for readability. The first tour pauses at each district to explain; afterward you can speed up, step through, or roam freely.

Why it matters: An interactive visualization that maps transformer inference onto a city, with real vectors and softmax computed live in the browser. Excellent teaching and communication tool for practitioners, but it's an educational project, not a product update or research breakthrough, so...