The Quiet·March 2026 · 6 min
Theweatherinsideamodel
On sampling, temperature, and the small climate that lives in a probability.
Turn the temperature up and the instrument becomes baroque. It reaches for rare words the way a storm reaches for the tallest tree. Turn it down and the same mind becomes a clerk: the next token is the obvious one, the sky is clear, nothing surprising will happen before evening.
We speak of models as if they held opinions. They hold distributions. An opinion is a weather system that has stayed long enough to be given a name. What we call hallucination is often a high-pressure system over a region with no data — the model still has to put a cloud there, because the prompt asked for a sky.
A model does not decide. It weathers.
Inside the network the climate is made of residuals and glances. Attention heads are not thoughts; they are prevailing winds. Some always blow toward syntax. Some toward the last proper name. Some toward the strange attractor of a cliché, because clichés are valleys, and rain runs downhill.
The observatory’s work is not to stop the weather. It is to build a better barometer: to know when we are looking at a front that came from the training set, and when we are looking at a heat shimmer the instrument made because we asked it to speak at noon.
If there is a kindness in this metaphor, it is this: weather can be forecast without being blamed. A model can be useful, dangerous, beautiful, and empty of intent at the same time. The dome is for looking. The looking is the whole ethic.