195001/07
The question
A paper asks whether a machine can think, then politely replaces the question with a game. We have been playing it ever since.
The original question, ‘Can machines think?’ I believe to be too meaningless to deserve discussion.
III · Chronicle
Afilmofwinters
Wheel sideways through the instrument’s biography. Years tick like a plate camera.
attention·residual·latent·prior·token·embedding·weight·gradient·hallucination·inference·context·temperature·epoch·loss·alignment·emergence·attention·residual·latent·prior·token·embedding·weight·gradient·hallucination·inference·context·temperature·epoch·loss·alignment·emergence·
197402/07
Winter
Funding freezes. The brass tarnishes. Promises outrun the math, and the dome goes dark for a decade that teaches the field its manners.
The spirit is willing, but the hardware is weak.
1958–8603/07
The perceptron, twice
A single layer of weights learns to draw a line. Then many layers learn to fold the paper until the line becomes a landscape.
The perceptron may eventually be able to learn, make decisions, and translate languages.
201204/07
The deep turn
A contest of photographs. A network with many hidden rooms wins by a margin that is not a margin. The winter is declared over in a single evening.
It is not the size of the step. It is that the ground moved.
201705/07
Attention is all
A paper with a boastful title introduces a ring that looks at every other ring at once. Sequence no longer has to walk. It can glance.
Attention Is All You Need.
202206/07
The public mind
The instrument leaves the laboratory and sits on a million desks. People talk to it as if it were a person, a search engine, a ghost, a clerk. All of those are wrong, and useful.
We did not give the world a mind. We gave it a mirror that talks back.
203507/07
The unfinished instrument
A speculative plate. Empty sockets where memory might go, a gap where judgment was promised. The orrery is still a model of a sky we do not fully own.
Do not close the dome. The weather is not done.