1948 · trunk question
What is information?
The cuts
Claude Shannon 1948
Information is the reduction of uncertainty — measurable in bits, and deliberately silent about meaning.
Made information an engineering quantity. Everything digital, including LLMs, is built on this renunciation.
A Mathematical Theory of Communication1948The tensions
Shannon’s 1948 cut was an act of deliberate renunciation: define information as reduction of uncertainty and refuse to say anything about meaning. The refusal is what made the theory universal — the same mathematics carries telegraph clicks, DNA, and model weights.
It also left a question waiting ever since: where does the meaning come back in? LLMs make it urgent. They are built entirely from Shannon’s information, yet appear to traffic in the very thing he set aside.
