A Mathematical Theory of Communication
Source: https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf ↗
Full text: author page ↗
Shannon's 1948 paper is the founding document of information theory and one of the most consequential scientific publications of the twentieth century.
It demonstrated that information could be quantified in bits, measured independently of meaning, and transmitted reliably over noisy channels through proper encoding.
The paper drew on thermodynamics, probability theory, and Boolean algebra to establish a rigorous mathematical framework for communication systems.
Its implications reached far beyond telephony: Shannon's entropy became central to cryptography, linguistics, genetics, and eventually computer science itself.
The work is remarkable for its clarity and completeness — the entire field emerged essentially whole from a single paper.
Central argument
Shannon argues that communication can be fully formalized as a mathematical problem divorced from meaning: the fundamental challenge is not what a message says but that any message is one selection from a set of possible messages, and the system must handle all possibilities. He introduces entropy as a logarithmic measure of information — quantifying uncertainty in a source — and defines channel capacity as the maximum rate at which information can be reliably transmitted. The central finding is that there exists a theoretical ceiling on how much information any channel can carry, determined by bandwidth and noise, and that efficient encoding can approach but not exceed this limit.
Critique
Shannon explicitly brackets meaning — 'the semantic aspects of communication are irrelevant to the engineering problem' — which is a deliberate and productive abstraction for transmission engineering but becomes a serious blind spot when the theory is applied beyond its original scope. When practitioners or researchers import information-theoretic concepts into human communication, cognition, or organizational design, this semantic exclusion quietly smuggles in the assumption that what matters is signal fidelity rather than interpretation, context, or intent. A thoughtful reader should ask whether a theory of communication that structurally ignores what messages mean can generalize to any domain where meaning is precisely what is at stake.
Why it matters for product
Shannon's channel capacity model offers product leaders a rigorous analogy for diagnosing communication bottlenecks inside their organizations: every review process, decision meeting, or documentation system has a finite throughput, and adding more messages without reducing noise — ambiguity, misaligned context, competing priorities — does not increase the information actually received. His point that a system must be designed for the entire set of possible inputs, not just the expected ones, directly challenges the common product trap of optimizing the happy path while ignoring edge states that stress architecture, support, and trust. More subtly, his logarithmic measure of information — where each additional bit doubles the decision space — gives a concrete intuition for why product complexity compounds non-linearly and why reducing optionality at key decision points has disproportionate organizational leverage.