Showing posts with label Shannon. Show all posts
Showing posts with label Shannon. Show all posts

Tuesday, September 22, 2026

Information Theory


"The fundamental problem of communication is that of reproduction at one point either exactly or approximately a message selected at another point. Frequently the messages have meaning; that is, they refer to or are correlated according to some system with certain physical or conceptual entities. These semantic aspects of communication are irrelevant to the engineering problem. The significant aspect is that the actual message is one selected from a set of possible messages."

- Claude Shannon (1916 - 2001)
A Mathematical Theory of Communication