Shannon-Weaver information theory

Information theory, pioneered by Claude Shannon, provides a mathematical framework for understanding communication. It focuses on the technical aspects of transmitting signals, abstracting away from the meaning of the message itself. Shannon's model breaks down communication into key components: a source that creates a message, an encoder that converts the message into signals, a channel through which signals travel, noise that interferes with signals, a decoder that converts signals back, and a receiver that gets the message.123

The theory also addresses concepts like entropy, which represents noise or disorder that can distort a message, and negative entropy and redundancy, which help to preserve or clarify the message. Information theory has applications in various fields, including physics, where it relates to thermodynamics and concepts like Maxwell's demon.45