topic mathematics ★★ seed
Information Theory
The mathematical study of information, communication, and encoding.
Founded by Claude Shannon in 1948, information theory provides a rigorous framework for quantifying, storing, and communicating information. It answers fundamental questions: what is the maximum rate at which data can be transmitted over a noisy channel? How much can data be compressed without loss? The theory introduced entropy as a measure of uncertainty, mutual information as a measure of shared knowledge, and channel capacity as a hard physical limit.
#information-theory
#shannon
#communication
#encoding