Information Theory

(Formerly EE 376A.) Information theory was invented as a mathematical theory for communication but has subsequently found a broad range of applications. We study how to measure, represent, and communicate information effectively: from the foundational concepts of entropy and mutual information to the fundamental role they play in data representation, communication, inference, practical compression and error correction. As time allows, we cover relations and applications to other areas such as probability, statistics, learning and genomics.