Introduction to Information Theory

Outline

 * Information Measures
 * Source coding
 * Channel capacity
 * Channel coding
 * Differential entropy
 * Rate-Distortion Theory

Pre-requisites

 * Linear Algebra
 * Probability

Textbooks

 * 1) Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, John Wiley & Sons, 2006.
 * 2) Raymond W. Yeung, Information Theory and Network Coding, Springer, August 2008

With video lectures

 * 1) Information Theory, Raymond W. Yeung, The Chinese University of Hong Kong, 2014.
 * 2) Information Theory and Coding, Prof. S.N. Merchant, IIT Bombay, 2011.

Without video lectures

 * 1) Information Theory, Srikrishna Bhashyam, IIT Madras, Jan-Apr 2013.
 * 2) Information Theory, Andrew Thangaraj, IIT Madras, Jan-Apr 2005.
 * 3) Information Theory, Navin Kashyap, IISc Bangalore, August-December 2013.
 * 4) Information Theory and Source Coding, Dr. M. R. Soleymani, Concordia University, Summer 2013.
 * 5) Information theory in computer science, Mark Braverman, Princeton University, Fall 2011.
 * 6) Information and Entropy, Prof. Paul Penfield and Prof. Seth Lloyd, MIT, Spring 2008
 * 7) Information Theory, Todd Moon, Spring 2006.
 * 8) Information Theory, Patric Östergård, Aalto University, Autumn 2013. (Earlier version: ).
 * 9) Information Theory and its applications in theory of computation, Venkatesan Guruswami, Carnegie Mellon University, Spring 2013.
 * 10) Information Theory, Thomas Cover, Stanford University, Winter 10-11.
 * 11) Information Theory, Henry D. Pfister, Texas A&M University, 2011.
 * 12) Information Theory, Mai Vu, Tufts University, Fall 2007.
 * 13) Random Codes in Communication, Haim Permuter, Ben-Gurion University, Spring 2011.
 * 14) Probability in Computer Science, Dr. Jan Bouda, Masaryk University, Summer 2012.
 * 15) Courses on Information Theory and Coding, Aslan Tchamkerten, Telecom ParisTech.
 * 16) Information Theory, J. Rockey Luo, Colorado State University, Fall 2014.
 * 17) Information Theory, Himanshu Tyagi, IISc Bangalore, August-December 2016.