Information theory bookmarks

Web links

• Entropy and Information Theory by R.M. Gray

  Downloadable PDF book. First edition from 1991, published by Springer Verlag. Mathematical treatment of information theory.

• Information Theory, Inference, and Learning Algorithms by David MacKay

  Downloadable/online viewable book.

• A Mathematical Theory of Communication by C. E. Shannon

  The original paper.

• Course on Information Theory, Pattern Recognition, and Neural Networks

  Video version of the above-mentioned book by the late David MacKay.