Information theory

• An example where the Kullback-Leibler divergence breaks the triangle inequality (20 September 2014)
• Demonstrating the log inequalities with Octave (17 January 2014)
• Entropy of discrete probabilities in Perl (27 March 2013)
• Information theory bookmarks (20 March 2013)
• Calculating the (7, 4) Hamming code (17 February 2013)
• Extract Dilbert image from MacKay file (14 February 2013)