Background on information theory

This section assumes that the reader has some familiarity with some basic probability.