Let be a Random Variable taking values in a discrete set following a distribution The information content of is itself a Random Variable: where is Random Probability of Random Variable. Note that improbable events have high information content.