Information Content

Let be a Random Variable taking values in a discrete set
following a distribution

The information content of is itself a Random Variable:

where is Random Probability of Random Variable.

Note that improbable events have high information content.