Notes on Cambridge Maths

Something looks off?

The button will add this page to my log of things to fix. Use it for broken links, equations not rendering correctly, etc.
Submit other issues on GitHub.

Fano's Inequality

Let and be Random Variables taking values in ,
Let
Then

The interpretation we might have is that is the probability of making an error
when trying to guess using a random variable .

Proof

Let

and
By Conditional Entropy

Now:

since choices for remain.
So:

Something looks off?

The button will add this page to my log of things to fix. Use it for broken links, equations not rendering correctly, etc.
Submit other issues on GitHub.

Graph View

Backlinks