Let and be Random Variables taking values in , Let Then The interpretation we might have is that is the probability of making an error when trying to guess using a random variable . Proof Let and By Conditional Entropy Now: since choices for remain. So: