Data Processing Property of the Entropy

Let be a Random Variable For any function on the alphabet of :

Additionally:

with equality if and only if is injective.

Proof

Also by the Entropy Chain Rule:

with equality if and only if

i.e. is invertible.