Let be Independent Random Variables in . Then

Proof

Data Processing Property of the Mutual Information:

Corollary

Let and be iid. Then:

Proof

Let be Independent from and . Then

Also we have so the inequality follows.