Notes on Cambridge Maths

Something looks off?

The button will add this page to my log of things to fix. Use it for broken links, equations not rendering correctly, etc.
Submit other issues on GitHub.

Submodularity for Sums inequality

Let be Independent Random Variables in .
Then

Proof

Data Processing Property of the Mutual Information:

Corollary

Let and be iid.
Then:

Proof

Let be Independent from and .
Then

Also we have so the inequality follows.

Something looks off?

The button will add this page to my log of things to fix. Use it for broken links, equations not rendering correctly, etc.
Submit other issues on GitHub.

Graph View

Backlinks