Notes on Cambridge Maths

Something looks off?

The button will add this page to my log of things to fix. Use it for broken links, equations not rendering correctly, etc.
Submit other issues on GitHub.

Entropy Chain Rule

Let be Random Variables
Then the Joint Entropy
is the sum of Mathematical Entropy
and Conditional Entropy for :

Note that there are ways to expand.

Proof

Suppose and are Random Variables
Then expand:

Generalization follows from this.

Something looks off?

The button will add this page to my log of things to fix. Use it for broken links, equations not rendering correctly, etc.
Submit other issues on GitHub.

Graph View

Backlinks