Let be Random Variables Then the Joint Entropy is the sum of Mathematical Entropy and Conditional Entropy for : Note that there are ways to expand. Proof Suppose and are Random Variables Then expand: Generalization follows from this.