Let be Random Variables. We define their entropy rate as:

whenever the limit exists ( is Mathematical Entropy).