Let be Random Variables.
We define their entropy rate as:

whenever the limit exists ( is Mathematical Entropy).