A Source is stationary if for each ,
the distribution of is the same for all .

Theorem

If is a stationary source on a finite alphabet ,
then the Entropy Rate exists and is equal to

Moreover, we can express this as