Suppose is an Ergodic Source on a finite alphabet .
Then for any function such that we have

where is the shift operator .

Corollary

Strong Law of Large Numbers