Suppose is an Ergodic Source on a finite alphabet . Then for any function such that we have

where is the shift operator .

Corollary

Strong Law of Large Numbers