Asymptotic Information rate

Proposition

Let
Then

Proof

First we prove 1. implies 2.
Gilbert-Shannon-Varshamov Bound so

So

Now we prove 1.