Asymptotic Information rate

Proposition

Let Then

Proof

First we prove 1. implies 2. Gilbert-Shannon-Varshamov Bound so

So

Now we prove 1.