Beta-smooth

A funciton is said to be if .

All eigenvalues of are

Theorem:

Let be . Then

Proof:

Apply Taylor and .

Corollary:

Remark

so we always make progress while making a step - but not necessarily fast enough.

Proof of Corollary:

Minimise the righthandside of the theorem with respect to by taking the gradient.