Exact Line Search

Iterative Methods for Linear Algebraic Systems
Solving

is equivalent to minimizing:

because

Search direction

Given some search direction we want to find

such that is minimal.
The optimal is such that minimizes -distance to i.e.

Thus we find:

where
Exact Line Search with Steepest Descent
Conjugate Gradient Search