Exact Line Search

Iterative Methods for Linear Algebraic Systems Solving

is equivalent to minimizing:

because

Search direction

Given some search direction we want to find

such that is minimal. The optimal is such that minimizes -distance to i.e.

Thus we find:

where Exact Line Search with Steepest Descent Conjugate Gradient Search