Been Down So Long it Looks Like Up to Me: A Unified Derivation of Conjugate Gradient and Variable Metric Minimization
Computational Physics
2007-05-23 v1
Abstract
Simple derivations, at a level appropriate for an undergraduate computational physics course, of the most popular methods for finding the minimum of a function of many variables are presented in a unified manner in the context of a general optimization scheme that emphasizes their essential similarities. The derivations in this paper encompass the conjugate gradient methods with and without conditioning, and the variable metric methods. The common variants of these methods including Fletcher-Reeves, Polak-Ribiere, Davidon-Fletcher-Powell, and Broyden-Fletcher-Goldfarb-Shanno are described and motivated.
Keywords
Cite
@article{arxiv.physics/0307119,
title = {Been Down So Long it Looks Like Up to Me: A Unified Derivation of Conjugate Gradient and Variable Metric Minimization},
author = {R. A. Hyman and Bridget Doporcyk and John Tetzlaff},
journal= {arXiv preprint arXiv:physics/0307119},
year = {2007}
}
Comments
11 pages. Submitted to the American Journal of Physics