Skip Navigation

IMA Journal of Mathematical Control and Information 1986 3(2-3):103-118; doi:10.1093/imamci/3.2-3.103
© 1986 by Institute of Mathematics and its Applications
This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by BYRNES, C. I.
Right arrow Articles by WILLEMS, J. C.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Least-Squares Estimation, Linear Programming, and Momentum: A Geometric Parametrization of Local Minima

CHRISTOPHER I. BYRNES and JAN C. WILLEMS

Department of Mathematics and Department of Electrical and Computer Engineering, Arizona State University Tempe, Arizona 85287 U.S.A.
Mathematics Institute, University of Groningen P.O. Box 800, 9700 Groningen AV, The Netherlands

In contrast to estimation by ordinary least squares, estimation by total least squares has much less favourable properties as far as existence and uniqueness of local minima is concerned. Indeed, as elementary examples show, and contrary to intuition gleaned from the Gauss-Markov theorem for ordinary least squares, for certain data sets this problem can have nonisolated local minima and local maxima. Using Morse theory and the Lie theory of coadjoint orbits, we show that, despite this apparent degeneracy, the distribution of critical points of least-squares problems is remarkably well behaved. For arbitrary data, the least-squares function is perfect in the sense of the Morse-Bott theory. In particular, the set of local minima always forms a connected manifold while there exists a unique minimum value.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?




Disclaimer: Please note that abstracts for content published before 1996 were created through digital scanning and may therefore not exactly replicate the text of the original print issues. All efforts have been made to ensure accuracy, but the Publisher will not be held responsible for any remaining inaccuracies. If you require any further clarification, please contact our Customer Services Department.