Logo image
Cubic regularization in symmetric rank-1 quasi-Newton methods
Journal article   Peer reviewed

Cubic regularization in symmetric rank-1 quasi-Newton methods

Hande Y. Benson and David F. Shanno
Mathematical programming computation, v 10(4), pp 457-486
01 Dec 2018

Abstract

Computer Science Computer Science, Software Engineering Mathematics Mathematics, Applied Operations Research & Management Science Physical Sciences Science & Technology Technology
Quasi-Newton methods based on the symmetric rank-one (SR1) update have been known to be fast and provide better approximations of the true Hessian than popular rank-two approaches, but these properties are guaranteed under certain conditions which frequently do not hold. Additionally, SR1 is plagued by the lack of guarantee of positive definiteness for the Hessian estimate. In this paper, we propose cubic regularization as a remedy to relax the conditions on the proofs of convergence for both speed and accuracy and to provide a positive definite approximation at each step. We show that the n-step convergence property for strictly convex quadratic programs is retained by the proposed approach. Extensive numerical results on unconstrained problems from the CUTEr test set are provided to demonstrate the computational efficiency and robustness of the approach.

Metrics

19 Record Views
10 citations in Scopus

Details

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
Web of Science research areas
Computer Science, Software Engineering
Mathematics, Applied
Operations Research & Management Science
Logo image