Improved Hessian approximations with modified secant equations for symmetric rank-one method

Symmetric rank-one (SR1) is one of the competitive formulas among the quasi-Newton (QN) methods. In this paper, we propose some modified SR1 updates based on the modified secant equations, which use both gradient and function information. Furthermore, to avoid the loss of positive definiteness and z...

Full description

Bibliographic Details
Main Authors: Modarres, Farzin, Abu Hassan, Malik, Leong, Wah June
Format: Article
Language:English
Published: Elsevier 2011
Online Access:http://psasir.upm.edu.my/id/eprint/24640/
http://psasir.upm.edu.my/id/eprint/24640/1/Improved%20Hessian%20approximations%20with%20modified%20secant%20equations%20for%20symmetric%20rank.pdf
Description
Summary:Symmetric rank-one (SR1) is one of the competitive formulas among the quasi-Newton (QN) methods. In this paper, we propose some modified SR1 updates based on the modified secant equations, which use both gradient and function information. Furthermore, to avoid the loss of positive definiteness and zero denominators of the new SR1 updates, we apply a restart procedure to this update. Three new algorithms are given to improve the Hessian approximation with modified secant equations for the SR1 method. Numerical results show that the proposed algorithms are very encouraging and the advantage of the proposed algorithms over the standard SR1 and BFGS updates is clearly observed.