Structured symmetric rank-one method for unconstrained optimization
In this paper, we investigate a symmetric rank-one (SR1) quasi-Newton (QN) formula in which the Hessian of the objective function has some special structure. Instead of approximating the whole Hessian via the SR1 formula, we consider an approach which only approximates part of the Hessian matrix tha...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis
2011
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/25072/ http://psasir.upm.edu.my/id/eprint/25072/1/Structured%20symmetric%20rank.pdf |
| _version_ | 1848845209689915392 |
|---|---|
| author | Modarres, Farzin Abu Hassan, Malik Leong, Wah June |
| author_facet | Modarres, Farzin Abu Hassan, Malik Leong, Wah June |
| author_sort | Modarres, Farzin |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | In this paper, we investigate a symmetric rank-one (SR1) quasi-Newton (QN) formula in which the Hessian of the objective function has some special structure. Instead of approximating the whole Hessian via the SR1 formula, we consider an approach which only approximates part of the Hessian matrix that is not easily acquired. Although the SR1 update possesses desirable features, it is unstable in the sense that, it may not retain positive definiteness and may become undefined. Therefore, we describe some safeguards to overcome these difficulties. Since the structured SR1 method provides a more accurate Hessian approximation, therefore the proposed method reduces significantly the computational efforts needed in solving a problem. The results of a series of experiments on a typical set of standard unconstrained optimization problems are reported, which show that the structured SR1 method exhibits a clear improvement in numerical performance over some existing QN algorithms. |
| first_indexed | 2025-11-15T08:43:11Z |
| format | Article |
| id | upm-25072 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T08:43:11Z |
| publishDate | 2011 |
| publisher | Taylor & Francis |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-250722017-08-16T09:37:54Z http://psasir.upm.edu.my/id/eprint/25072/ Structured symmetric rank-one method for unconstrained optimization Modarres, Farzin Abu Hassan, Malik Leong, Wah June In this paper, we investigate a symmetric rank-one (SR1) quasi-Newton (QN) formula in which the Hessian of the objective function has some special structure. Instead of approximating the whole Hessian via the SR1 formula, we consider an approach which only approximates part of the Hessian matrix that is not easily acquired. Although the SR1 update possesses desirable features, it is unstable in the sense that, it may not retain positive definiteness and may become undefined. Therefore, we describe some safeguards to overcome these difficulties. Since the structured SR1 method provides a more accurate Hessian approximation, therefore the proposed method reduces significantly the computational efforts needed in solving a problem. The results of a series of experiments on a typical set of standard unconstrained optimization problems are reported, which show that the structured SR1 method exhibits a clear improvement in numerical performance over some existing QN algorithms. Taylor & Francis 2011 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/25072/1/Structured%20symmetric%20rank.pdf Modarres, Farzin and Abu Hassan, Malik and Leong, Wah June (2011) Structured symmetric rank-one method for unconstrained optimization. International Journal of Computer Mathematics, 88 (12). pp. 2608-2617. ISSN 0020-7160; ESSN: 1029-0265 http://www.tandfonline.com/doi/abs/10.1080/00207160.2011.553220 10.1080/00207160.2011.553220 |
| spellingShingle | Modarres, Farzin Abu Hassan, Malik Leong, Wah June Structured symmetric rank-one method for unconstrained optimization |
| title | Structured symmetric rank-one method for unconstrained optimization |
| title_full | Structured symmetric rank-one method for unconstrained optimization |
| title_fullStr | Structured symmetric rank-one method for unconstrained optimization |
| title_full_unstemmed | Structured symmetric rank-one method for unconstrained optimization |
| title_short | Structured symmetric rank-one method for unconstrained optimization |
| title_sort | structured symmetric rank-one method for unconstrained optimization |
| url | http://psasir.upm.edu.my/id/eprint/25072/ http://psasir.upm.edu.my/id/eprint/25072/ http://psasir.upm.edu.my/id/eprint/25072/ http://psasir.upm.edu.my/id/eprint/25072/1/Structured%20symmetric%20rank.pdf |