Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization
Memoryless quasi-Newton method is exactly the quasi-Newton method for which the approximation to the inverse of Hessian, at each step, is updated from a positive multiple of identity matrix. Hence, its search direction can be computed without the storage of matrices, namely O(n2) storages. in this p...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Yokohama Publishers
2011
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/25071/ http://psasir.upm.edu.my/id/eprint/25071/1/Positive.pdf |
| _version_ | 1848845209441402880 |
|---|---|
| author | Leong, Wah June Abu Hassan, Malik |
| author_facet | Leong, Wah June Abu Hassan, Malik |
| author_sort | Leong, Wah June |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Memoryless quasi-Newton method is exactly the quasi-Newton method for which the approximation to the inverse of Hessian, at each step, is updated from a positive multiple of identity matrix. Hence, its search direction can be computed without the storage of matrices, namely O(n2) storages. in this paper, a memoryless symmetric rank one (SR1) method for solving large-scale unconstrained optimization problems is presented. The basic idea is to incorporate the SR1 update within the framework of the memoryless quasi-method. However, it is well-known that the SR1 update may not preserve positive definiteness even when updated from the positive definite matrix. Therefore, we propose that the memoryless SR1 method is updated from the positive scaled of the identity, in which the scaling factor is derived in such a way to preserve the positive definiteness and improves the condition the scale memoryless SR1 update. Under some standard conditions it is shown that the method is globally and R-linearly convergent. Numerical results show that the memoryless SR1 method is very encouraging. |
| first_indexed | 2025-11-15T08:43:11Z |
| format | Article |
| id | upm-25071 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T08:43:11Z |
| publishDate | 2011 |
| publisher | Yokohama Publishers |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-250712018-10-19T01:01:10Z http://psasir.upm.edu.my/id/eprint/25071/ Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization Leong, Wah June Abu Hassan, Malik Memoryless quasi-Newton method is exactly the quasi-Newton method for which the approximation to the inverse of Hessian, at each step, is updated from a positive multiple of identity matrix. Hence, its search direction can be computed without the storage of matrices, namely O(n2) storages. in this paper, a memoryless symmetric rank one (SR1) method for solving large-scale unconstrained optimization problems is presented. The basic idea is to incorporate the SR1 update within the framework of the memoryless quasi-method. However, it is well-known that the SR1 update may not preserve positive definiteness even when updated from the positive definite matrix. Therefore, we propose that the memoryless SR1 method is updated from the positive scaled of the identity, in which the scaling factor is derived in such a way to preserve the positive definiteness and improves the condition the scale memoryless SR1 update. Under some standard conditions it is shown that the method is globally and R-linearly convergent. Numerical results show that the memoryless SR1 method is very encouraging. Yokohama Publishers 2011 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/25071/1/Positive.pdf Leong, Wah June and Abu Hassan, Malik (2011) Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization. Pacific Journal of Optimization, 7 (1). pp. 29-41. ISSN 1348-9151; ESSN: 1349-8169 http://www.ybook.co.jp/online2/oppjo/vol7/p29.html |
| spellingShingle | Leong, Wah June Abu Hassan, Malik Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| title | Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| title_full | Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| title_fullStr | Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| title_full_unstemmed | Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| title_short | Positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| title_sort | positive-definite memoryless symmetric rank one method for large-scale unconstrained optimization |
| url | http://psasir.upm.edu.my/id/eprint/25071/ http://psasir.upm.edu.my/id/eprint/25071/ http://psasir.upm.edu.my/id/eprint/25071/1/Positive.pdf |