Diagonal quasi-newton updating strategy with cholesky factor via variational principle
The quasi-Newton method was popular due to the fact that only the gradient of the objective is required at each iterate and, since the second derivatives (Hessian) were not necessary, the quasi-Newton approach is often more efficient than the Newton method, especially when Hessian computation is cos...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
Malaysian Mathematical Society
2022
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/100946/ |
| _version_ | 1848863454109106176 |
|---|---|
| author | Bukar, Tijjani Wah, June Leong Marjugi, Mahani Chuei, Yee Chen Hong, Seng Sim |
| author_facet | Bukar, Tijjani Wah, June Leong Marjugi, Mahani Chuei, Yee Chen Hong, Seng Sim |
| author_sort | Bukar, Tijjani |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | The quasi-Newton method was popular due to the fact that only the gradient of the objective is required at each iterate and, since the second derivatives (Hessian) were not necessary, the quasi-Newton approach is often more efficient than the Newton method, especially when Hessian computation is costly. However, the method needed full matrix storage that approximated the (inverse) Hessian. As a result, they might not be appropriate for dealing with large-scale problems. In this paper, a diagonal quasi-Newton updating strategy is presented. The elements of the diagonal matrix approximating the Hessian were determined using the log-determinant norm satisfying weaker secant equation. To ensure the positive definiteness of the proposed diagonal updating matrices, their Cholesky factor will be considered within the variational problem. The corresponding variational problems are solved with the application of Lagrange multipliers approximated using Newton-Raphson method. Executable codes were developed to test the effectiveness and efficiency of the methods compared with some standard conjugate-gradient methods. Numerical results show that the proposed methods performs better. |
| first_indexed | 2025-11-15T13:33:10Z |
| format | Article |
| id | upm-100946 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-15T13:33:10Z |
| publishDate | 2022 |
| publisher | Malaysian Mathematical Society |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-1009462023-07-13T08:46:41Z http://psasir.upm.edu.my/id/eprint/100946/ Diagonal quasi-newton updating strategy with cholesky factor via variational principle Bukar, Tijjani Wah, June Leong Marjugi, Mahani Chuei, Yee Chen Hong, Seng Sim The quasi-Newton method was popular due to the fact that only the gradient of the objective is required at each iterate and, since the second derivatives (Hessian) were not necessary, the quasi-Newton approach is often more efficient than the Newton method, especially when Hessian computation is costly. However, the method needed full matrix storage that approximated the (inverse) Hessian. As a result, they might not be appropriate for dealing with large-scale problems. In this paper, a diagonal quasi-Newton updating strategy is presented. The elements of the diagonal matrix approximating the Hessian were determined using the log-determinant norm satisfying weaker secant equation. To ensure the positive definiteness of the proposed diagonal updating matrices, their Cholesky factor will be considered within the variational problem. The corresponding variational problems are solved with the application of Lagrange multipliers approximated using Newton-Raphson method. Executable codes were developed to test the effectiveness and efficiency of the methods compared with some standard conjugate-gradient methods. Numerical results show that the proposed methods performs better. Malaysian Mathematical Society 2022-07-29 Article PeerReviewed Bukar, Tijjani and Wah, June Leong and Marjugi, Mahani and Chuei, Yee Chen and Hong, Seng Sim (2022) Diagonal quasi-newton updating strategy with cholesky factor via variational principle. Menemui Matematik (Discovering Mathematics), 44 (1). 14 - 22. ISSN 0126-9003 https://myjms.mohe.gov.my/index.php/dismath/article/view/18941 |
| spellingShingle | Bukar, Tijjani Wah, June Leong Marjugi, Mahani Chuei, Yee Chen Hong, Seng Sim Diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| title | Diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| title_full | Diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| title_fullStr | Diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| title_full_unstemmed | Diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| title_short | Diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| title_sort | diagonal quasi-newton updating strategy with cholesky factor via variational principle |
| url | http://psasir.upm.edu.my/id/eprint/100946/ http://psasir.upm.edu.my/id/eprint/100946/ |