A new stepsize for gradient method via weak secant equation
In this work we present a new technique for stepsize selection in the frame of gradient method. This new stepsize selection technique provides a different stepsize for every component of the negative gradient search. The algorithm then selects the stepsizes along the negative gradient using a new...
| Main Author: | |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
2007
|
| Subjects: | |
| Online Access: | http://psasir.upm.edu.my/id/eprint/8781/ |
| _version_ | 1848840965944508416 |
|---|---|
| author | Leong, Wah June |
| author_facet | Leong, Wah June |
| author_sort | Leong, Wah June |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | In this work we present a new technique for stepsize selection in the frame of gradient
method. This new stepsize selection technique provides a different stepsize for every component
of the negative gradient search. The algorithm then selects the stepsizes along
the negative gradient using a new approximation of the Hessian based on the weak secant
equation. The resulting algorithm belongs to the same class of gradient methods with linear
convergence property. Some preliminary numerical results suggest that the algorithm
compares favourably with the Barzilai-Borwein method. |
| first_indexed | 2025-11-15T07:35:44Z |
| format | Conference or Workshop Item |
| id | upm-8781 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-15T07:35:44Z |
| publishDate | 2007 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-87812015-01-21T08:30:32Z http://psasir.upm.edu.my/id/eprint/8781/ A new stepsize for gradient method via weak secant equation Leong, Wah June In this work we present a new technique for stepsize selection in the frame of gradient method. This new stepsize selection technique provides a different stepsize for every component of the negative gradient search. The algorithm then selects the stepsizes along the negative gradient using a new approximation of the Hessian based on the weak secant equation. The resulting algorithm belongs to the same class of gradient methods with linear convergence property. Some preliminary numerical results suggest that the algorithm compares favourably with the Barzilai-Borwein method. 2007-12-12 Conference or Workshop Item NonPeerReviewed Leong, Wah June (2007) A new stepsize for gradient method via weak secant equation. In: The 7th International Conference on Optimization : Techniques and Applications (ICOTA7), 12-15 Dec. 2007, Kobe, Japan. . (Unpublished) Convergence Equations |
| spellingShingle | Convergence Equations Leong, Wah June A new stepsize for gradient method via weak secant equation |
| title | A new stepsize for gradient method via weak secant
equation |
| title_full | A new stepsize for gradient method via weak secant
equation |
| title_fullStr | A new stepsize for gradient method via weak secant
equation |
| title_full_unstemmed | A new stepsize for gradient method via weak secant
equation |
| title_short | A new stepsize for gradient method via weak secant
equation |
| title_sort | new stepsize for gradient method via weak secant
equation |
| topic | Convergence Equations |
| url | http://psasir.upm.edu.my/id/eprint/8781/ |