Modification of Polak-Ribiere-Polyak (PRP) conjugate gradient coefficient for unconstrained optimization problems

Conjugate gradient (CG) method is an important class of methods for solving unconstrained optimization problems, especially when the dimensions are large. This thesis presents three modifications of Polak-Ribiere-Polyak (PRP) conjugate gradient methods for solving this type of problems, where the mo...

Full description

Bibliographic Details
Main Author: Mohamed Ahmed Hamoda (Author)
Corporate Author: Universiti Sultan Zainal Abidin . Faculty of Informatics and Computing
Format: Thesis Book
Language:English
Subjects:

MARC

LEADER 00000cam a2200000 7i4500
001 0000093700
005 20200723093000.0
008 170827s2016 my eng
040 |a UniSZA   |e rda 
050 0 0 |a QA297   |b .M64 2016 
090 0 0 |a QA297   |b .M64 2016 
100 0 |a Mohamed Ahmed Hamoda ,   |e author 
245 1 0 |a Modification of Polak-Ribiere-Polyak (PRP) conjugate gradient coefficient for unconstrained optimization problems   |c Mohamed Ahmed Hamoda 
264 0 |c 2016 
300 |a xviii, 297 leaves :   |b illustrations ;   |c 30cm. 
336 |a text  |2 rdacontent 
337 |a unmediated  |2 rdamedia 
338 |a volume  |2 rdacarrier 
502 |a Thesis (Degree of Doctor of Philosophy) - Universiti Sultan Zainal Abidin, 2016 
504 |a Includes bibliographical references 
505 0 |a 1. Introduction and Literature Review -- 2. The Elementary Concept of Optimization -- 3. Conjugate Gradient Methods -- 4. New Modifications Method -- 5. Numerical Results and Discussion -- 6. Conclusion 
520 |a Conjugate gradient (CG) method is an important class of methods for solving unconstrained optimization problems, especially when the dimensions are large. This thesis presents three modifications of Polak-Ribiere-Polyak (PRP) conjugate gradient methods for solving this type of problems, where the modifications named as HRMl, HRM2, and HRM3. The modifications are iterative methods that modify the PRP method by using exact and inexact line search techniques, wherein inexact employing strong Wolfe-Powell line search._ Theoretical proof has shown that these three modifications possess a guaranteed global convergence on general non-convex objective functions. They are also in line with the angle condition, suggesting that these coefficients always converge faster than steepest descent methods. All of these new Ih (HRMl, HRM2, and HRM3) are tested based on thirty-four standard optimization functions using MATLAB R2014a (8.3.0.532) subroutine programming. Based on the numerical results, a comparative analysis is conducted assessing the new methods against other CG methods, which included the FR, PRP, MPRP, DPRP, WYL, and AMRl. The chosen test functions consist of small and large-scale problems. For every problem, four different arbitrary initial points x E R" are used, based on the one that is nearest to the solution point. The numerical results based on the number of iterations and CPU times are analyzed using the performance profile developed by Dolan and More. Numerical results show that the new methods are efficient, robust, and outperforms the FR, PRP, NPRP, MPRP, DPRP, WYL and AMRl methods. While achieving superior performance, the new methods still retain its simplicity, possess sufficient descent condition and global convergence properties. It is also shown that the numerical results are in line with the theoretical proof. 
610 2 0 |a Universiti Sultan Zainal Abidin   |x Dissertations 
610 2 0 |a Universiti Sultan Zainal Abidin   |x Faculty of Informatics and Computing   |v Dissertations 
650 0 |a MATLAB 
650 0 |a Numerical analysis--Data processing 
655 0 |a Dissertations, Academic 
710 2 |a Universiti Sultan Zainal Abidin .   |b Faculty of Informatics and Computing 
999 |a 1000172004   |b Thesis   |c Close Access   |e Tembila Campus