Modification of scaled steepest descent method for solving unconstrained optimization problems

The steepest descent (SD) method is a well-known optimization method for solving unconstrained optimization problems. The conceptual computation of SD method is straightforward and regarded as a fundamental approach in developing optimization theory. The SD method has low computational cost and matr...

Full description

Bibliographic Details
Main Author: Rashidah Johari (Author)
Corporate Author: Universiti Sultan Zainal Abidin . Faculty of Informatics and Computing
Format: Thesis Book
Language:English
Subjects:

MARC

LEADER 00000cam a2200000 7i4500
001 0000093695
005 20200723093000.0
008 170822s2017 my eng
040 |a UniSZA   |e rda 
050 0 0 |a QA402.5   |b .R37 2017 
090 0 0 |a QA402.5   |b .R37 2017 
100 0 |a Rashidah Johari ,   |e author 
245 1 0 |a Modification of scaled steepest descent method for solving unconstrained optimization problems   |c Rashidah binti Johari 
264 0 |c 2017 
300 |a xiv, 91 leaves :   |b illustrations ;   |c 30cm. 
336 |a text  |2 rdacontent 
337 |a unmediated  |2 rdamedia 
338 |a volume  |2 rdacarrier 
502 |a Thesis(Degree of Master of Science) - Universiti Sultan Zainal Abidin, 2017 
504 |a Includes bibliographical references 
505 0 |a 1. Introduction of Research -- 2. Literature Review -- 3. Methodology -- 4. Modification of Steepest Descent Method -- 5. Numerical Results and Discussion -- 6. Conclusion and Recommendations 
520 |a The steepest descent (SD) method is a well-known optimization method for solving unconstrained optimization problems. The conceptual computation of SD method is straightforward and regarded as a fundamental approach in developing optimization theory. The SD method has low computational cost and matrix storage requirement considering that it does not need the computation of second derivatives to be solved to compute the search direction. Despite its attractive advantages, the rate of convergence of SD method is quite slow when near the minimum point. This occurs because of the zigzag form of the steps that occur when approaching the minimum point. This is due to the direction of the SD being not well-scaled. Therefore, the focus of this research is to present a new scaled search direction of SD method for unconstrained optimization. This modification uses exact line search and is compared with the classical SD and Zubai'ah-Mustafa-Rivaie-Ismail (ZMRI) methods. The proposed method is developed by applying a new scaling parameter inspired from Andrei's approach into the search direction of ZMRI method. The proposed method is named as RRM denoted by the name of contributors which are Rashidah, Rivaie and Mamat. The efficiency of the proposed method is studied by testing it on 20 standard test functions via Maple 18 subroutine programming. Four different initial points are chosen for each test functions to study the global convergence properties of the proposed method. The initial points are assigned ranging from the point closer to the minimum point to the point furthest away. The efficiency and robustness of the proposed method are examined by plotting the numerical results into graphs of performance profile. It is shown that RRM solves 100% of the entire test problems while ZMRI and SD solve 95% and 71.5% of the test problems, respectively. RRM is the fastest solver for about 83.75% of the test problems, whereas ZMRI and SD are only at 13.75% and 8.75% of the test problems. In terms of CPU time, RRM is still the fastest which solves about 75% of the test problems with the minimum time while ZMRI and SD are only about 17.5% and 10% of the test problems, respectively. Hence, it can be concluded that the proposed method is more efficient and robust than the classical SD and ZMRI methods. 
610 2 0 |a Universiti Sultan Zainal Abidin   |x Dissertations 
610 2 0 |a Universiti Sultan Zainal Abidin   |x Faculty of Informatics and Computing   |v Dissertations 
650 0 |a Mathematical optimization--Data processing 
650 2 |a Computer Science 
655 0 |a Dissertations, Academic 
710 2 |a Universiti Sultan Zainal Abidin .   |b Faculty of Informatics and Computing 
999 |a 1000172005   |b Thesis   |c Close Access   |e Tembila Campus