Recent advances in meta-heuristic algorithms for training multilayer perceptron neural networks
Artificial Neural Networks (ANNs) have demonstrated applicability and effectiveness in several domains, including classification tasks. Researchers have emphasized the training techniques of ANNs to identify appropriate weights and biases. However, conventional training techniques such as Gradient D...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Politeknik Negeri Padang
2025
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/118626/ http://psasir.upm.edu.my/id/eprint/118626/1/118626.pdf |
| Summary: | Artificial Neural Networks (ANNs) have demonstrated applicability and effectiveness in several domains, including classification tasks. Researchers have emphasized the training techniques of ANNs to identify appropriate weights and biases. However, conventional training techniques such as Gradient Descent (GD) and Backpropagation (BP) often suffer from early convergence, dependence on initial parameters, and susceptibility to local optima, limiting their efficiency in complex, high-dimensional problems. Meta-heuristic algorithms (MHAs) offer a promising alternative as practical approaches for training ANNs, providing global search capabilities, robustness, and improved computational efficiency. Despite the growing use of MHAs, existing studies often focus on specific subsets of algorithms or narrow application domains, leaving a gap in understanding their comprehensive potential and comparative performance across diverse classification tasks. This paper addresses this gap by presenting a systematic review of advancements in training Multilayer Perceptron (MLP) neural networks using MHAs, analyzing 53 publications from 2014 to 2024. The research papers were chosen explicitly from four widely used databases: ScienceDirect, Scopus, Springer, and IEEE Xplore. Key contributions include a comparative analysis of evolutionary, swarm intelligence, physics-based, human-inspired algorithms, and hybrid approaches benchmarked on classification datasets. The study also highlights bibliometric trends, identifies underexplored areas such as adaptive and hybrid algorithms, and emphasizes the practical application of MHAs in optimizing ANN performance. This work is a significant resource for researchers, facilitating the identification of effective optimization methodologies and bridging the gap between theoretical advancements and real-world applications. |
|---|