Optimising neural network training efficiency through spectral parameter-based multiple adaptive learning rates

QR Code

Optimising neural network training efficiency through spectral parameter-based multiple adaptive learning rates

The process of training deep neural networks involves heavily solving optimization problems. Finding optimal values for different hyperparameters makes training neural networks challenging. A hyperparameter called learning rate or step size is one of the most crucial factors in optimization using gr...

Full description

Bibliographic Details
Main Author:	Koay, Yeong Lin
Format:	Final Year Project / Dissertation / Thesis
Published:	2023
Subjects:	Q Science (General) QA Mathematics
Online Access:	http://eprints.utar.edu.my/6338/ http://eprints.utar.edu.my/6338/1/4._Revised_Dissertation_Koay_Yeong_Lin.pdf

Similar Items

A Modified Spectral Gradient Method for Solving Non Linear System
by: Koay, Yeong Lin
Published: (2020)

Adaptive regularizer for recursive neural network training algorithms
by: Asirvadam, Vijanth Sagayan
Published: (2008)

Adaptive neural network optimisation control of ICE for vehicle with continuously variable transmission
by: Tawi, Kamarul Baharin, et al.
Published: (2007)

Adaptive Teleoperation System with Neural Network-Based Multiple Model Control
by: Vu, Trieu Minh, et al.
Published: (2010)

Multiple convolutional neural network training for Bangla handwritten numeral recognition
by: Akhand, M. A. H, et al.
Published: (2016)

Energy- and spectral-efficient wireless cellular networks.
by: Salman, Mustafa Ismael, et al.
Published: (2012)

Adapting and enhancing mussels wandering optimization algorithm for supervised training of neural networks
by: Abusnaina, Ahmed A. A.
Published: (2015)

Optimised neural network model for river nitrogen prediction utilizing a new training approach
by: Kumar, Pavitra, et al.
Published: (2020)

Artificial neural network model for prediction of drilling rate of penetration and optimization of parameters
by: Bataee, M., et al.
Published: (2014)

A study of acceleration techniques in training neural networks - local adaptive techniques / Norpah Mahat
by: Mahat, Norpah
Published: (2011)

Optimisation of controller parameters for gridtied photovoltaic system at faulty network using artificial neural network-based cuckoo search algorithm
by: Kalaam, R., et al.
Published: (2017)

Optimization Methods In Training Neural Networks
by: Sathasivam, Saratha
Published: (2003)

Optimizing overbreak prediction based on geological parameters comparing multiple regression analysis and artificial neural network
by: Jang, Hyongdoo, et al.
Published: (2013)

Handover parameters optimisation techniques in 5G networks
by: Saad, Wasan Kadhim, et al.
Published: (2021)

Estimation of Examinees' Ability Through Computer Adaptive Testing Based on Neural Network Approach
by: Kazemi, Azam
Published: (2010)

Optimisation of congestion window for TCP adaptation to LEO satellite networks
by: Abdalla, M. S., et al.
Published: (2004)

Efficient beamforming and spectral efficiency maximization in a joint transmission system using an adaptive particle swarm optimization algorithm
by: Faisal, Ali Raed, et al.
Published: (2016)

Optimisation of light spectral quality to improve plant growth and development
by: Smith, Hayley L.
Published: (2017)

A Spectral Proximal Methodforsparse Optimisation On Underdetermined Linear Systems
by: Woo, Gillian Yi Han
Published: (2022)

Role of length specificity, velocity specificity and neural adaptations in strength training
by: Ismail, Ahmad Naim
Published: (2012)

Analysis and dynamics of multiple-spike waves in neural networks
by: Davis, Joshua
Published: (2018)

Multiple faults detection using artificial neural network
by: Abd. Hamid, Mohd. Kamaruddin
Published: (2004)

Optimisation of neural network with simultaneous feature selection and network prunning using evolutionary algorithm
by: Wong, Wei, et al.
Published: (2016)

Solving optimisation problems using NEUCOMP - a neural network compiler
by: Evans, D. J., et al.
Published: (1996)

Optimising variable sample size X chart through median run length with estimated process parameters
by: Wei, Lin Teoh, et al.
Published: (2025)

Forecasting Exchange Rate Using Neural Networks
by: Raksaseree, Sukhita
Published: (2009)

Effect of multiple deconvolution parameters on the resolvability of decay rates of multiexponential signals
by: Jibia, Abdussamad U., et al.
Published: (2008)

Simultaneous Adaptation Of Multiple Genetic Algorithm Parameters Using Fuzzy Logic Controllers
by: Ghallab, Abdullatif Saleh Nasser
Published: (2010)

Adaptive spectral tracking for coherence estimation: the z-tracker
by: Halliday, David M., et al.
Published: (2018)

An Improvement on Extended Kalman Filter for Neural Network Training
by: Tsan, Ken Yim
Published: (2005)

Magnetoencephalographic dynamics and adaptive brain networks across multiple timescales
by: Mandke, Kanad
Published: (2020)

Air Pollution Index Prediction Using Multiple Neural Networks
by: Ahmad, Zainal, et al.
Published: (2017)

Air pollution index prediction using multiple neural networks
by: Ahmad, Zainal, et al.
Published: (2017)

Multiple responses optimisation in injection moulding parameter for polypropylene-nanoclay-gigantochloa Scortechinii via Taguchi method
by: Khamis, S.Z., et al.
Published: (2019)

Multiple responses optimisation in injection moulding parameter for polypropylene-nanoclay-gigantochloa scortechinii via Taguchi method
by: S. Z., Khamis, et al.
Published: (2019)

Multiple responses optimisation in injection moulding parameter for polypropylene-nanoclay-gigantochloa scortechinii via taguchi method
by: Khamis, S Z, et al.
Published: (2019)

Adaptive unified neural network for dynamic power quality compensation
by: Ghazanfarpour, Behzad, et al.
Published: (2013)

Training feedforward neural networks for fault diagnosis of ball bearing
by: Tuan Abdul Rahman, Tuan Ahmad Zahidi, et al.
Published: (2018)

Training functional link neural network with ant lion optimizer
by: Mohmad Hassim, Yana Mazwin, et al.
Published: (2020)

Improving neural networks training using experiment design approach
by: Chong, Wei Kean
Published: (2005)