Stochastic diagonal approximate greatest descent in neural networks

QR Code

Stochastic diagonal approximate greatest descent in neural networks

© 2017 IEEE. Optimization is important in neural networks to iteratively update weights for pattern classification. Existing optimization techniques suffer from suboptimal local minima and slow convergence rate. In this paper, stochastic diagonal Approximate Greatest Descent (SDAGD) algorithm is pro...

Full description

Bibliographic Details
Main Authors:	Tan, H., Lim, Hann, Harno, H.
Format:	Conference Paper
Published:	2017
Online Access:	http://hdl.handle.net/20.500.11937/57712

Similar Items

Stochastic diagonal approximate greatest descent in convolutional neural networks
by: Tan, H., et al.
Published: (2017)

Radial effect in stochastic diagonal approximate greatest descent
by: Tan, H., et al.
Published: (2017)

Adaptive Second-order Derivative Approximate Greatest Descent Optimization for Deep Learning Neural Networks
by: Tan, Hong Hui
Published: (2019)

Stochastic mirror descent method for distributed multi-agent optimization
by: Li, J., et al.
Published: (2016)

On regularity of diagonally positive quadratic doubly stochastic operators
by: Saburov, Mansoor
Published: (2017)

Mental Stress Classification Among Higher Education Students In Malaysia From Electroencephalogram (Eeg) Using Convolutional Neural Network With Modified Stochastic Gradient Descent.
by: Rashid, Nur Ramizah Ramino
Published: (2024)

The greatest good for the greatest number of people: an Islamic philosophical analysis
by: Jalil, Md. Abdul, et al.
Published: (2013)

The greatest good for the greatest number of people: an Islamic philosophical analysis
by: Md Abdul Jalil,, et al.
Published: (2014)

An improvement of stochastic gradient descent approach for mean-variance portfolio optimization problem
by: S. W. Su, Stephanie, et al.
Published: (2021)

A new Newtons method with diagonal Jacobian approximation for systems of nonlinear equations
by: Yusuf, Mohammed Waziri, et al.
Published: (2010)

Diagonal hessian approximation for limited memory quasi-newton via variational principle
by: Marjugi, Siti Mahani, et al.
Published: (2013)

The greatest love: tales of mothers
Published: (2015)

Spine tuberculosis:The greatest mimicker
by: Subramaniam, Kishan Rao, et al.
Published: (2018)

Now Playing The Greatest Swing
by: Parfitt, Mark
Published: (2013)

The next greatest engineering challenge
by: Abd Razak, Dzulkifli
Published: (2008)

A modified Shamanskii accelerated scheme via diagonal Jacobian approximation for nonlinear equations

A Mini-Batch Proximal Stochastic Recursive Gradient Algorithm with Diagonal Barzilai–Borwein Stepsize
by: Yu, T.T., et al.
Published: (2022)

An Improved Wavelet Neural Network For Classification And Function Approximation
by: Ong , Pauline
Published: (2011)

Instability and stability of solutions of systems of nonlinear stochastic difference equations with diagonal noise
by: Dokuchaev, Nikolai, et al.
Published: (2013)

On strong causal binomial approximation for stochastic processes
by: Dokuchaev, Nikolai
Published: (2014)

A new independent component analysis algorithm: Joint approximate diagonalization of simplified cumulant matrices
by: Liu, Xianhua, et al.
Published: (2005)

Improved stochastic gradient descent algorithm with mean-gradient adaptive stepsize for solving large-scale optimization problems
by: Zulkifli, Munierah, et al.
Published: (2023)

Performance of stochastic Runge-Kutta Methods in approximating the solution of stochastic model in biological system
by: Noor Amalina Nisa, Ariffin, et al.
Published: (2017)

Discrete-time nonlinear stochastic optimal control problem based on stochastic approximation approach
by: Kek, Sie Long, et al.
Published: (2018)

Entrepreneurship education: Inspiration from the greatest entrepreneur

Application of kohonen neural network and rough approximation for overlapping clusters optimization
by: Mohebi, E., et al.
Published: (2008)

Identification of hammerstain model using stochastic perturbation simultaneous approximation
by: Nurriyah, Mohd Noor
Published: (2016)

An approximation of a multivariative stochastic model for the analysis of longitudinal data
by: Abu Bakar, Mohd Rizam, et al.
Published: (2008)

Between the Light and the Night, Descent into Dark
by: Slatter, Nicole
Published: (2014)

The performance of stochastic Taylor methods and derivative-free method to approximate the solutions of stochastic delay differential equations
by: Norhayati, Rosli, et al.
Published: (2019)

Lyapunov theory-based multilayered neural network
by: Lim, Hann, et al.
Published: (2009)

DERBY: WA FOOTY FANS ON THE GAME'S GREATEST RIVALRY
by: Whish-Wilson, David, et al.
Published: (2017)

Derby WA Footy Fans on the Game's Greatest Rivalry
by: Gorman, Sean, et al.
Published: (2017)

Our Greatest Challenge Aboriginal Children and Human Rights
by: McGlade, Hannah
Published: (2012)

Climate change: The greatest equity issue in public health
by: Binns, Colin, et al.
Published: (2011)

Team performance: where learning makes the greatest impact
by: Dayaram, Kandy, et al.
Published: (2012)

Malaysia traffic sign recognition with convolutional neural network
by: Lau, M., et al.
Published: (2015)

Approximate Entropy-Based Epileptic EEG Detection Using Artificial Neural Networks
by: Srinivasan, Vairavan, et al.
Published: (2007)

Complexity approximation of classification task for large dataset ensemble artificial neural networks

Complexity Approximation of Classification Task for Large Dataset Ensemble Artificial Neural Networks