Entropy learning in neural network

QR Code

Entropy learning in neural network

In this paper, entropy term is used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence entropy approach is proposed to dampen the early creation of such nodes. The entropy...

Full description

Bibliographic Details
Main Authors:	Geok, See Ng, Shi, Daming, Abdul Rahman, Abdul Wahab, Singh, H.
Format:	Article
Language:	English
Published:	ASEAN Committee on Science and Technology 2003
Subjects:	T Technology (General)
Online Access:	http://irep.iium.edu.my/38199/ http://irep.iium.edu.my/38199/1/ENTROPY_LEARNING_IN_NEURAL_NETWORK.pdf

Similar Items

Entropy learning and relevance criteria for neural network pruning
by: Geok, See Ng, et al.
Published: (2003)

Approximate Entropy-Based Epileptic EEG Detection Using Artificial Neural Networks
by: Srinivasan, Vairavan, et al.
Published: (2007)

Feature extraction for neural-fuzzy inference system
by: Quek, Chai, et al.
Published: (2003)

Application of EFUNN for the classification of handwritten digits
by: Geok, See Ng, et al.
Published: (2004)

Single-Ion Entropies, Sion, of Solids; A Route to Standard Entropy Estimation
by: Glasser, Leslie, et al.
Published: (2009)

Generalized Entropy-Based Approach With A Dynamic Threshold To Detect Ddos Attacks On Software Defined Networking Controller
by: Aladaileh, Mohammad Adnan Ahmad
Published: (2021)

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal
by: Namazi, Hamidreza Reza, et al.
Published: (2016)

Study of an entropy-consistent Navier–Stokes flux
by: Mohammed, Akmal Nizam, et al.
Published: (2014)

Keberkesanan pengambangan entropi bersilangan dan entropi tsallis untuk sistem pengecaman balistik forensik automatik
by: Zun, Liang Chuan, et al.
Published: (2013)

Testing intra-daily seasonality using Maximum Entropy Density
by: Chan, F., et al.
Published: (2013)

Classification of EEG-based auditory evoked potentials using entropy-based features and machine learning techniques
by: Islam, Thamina, et al.
Published: (2023)

Fault tolerant hardware for high performance signal processing
by: Erdogan, S. S., et al.
Published: (2008)

Differential evolution for neural networks learning enhancement
by: Ismail Wdaa, Abdul Sttar
Published: (2008)

Web Phishing Classification Model using Artificial Neural Network and Deep Learning Neural Network
by: Noor Hazirah, Hassan, et al.
Published: (2023)

An Entropy-Based Directed Random Walk for Cancer Classification Using Gene Expression Data Based on Bi-Random Walk on Two Separated Networks
by: Xin Hui Tay, Xin Hui Tay, et al.
Published: (2023)

Stock market equity advisory tool by using of neural network method
by: Ng, Shun Yi
Published: (2024)

Entropy in portfolio optimization / Yasaman Izadparast Shirazi
by: Yasaman Izadparast, Shirazi
Published: (2017)

New entropy-based method for gene selection
by: Mahmoodian, Sayed Hamid, et al.
Published: (2009)

An experimental study of the extended NRBF regression model and its enhancement for classification problem
by: Ma, L., et al.
Published: (2008)

The cohesive entropy of condensed materials, empirical relations and restrictions
by: Glasser, Leslie
Published: (2022)

Modelling Body Mass Index Distribution using Maximum Entropy Density
by: Singh, Ranjodh, et al.
Published: (2015)

Textured Renyl Entropy for Image Thresholding
by: Abu Shareha, Ahmad Adel, et al.
Published: (2008)

Thermodynamic entropy as an indicator for urban sustainability?
by: Purvis, Ben, et al.
Published: (2017)

Carrier Synchronization Based on Renyi's Entropy
by: Pedzisz, M., et al.
Published: (2004)

Meta-Learning Evolutionary Artificial Neural Network for Selecting Flexible Manufacturing Systems
Published: (2006)

Development and application of medical decision support systems using artificial neural networks
by: Ng, Wan Chia
Published: (2001)

A Hybrid ACO-Graph Entropy for Functional Modules Detection From Protein-Protein Interaction Network
by: Jamaludin, Sallim, et al.
Published: (2018)

Entropy-Stable Residual Distribution Methods for System of Euler Equations
by: Chizari, Hossain
Published: (2016)

Entropy squeezing for qubit-field system in the presence multi-photon process under decoherence effect
by: Sayed, Abdel-Khalek, et al.
Published: (2015)

Application of artificial neural network on vibration test data for damage identification in bridge girder
by: S. Hakim, S. J., et al.
Published: (2011)

Incremental learning of deep neural network for robust vehicle classification
by: Ahmad Mimi Nathiratul Athriyah,, et al.
Published: (2022)

CRNN: a joint neural network for redundancy detection
by: Fu, Xinyu, et al.
Published: (2017)

Viscous dissipation effect on entropy generation for non-Newtonian fluids in microchannels☆
by: HUNG, Y
Published: (2008)

Viscous dissipation effect on entropy generation for non-Newtonian fluids in microchannels☆
by: HUNG, Y
Published: (2008)

Entropy analysis of magnetized ferroﬂuid over a vertical ﬂat surface with variable heating
by: Hanifa, Hanif, et al.
Published: (2023)

Entropy analysis of magnetized ferroﬂuid over a vertical ﬂat surface with variable heating
by: Hanifa, Hanif, et al.
Published: (2023)

Entropy of stable seasonal rainfall distribution in Kelantan
by: Muhammad Az-Zuhri, Azman, et al.
Published: (2017)

Stream Quantiles via Maximal Entropy Histograms
by: Arandjelovic, O., et al.
Published: (2014)

Automatic signal detection in noise using entropy
by: Erbe, Christine
Published: (2010)

Entropy Drives Calcium Carbonate Ion Association
by: Kellermeier, M., et al.
Published: (2016)