Entropy learning and relevance criteria for neural network pruning
In this paper, entropy is a term used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence an entropy approach is proposed to dampen the early creation of such nodes by using...
| Main Authors: | Geok, See Ng, Abdul Rahman, Abdul Wahab, Shi, Daming |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
World Scientific Publishing Company
2003
|
| Subjects: | |
| Online Access: | http://irep.iium.edu.my/38198/ http://irep.iium.edu.my/38198/1/Entropy_learning_and_relevance_criteria_for_neural_network_pruning.pdf |
Similar Items
Entropy learning in neural network
by: Geok, See Ng, et al.
Published: (2003)
by: Geok, See Ng, et al.
Published: (2003)
Network performance of pruned hierarchical torus network
by: Rahman, M.M. Hafizur, et al.
Published: (2009)
by: Rahman, M.M. Hafizur, et al.
Published: (2009)
Pruned committee neural network based on accuracy and diversity trade-off for permeability prediction
by: Kenari, Seyed Ali Jafari, et al.
Published: (2014)
by: Kenari, Seyed Ali Jafari, et al.
Published: (2014)
Approximate Entropy-Based Epileptic EEG Detection Using Artificial Neural Networks
by: Srinivasan, Vairavan, et al.
Published: (2007)
by: Srinivasan, Vairavan, et al.
Published: (2007)
A New Hyperbox Selection Rule and a Pruning Strategy for the Enhanced Fuzzy Min–Max Neural Network
by: Mohammed, Mohammed Falah, et al.
Published: (2017)
by: Mohammed, Mohammed Falah, et al.
Published: (2017)
Of Spears and Pruning Hooks II
by: Gray, Michael
Published: (2014)
by: Gray, Michael
Published: (2014)
Choosing the right threshold for cross-entropy-based stopping criteria
by: Mohamad, Roslina, et al.
Published: (2015)
by: Mohamad, Roslina, et al.
Published: (2015)
Artificial neural network and its Islamic relevance
by: Ahmad Kamaruddin, Saadi, et al.
Published: (2011)
by: Ahmad Kamaruddin, Saadi, et al.
Published: (2011)
Pruning rules for optimal runway sequencing
by: de Maere, Geert, et al.
Published: (2017)
by: de Maere, Geert, et al.
Published: (2017)
Effective pruning strategies for sequential pattern mining
by: Xu, Y., et al.
Published: (2008)
by: Xu, Y., et al.
Published: (2008)
Feature extraction for neural-fuzzy inference system
by: Quek, Chai, et al.
Published: (2003)
by: Quek, Chai, et al.
Published: (2003)
Implementing the reliability of data information in multi-criteria decision making process based on fuzzy topsis and fuzzy entropy
by: N. J., Mohd Jamal, et al.
Published: (2021)
by: N. J., Mohd Jamal, et al.
Published: (2021)
Application of EFUNN for the classification of handwritten digits
by: Geok, See Ng, et al.
Published: (2004)
by: Geok, See Ng, et al.
Published: (2004)
Multi-Criteria Decision-Making Model using Intuitionistic Fuzzy Entropy and Variable Weight Theory
by: Ayasrah, Omar, et al.
Published: (2021)
by: Ayasrah, Omar, et al.
Published: (2021)
The Pruning of Combined Neighborhood
Differences Texture Descriptor for Multispectral
Image Segmentation
by: Saipullah, Khairul Muzzammil
Published: (2011)
by: Saipullah, Khairul Muzzammil
Published: (2011)
Pruning trial for Acacia mangium willd. plantation in Peninsular Malaysia
by: Nik Muhamad, Majid, et al.
Published: (1992)
by: Nik Muhamad, Majid, et al.
Published: (1992)
Growth and phytochemical responses of Andrographis paniculata as influenced by different shade levels and prunings
by: Omar, Nur Faezah, et al.
Published: (2016)
by: Omar, Nur Faezah, et al.
Published: (2016)
Family-Owned SMEs, Internationalisation and Networks.
The case study of the French family SME: "A La Prune Lorraine".
by: Loisy, Anne M. E.
Published: (2013)
by: Loisy, Anne M. E.
Published: (2013)
Are learning styles relevant to virtual reality?
by: Chen, Chwen Jen, et al.
Published: (2005)
by: Chen, Chwen Jen, et al.
Published: (2005)
Changes in photosynthetic rate and physiological characters of Andrographis paniculata under different shade levels and pruning
by: Omar, Nur Faezah, et al.
Published: (2015)
by: Omar, Nur Faezah, et al.
Published: (2015)
Generalized Entropy-Based Approach With A Dynamic Threshold To Detect Ddos Attacks On Software Defined Networking Controller
by: Aladaileh, Mohammad Adnan Ahmad
Published: (2021)
by: Aladaileh, Mohammad Adnan Ahmad
Published: (2021)
Single-Ion Entropies, Sion, of Solids; A Route to Standard Entropy Estimation
by: Glasser, Leslie, et al.
Published: (2009)
by: Glasser, Leslie, et al.
Published: (2009)
Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal
by: Namazi, Hamidreza Reza, et al.
Published: (2016)
by: Namazi, Hamidreza Reza, et al.
Published: (2016)
Effect of sucker pruning on sago palm (Mextroxylon sago Rottb.) growth performance
by: Howell, Peter Stanley
Published: (2017)
by: Howell, Peter Stanley
Published: (2017)
Study of an entropy-consistent Navier–Stokes flux
by: Mohammed, Akmal Nizam, et al.
Published: (2014)
by: Mohammed, Akmal Nizam, et al.
Published: (2014)
Keberkesanan pengambangan entropi bersilangan dan entropi tsallis untuk sistem pengecaman balistik forensik automatik
by: Zun, Liang Chuan, et al.
Published: (2013)
by: Zun, Liang Chuan, et al.
Published: (2013)
Work-Related Musculoskeletal Risks And Electromyographic Analysis Of The Upper Body Muscles During Oil Palm Pruning Activities
by: Abdullah, Nadiah Aqilahwati
Published: (2021)
by: Abdullah, Nadiah Aqilahwati
Published: (2021)
Indicators for sustainable development: understanding the criteria for a successful sustainability relevant to environmental law in Malaysia
by: Mustafa, Maizatun
Published: (2017)
by: Mustafa, Maizatun
Published: (2017)
The effect of pruning on the oil palm production (review paper) / Mohd Zulhilmi Md Saburi
by: Md Saburi, Mohd Zulhilmi
Published: (2016)
by: Md Saburi, Mohd Zulhilmi
Published: (2016)
Effect of Culture, Age and Pruning on Mass Production
of the VA Mycorrhizal Fungus, Glomus fascicuiatum.
by: Sreenivasa, M. N, et al.
Published: (1988)
by: Sreenivasa, M. N, et al.
Published: (1988)
Classification of EEG-based auditory evoked potentials using entropy-based features and machine learning techniques
by: Islam, Thamina, et al.
Published: (2023)
by: Islam, Thamina, et al.
Published: (2023)
Fault tolerant hardware for high performance signal processing
by: Erdogan, S. S., et al.
Published: (2008)
by: Erdogan, S. S., et al.
Published: (2008)
Differential evolution for neural networks learning enhancement
by: Ismail Wdaa, Abdul Sttar
Published: (2008)
by: Ismail Wdaa, Abdul Sttar
Published: (2008)
Web Phishing Classification Model using Artificial Neural Network and Deep Learning Neural Network
by: Noor Hazirah, Hassan, et al.
Published: (2023)
by: Noor Hazirah, Hassan, et al.
Published: (2023)
An Entropy-Based Directed Random Walk for Cancer Classification Using Gene Expression Data Based on
Bi-Random Walk on Two Separated Networks
by: Xin Hui Tay, Xin Hui Tay, et al.
Published: (2023)
by: Xin Hui Tay, Xin Hui Tay, et al.
Published: (2023)
Relevant, applicable learning and research
by: Daing Nasir, Ibrahim
Published: (2013)
by: Daing Nasir, Ibrahim
Published: (2013)
Stock market equity advisory tool by using of neural network method
by: Ng, Shun Yi
Published: (2024)
by: Ng, Shun Yi
Published: (2024)
Entropy in portfolio optimization / Yasaman Izadparast Shirazi
by: Yasaman Izadparast, Shirazi
Published: (2017)
by: Yasaman Izadparast, Shirazi
Published: (2017)
New entropy-based method for gene selection
by: Mahmoodian, Sayed Hamid, et al.
Published: (2009)
by: Mahmoodian, Sayed Hamid, et al.
Published: (2009)
Improving the efficiency of minimum determinant computation in space time trellis code with optimal subtree pruning
by: Ungku Azlin Ungku Chulan,, et al.
Published: (2024)
by: Ungku Azlin Ungku Chulan,, et al.
Published: (2024)
Similar Items
-
Entropy learning in neural network
by: Geok, See Ng, et al.
Published: (2003) -
Network performance of pruned hierarchical torus network
by: Rahman, M.M. Hafizur, et al.
Published: (2009) -
Pruned committee neural network based on accuracy and diversity trade-off for permeability prediction
by: Kenari, Seyed Ali Jafari, et al.
Published: (2014) -
Approximate Entropy-Based Epileptic EEG Detection Using Artificial Neural Networks
by: Srinivasan, Vairavan, et al.
Published: (2007) -
A New Hyperbox Selection Rule and a Pruning Strategy for the Enhanced Fuzzy Min–Max Neural Network
by: Mohammed, Mohammed Falah, et al.
Published: (2017)