Training process reduction based on potential weights linear analysis to accelerate back propagation network.

Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the c...

Full description

Bibliographic Details
Main Authors: Asadi, Roya, Mustapha, Norwati, Sulaiman, Md. Nasir
Format: Article
Language:English
English
Published: IJCSIS Press 2009
Subjects:
Online Access:http://psasir.upm.edu.my/id/eprint/17465/
http://psasir.upm.edu.my/id/eprint/17465/1/Training%20process%20reduction%20based%20on%20potential%20weights%20linear%20analysis%20to%20accelerate%20back%20propagation%20network.pdf
_version_ 1848843248512008192
author Asadi, Roya
Mustapha, Norwati
Sulaiman, Md. Nasir
author_facet Asadi, Roya
Mustapha, Norwati
Sulaiman, Md. Nasir
author_sort Asadi, Roya
building UPM Institutional Repository
collection Online Access
description Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the contributing factors in developing efficient techniques for reducing training time with high accuracy and initialization of the weights is the important issue which is random and creates paradox, and leads to low accuracy with high training time. One good data preprocessing technique for accelerating BPN classification is dimension reduction technique but it has problem of missing data. In this paper, we study current pre-training techniques and new preprocessing technique called Potential Weight Linear Analysis (PWLA) which combines normalization, dimension reduction input values and pre-training. In PWLA, the first data preprocessing is performed for generating normalized input values and then applying them by pre-training technique in order to obtain the potential weights. After these phases, dimension of input values matrix will be reduced by using real potential weights. For experiment results XOR problem and three datasets, which are SPECT Heart, SPECTF Heart and Liver disorders (BUPA) will be evaluated. Our results, however, will show that the new technique of PWLA will change BPN to new Supervised Multi Layer Feed Forward Neural Network (SMFFNN) model with high accuracy in one epoch without training cycle. Also PWLA will be able to have power of non linear supervised and unsupervised dimension reduction property for applying by other supervised multi layer feed forward neural network model in future work.
first_indexed 2025-11-15T08:12:01Z
format Article
id upm-17465
institution Universiti Putra Malaysia
institution_category Local University
language English
English
last_indexed 2025-11-15T08:12:01Z
publishDate 2009
publisher IJCSIS Press
recordtype eprints
repository_type Digital Repository
spelling upm-174652015-11-16T01:17:45Z http://psasir.upm.edu.my/id/eprint/17465/ Training process reduction based on potential weights linear analysis to accelerate back propagation network. Asadi, Roya Mustapha, Norwati Sulaiman, Md. Nasir Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the contributing factors in developing efficient techniques for reducing training time with high accuracy and initialization of the weights is the important issue which is random and creates paradox, and leads to low accuracy with high training time. One good data preprocessing technique for accelerating BPN classification is dimension reduction technique but it has problem of missing data. In this paper, we study current pre-training techniques and new preprocessing technique called Potential Weight Linear Analysis (PWLA) which combines normalization, dimension reduction input values and pre-training. In PWLA, the first data preprocessing is performed for generating normalized input values and then applying them by pre-training technique in order to obtain the potential weights. After these phases, dimension of input values matrix will be reduced by using real potential weights. For experiment results XOR problem and three datasets, which are SPECT Heart, SPECTF Heart and Liver disorders (BUPA) will be evaluated. Our results, however, will show that the new technique of PWLA will change BPN to new Supervised Multi Layer Feed Forward Neural Network (SMFFNN) model with high accuracy in one epoch without training cycle. Also PWLA will be able to have power of non linear supervised and unsupervised dimension reduction property for applying by other supervised multi layer feed forward neural network model in future work. IJCSIS Press 2009-07 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/17465/1/Training%20process%20reduction%20based%20on%20potential%20weights%20linear%20analysis%20to%20accelerate%20back%20propagation%20network.pdf Asadi, Roya and Mustapha, Norwati and Sulaiman, Md. Nasir (2009) Training process reduction based on potential weights linear analysis to accelerate back propagation network. International Journal of Computer Science and Information Security, 3 (1). pp. 229-239. ISSN 1947-5500 Computer Science - Neural and Evolutionary Computing. Dimension reduction (Statistics). English
spellingShingle Computer Science - Neural and Evolutionary Computing.
Dimension reduction (Statistics).
Asadi, Roya
Mustapha, Norwati
Sulaiman, Md. Nasir
Training process reduction based on potential weights linear analysis to accelerate back propagation network.
title Training process reduction based on potential weights linear analysis to accelerate back propagation network.
title_full Training process reduction based on potential weights linear analysis to accelerate back propagation network.
title_fullStr Training process reduction based on potential weights linear analysis to accelerate back propagation network.
title_full_unstemmed Training process reduction based on potential weights linear analysis to accelerate back propagation network.
title_short Training process reduction based on potential weights linear analysis to accelerate back propagation network.
title_sort training process reduction based on potential weights linear analysis to accelerate back propagation network.
topic Computer Science - Neural and Evolutionary Computing.
Dimension reduction (Statistics).
url http://psasir.upm.edu.my/id/eprint/17465/
http://psasir.upm.edu.my/id/eprint/17465/1/Training%20process%20reduction%20based%20on%20potential%20weights%20linear%20analysis%20to%20accelerate%20back%20propagation%20network.pdf