Improving neural networks training using experiment design approach
This project involves the use of Neural Networks (NN) for function approximation. Conventionally, the parameters of a neural network are tuned by minimizing an objective function based on a pre-determined set of training data. This training paradigm is passive in the sense that the neural network on...
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
2005
|
| Subjects: | |
| Online Access: | http://eprints.utm.my/3580/ http://eprints.utm.my/3580/2/ChongWeiKeanMED2005.PDF |
| _version_ | 1848890603726700544 |
|---|---|
| author | Chong, Wei Kean |
| author_facet | Chong, Wei Kean |
| author_sort | Chong, Wei Kean |
| building | UTeM Institutional Repository |
| collection | Online Access |
| description | This project involves the use of Neural Networks (NN) for function approximation. Conventionally, the parameters of a neural network are tuned by minimizing an objective function based on a pre-determined set of training data. This training paradigm is passive in the sense that the neural network only learns from the training patterns presented to it by the environment or a teacher. It may be more useful if the neural network could 'actively' obtain the training samples itself sequentially by interacting with its environment. There are several methods of selecting training data from input space for neural networks which include D-optimal and Max-min design approaches. Consider a function approximation problem (Neural Network using Radial Basic Function structure) and limit the amount of training data, say (m) from N amount of possible data. Randomly select the m data set for conventional training algorithm. One more data (m+ 1) is entered to train the NN again. This data is selected by two methods: random and Experiment Design Approach (D-optimal and Maxmin Distance). The performances of the two approaches are then compared. It was found that the NN trained using the data obtained using experiment design approaches approximated the unknown function better than the NN that is trained when the data are selected randomly. Maxmin Distance Approach is independent of the NN model while Doptimal point is dependent on the NN model used. |
| first_indexed | 2025-11-15T20:44:42Z |
| format | Thesis |
| id | utm-3580 |
| institution | Universiti Teknologi Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T20:44:42Z |
| publishDate | 2005 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | utm-35802020-03-09T07:02:49Z http://eprints.utm.my/3580/ Improving neural networks training using experiment design approach Chong, Wei Kean TK Electrical engineering. Electronics Nuclear engineering This project involves the use of Neural Networks (NN) for function approximation. Conventionally, the parameters of a neural network are tuned by minimizing an objective function based on a pre-determined set of training data. This training paradigm is passive in the sense that the neural network only learns from the training patterns presented to it by the environment or a teacher. It may be more useful if the neural network could 'actively' obtain the training samples itself sequentially by interacting with its environment. There are several methods of selecting training data from input space for neural networks which include D-optimal and Max-min design approaches. Consider a function approximation problem (Neural Network using Radial Basic Function structure) and limit the amount of training data, say (m) from N amount of possible data. Randomly select the m data set for conventional training algorithm. One more data (m+ 1) is entered to train the NN again. This data is selected by two methods: random and Experiment Design Approach (D-optimal and Maxmin Distance). The performances of the two approaches are then compared. It was found that the NN trained using the data obtained using experiment design approaches approximated the unknown function better than the NN that is trained when the data are selected randomly. Maxmin Distance Approach is independent of the NN model while Doptimal point is dependent on the NN model used. 2005-03 Thesis NonPeerReviewed application/pdf en http://eprints.utm.my/3580/2/ChongWeiKeanMED2005.PDF Chong, Wei Kean (2005) Improving neural networks training using experiment design approach. Masters thesis, Universiti Teknologi Malaysia, Faculty of Electrical Engineering. |
| spellingShingle | TK Electrical engineering. Electronics Nuclear engineering Chong, Wei Kean Improving neural networks training using experiment design approach |
| title | Improving neural networks training using experiment design approach |
| title_full | Improving neural networks training using experiment design approach |
| title_fullStr | Improving neural networks training using experiment design approach |
| title_full_unstemmed | Improving neural networks training using experiment design approach |
| title_short | Improving neural networks training using experiment design approach |
| title_sort | improving neural networks training using experiment design approach |
| topic | TK Electrical engineering. Electronics Nuclear engineering |
| url | http://eprints.utm.my/3580/ http://eprints.utm.my/3580/2/ChongWeiKeanMED2005.PDF |