Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction

(Research into the field of artificial neural networks (ANN) is fast gaining interest in recent years, due to the fact that it is fast becoming a popular tool of choice in prediction of time series trends. This recent surge in its popularity can be attributed to the fact that ANN, especially a multi...

Full description

Bibliographic Details
Main Author: Tan, James Yiaw Beng
Format: Thesis
Language:English
Published: Universiti Malaysia Sarawak (UNIMAS) 2012
Subjects:
Online Access:http://ir.unimas.my/id/eprint/14395/
http://ir.unimas.my/id/eprint/14395/3/Optimization%20of%20the%20Hidden%20Layer%20of%20A%20Multilayer%20Perception%20with%20Backpropagation%20%28BP%29%20Network%20Using%20Hybrid%20K-Means-Greedy%20Algorithm%20%28KGA%29%20for%20Time%20Series%20Prediction%20%28Fulltext%29.pdf
_version_ 1848837639563640832
author Tan, James Yiaw Beng
author_facet Tan, James Yiaw Beng
author_sort Tan, James Yiaw Beng
building UNIMAS Institutional Repository
collection Online Access
description (Research into the field of artificial neural networks (ANN) is fast gaining interest in recent years, due to the fact that it is fast becoming a popular tool of choice in prediction of time series trends. This recent surge in its popularity can be attributed to the fact that ANN, especially a multilayer perceptron with backpropagation (BP) network that has the optimal number of neurons in its hidden layer would be able to predict with better accuracy unknown values of a time series that it is trained with, compared to other methods implemented to predict the same time series The drawback of using BP networks in time series prediction is that it is difficult and time-consuming to find the optimal number of neurons in its hidden layer to minimize the prediction error. We propose a model known as K-means-Greedy Algorithm (KGA) model in this research to overcome this serious drawback of the BP network. The proposed KGA model combines greedy algorithm withk-means++ clustering in this research to assist users in automating the finding of the optimal number of new-ons inside the hidden layer of the BP network. The evaluation results the proposed KGA model using several time series, namely the sunspot data, the Mackey-Glass time series, and electrical load forecasting using data from several econometric factors, as well as historical electricity demand data, show that the proposed KGA model is eflective in finding the optimal number ofneurons for the hidden layer of a BP network that is used to perform time series prediction.
first_indexed 2025-11-15T06:42:51Z
format Thesis
id unimas-14395
institution Universiti Malaysia Sarawak
institution_category Local University
language English
last_indexed 2025-11-15T06:42:51Z
publishDate 2012
publisher Universiti Malaysia Sarawak (UNIMAS)
recordtype eprints
repository_type Digital Repository
spelling unimas-143952023-05-03T09:02:52Z http://ir.unimas.my/id/eprint/14395/ Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction Tan, James Yiaw Beng TA Engineering (General). Civil engineering (General) (Research into the field of artificial neural networks (ANN) is fast gaining interest in recent years, due to the fact that it is fast becoming a popular tool of choice in prediction of time series trends. This recent surge in its popularity can be attributed to the fact that ANN, especially a multilayer perceptron with backpropagation (BP) network that has the optimal number of neurons in its hidden layer would be able to predict with better accuracy unknown values of a time series that it is trained with, compared to other methods implemented to predict the same time series The drawback of using BP networks in time series prediction is that it is difficult and time-consuming to find the optimal number of neurons in its hidden layer to minimize the prediction error. We propose a model known as K-means-Greedy Algorithm (KGA) model in this research to overcome this serious drawback of the BP network. The proposed KGA model combines greedy algorithm withk-means++ clustering in this research to assist users in automating the finding of the optimal number of new-ons inside the hidden layer of the BP network. The evaluation results the proposed KGA model using several time series, namely the sunspot data, the Mackey-Glass time series, and electrical load forecasting using data from several econometric factors, as well as historical electricity demand data, show that the proposed KGA model is eflective in finding the optimal number ofneurons for the hidden layer of a BP network that is used to perform time series prediction. Universiti Malaysia Sarawak (UNIMAS) 2012 Thesis NonPeerReviewed text en http://ir.unimas.my/id/eprint/14395/3/Optimization%20of%20the%20Hidden%20Layer%20of%20A%20Multilayer%20Perception%20with%20Backpropagation%20%28BP%29%20Network%20Using%20Hybrid%20K-Means-Greedy%20Algorithm%20%28KGA%29%20for%20Time%20Series%20Prediction%20%28Fulltext%29.pdf Tan, James Yiaw Beng (2012) Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction. Masters thesis, Universiti Malaysia Sarawak.
spellingShingle TA Engineering (General). Civil engineering (General)
Tan, James Yiaw Beng
Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
title Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
title_full Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
title_fullStr Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
title_full_unstemmed Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
title_short Optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
title_sort optimization of the hidden layer of a multilayer perceptron with backpropagation (bp) network using hybrid k-means-greedy algorithm (kga) for time series prediction
topic TA Engineering (General). Civil engineering (General)
url http://ir.unimas.my/id/eprint/14395/
http://ir.unimas.my/id/eprint/14395/3/Optimization%20of%20the%20Hidden%20Layer%20of%20A%20Multilayer%20Perception%20with%20Backpropagation%20%28BP%29%20Network%20Using%20Hybrid%20K-Means-Greedy%20Algorithm%20%28KGA%29%20for%20Time%20Series%20Prediction%20%28Fulltext%29.pdf