Error magnitude and directional accuracy for time series forecasting evaluation
Evaluation of forecast accuracy is very much influenced by the choice of accurate measurement since it can produce different conclusion from the empirical results. Thus, it is important to use appropriate measurement in accordance to the purpose of forecasting. Commonly, accuracy is measured i...
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Published: |
2014
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/1267/ http://eprints.uthm.edu.my/1267/1/24%20MARIA%20ELENA%20NOR.pdf |
| _version_ | 1848887418478919680 |
|---|---|
| author | Nor, Maria Elena |
| author_facet | Nor, Maria Elena |
| author_sort | Nor, Maria Elena |
| building | UTHM Institutional Repository |
| collection | Online Access |
| description | Evaluation of forecast accuracy is very much influenced by the choice of
accurate measurement since it can produce different conclusion from the empirical
results. Thus, it is important to use appropriate measurement in accordance to the
purpose of forecasting. Commonly, accuracy is measured in terms of error
magnitude. However, directional accuracy is as important as error magnitude
especially in economics since it considers directional movement of the data. This
research attempted to combine the two types of measurements by introducing a new
element, the slope value. This proposed measure is known as square error modified
of directional accuracy (SE-mDA). Before that, the existing directional change error
measurement was modified by comparing the direction of two subsequent forecasts
data with two subsequent observed data. Empirical application utilizing the monthly
data of Malaysia and Bali tourism demand was used to compare the forecast
performance between SARIMA, time series regression, Holt-Winter, intervention
neural network and fuzzy time series. The root mean square error, mean absolute
percentage error, mean absolute deviation, Fisher’s exact test, Chi-square test,
directional accuracy, directional value and the modified of directional change error
were used in forecast accuracy evaluation. The best forecast model in terms of
SE-mDA for the data of Malaysia and Bali are Holt-Winters and neural network,
respectively. The main conclusion from this study is that SE-mDA is able to
improve the forecasting performance assessment of error magnitude measurement by
considering the directional movements. At the same time it also enhances the
available directional accuracy measurement by taking into account the difference
between slopes of forecast data and observed data. These improvements will help
forecaster to choose the best forecasting method or model so as to produce the most
accurate forecast. |
| first_indexed | 2025-11-15T19:54:04Z |
| format | Thesis |
| id | uthm-1267 |
| institution | Universiti Tun Hussein Onn Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T19:54:04Z |
| publishDate | 2014 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | uthm-12672021-09-30T06:58:20Z http://eprints.uthm.edu.my/1267/ Error magnitude and directional accuracy for time series forecasting evaluation Nor, Maria Elena QA273-280 Probabilities. Mathematical statistics Evaluation of forecast accuracy is very much influenced by the choice of accurate measurement since it can produce different conclusion from the empirical results. Thus, it is important to use appropriate measurement in accordance to the purpose of forecasting. Commonly, accuracy is measured in terms of error magnitude. However, directional accuracy is as important as error magnitude especially in economics since it considers directional movement of the data. This research attempted to combine the two types of measurements by introducing a new element, the slope value. This proposed measure is known as square error modified of directional accuracy (SE-mDA). Before that, the existing directional change error measurement was modified by comparing the direction of two subsequent forecasts data with two subsequent observed data. Empirical application utilizing the monthly data of Malaysia and Bali tourism demand was used to compare the forecast performance between SARIMA, time series regression, Holt-Winter, intervention neural network and fuzzy time series. The root mean square error, mean absolute percentage error, mean absolute deviation, Fisher’s exact test, Chi-square test, directional accuracy, directional value and the modified of directional change error were used in forecast accuracy evaluation. The best forecast model in terms of SE-mDA for the data of Malaysia and Bali are Holt-Winters and neural network, respectively. The main conclusion from this study is that SE-mDA is able to improve the forecasting performance assessment of error magnitude measurement by considering the directional movements. At the same time it also enhances the available directional accuracy measurement by taking into account the difference between slopes of forecast data and observed data. These improvements will help forecaster to choose the best forecasting method or model so as to produce the most accurate forecast. 2014-10 Thesis NonPeerReviewed text en http://eprints.uthm.edu.my/1267/1/24%20MARIA%20ELENA%20NOR.pdf Nor, Maria Elena (2014) Error magnitude and directional accuracy for time series forecasting evaluation. Doctoral thesis, Universiti Teknologi Malaysia. |
| spellingShingle | QA273-280 Probabilities. Mathematical statistics Nor, Maria Elena Error magnitude and directional accuracy for time series forecasting evaluation |
| title | Error magnitude and directional accuracy for time series forecasting evaluation |
| title_full | Error magnitude and directional accuracy for time series forecasting evaluation |
| title_fullStr | Error magnitude and directional accuracy for time series forecasting evaluation |
| title_full_unstemmed | Error magnitude and directional accuracy for time series forecasting evaluation |
| title_short | Error magnitude and directional accuracy for time series forecasting evaluation |
| title_sort | error magnitude and directional accuracy for time series forecasting evaluation |
| topic | QA273-280 Probabilities. Mathematical statistics |
| url | http://eprints.uthm.edu.my/1267/ http://eprints.uthm.edu.my/1267/1/24%20MARIA%20ELENA%20NOR.pdf |