Comparative analysis of imputation methods for enhancing predictive accuracy in data models
The presence of missing values within datasets can introduce a detrimental bias, significantly impeding the predictive algorithm's ability to discern patterns and accurately execute prediction. This paper aims to elucidate the intricacies of data imputation methods, providing a more profound un...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Politeknik Negeri Padang
2024
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/42748/ http://umpir.ump.edu.my/id/eprint/42748/1/Comparative%20analysis%20of%20imputation%20methods%20for%20enhancing%20predictive%20accuracy%20in%20data%20models.pdf |
| _version_ | 1848826691741286400 |
|---|---|
| author | Nurul Aqilah, Zamri Mohd Izham, Mohd Jaya Irawati, Indrarini Dyah Rassem, Taha H. Rasyidah, . Shahreen, Kasim |
| author_facet | Nurul Aqilah, Zamri Mohd Izham, Mohd Jaya Irawati, Indrarini Dyah Rassem, Taha H. Rasyidah, . Shahreen, Kasim |
| author_sort | Nurul Aqilah, Zamri |
| building | UMP Institutional Repository |
| collection | Online Access |
| description | The presence of missing values within datasets can introduce a detrimental bias, significantly impeding the predictive algorithm's ability to discern patterns and accurately execute prediction. This paper aims to elucidate the intricacies of data imputation methods, providing a more profound understanding of prevalent imputation methods, including list-wise deletion (IGN), mean imputation (AVG), K-Nearest Neighbors (KNN), MissForest (MF), and Predictive Mean Matching (PMM). The dataset employed in this study consists of financial data about S&P 500 companies in the Compustat North America database. The training and validation dataset encompasses 1973 instances, consisting of data during the fourth quarter of 2009, the first quarter of 2010, and the third quarter of 2014. Within this set, 457 missing values were identified and imputed. The test dataset comprises 197 randomly selected instances from the fourth quarter of 2014, equivalent to ten percent of the total instances in the training dataset. The evaluation findings prominently position the dataset derived from MF imputation as the leading performer among all the imputed datasets. The insights derived from this study are intended to assist practitioners in making informed choices when selecting the most suitable data imputation method, particularly in the context of predictive modeling tasks. |
| first_indexed | 2025-11-15T03:48:51Z |
| format | Article |
| id | ump-42748 |
| institution | Universiti Malaysia Pahang |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T03:48:51Z |
| publishDate | 2024 |
| publisher | Politeknik Negeri Padang |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | ump-427482024-10-04T04:04:44Z http://umpir.ump.edu.my/id/eprint/42748/ Comparative analysis of imputation methods for enhancing predictive accuracy in data models Nurul Aqilah, Zamri Mohd Izham, Mohd Jaya Irawati, Indrarini Dyah Rassem, Taha H. Rasyidah, . Shahreen, Kasim QA75 Electronic computers. Computer science T Technology (General) The presence of missing values within datasets can introduce a detrimental bias, significantly impeding the predictive algorithm's ability to discern patterns and accurately execute prediction. This paper aims to elucidate the intricacies of data imputation methods, providing a more profound understanding of prevalent imputation methods, including list-wise deletion (IGN), mean imputation (AVG), K-Nearest Neighbors (KNN), MissForest (MF), and Predictive Mean Matching (PMM). The dataset employed in this study consists of financial data about S&P 500 companies in the Compustat North America database. The training and validation dataset encompasses 1973 instances, consisting of data during the fourth quarter of 2009, the first quarter of 2010, and the third quarter of 2014. Within this set, 457 missing values were identified and imputed. The test dataset comprises 197 randomly selected instances from the fourth quarter of 2014, equivalent to ten percent of the total instances in the training dataset. The evaluation findings prominently position the dataset derived from MF imputation as the leading performer among all the imputed datasets. The insights derived from this study are intended to assist practitioners in making informed choices when selecting the most suitable data imputation method, particularly in the context of predictive modeling tasks. Politeknik Negeri Padang 2024 Article PeerReviewed pdf en cc_by_nc_sa_4 http://umpir.ump.edu.my/id/eprint/42748/1/Comparative%20analysis%20of%20imputation%20methods%20for%20enhancing%20predictive%20accuracy%20in%20data%20models.pdf Nurul Aqilah, Zamri and Mohd Izham, Mohd Jaya and Irawati, Indrarini Dyah and Rassem, Taha H. and Rasyidah, . and Shahreen, Kasim (2024) Comparative analysis of imputation methods for enhancing predictive accuracy in data models. International Journal on Informatics Visualization, 8 (3). pp. 1271-1276. ISSN 2549-9904. (Published) https://www.joiv.org/index.php/joiv/article/view/1666 |
| spellingShingle | QA75 Electronic computers. Computer science T Technology (General) Nurul Aqilah, Zamri Mohd Izham, Mohd Jaya Irawati, Indrarini Dyah Rassem, Taha H. Rasyidah, . Shahreen, Kasim Comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| title | Comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| title_full | Comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| title_fullStr | Comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| title_full_unstemmed | Comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| title_short | Comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| title_sort | comparative analysis of imputation methods for enhancing predictive accuracy in data models |
| topic | QA75 Electronic computers. Computer science T Technology (General) |
| url | http://umpir.ump.edu.my/id/eprint/42748/ http://umpir.ump.edu.my/id/eprint/42748/ http://umpir.ump.edu.my/id/eprint/42748/1/Comparative%20analysis%20of%20imputation%20methods%20for%20enhancing%20predictive%20accuracy%20in%20data%20models.pdf |