A Novel Performance Metric for Building an Optimized Classifier

Problem statement: Typically, the accuracy metric is often applied for optimizing the heuristic or stochastic classification models. However, the use of accuracy metric might lead the searching process to the sub-optimal solutions due to its less discriminating values and it is also not robust to...

Full description

Bibliographic Details
Main Authors: Hossin, M., Sulaiman, M.N, Mustapha, A., Mustapha , N.
Format: Article
Language:English
Published: Science Publications 2011
Subjects:
Online Access:http://ir.unimas.my/id/eprint/3432/
http://ir.unimas.my/id/eprint/3432/1/A%20Novel%20Performance%20Metric%20for%20Building%20an%20Optimized%20Classifier.pdf
_version_ 1848835214810284032
author Hossin, M.
Sulaiman, M.N
Mustapha, A.
Mustapha , N.
author_facet Hossin, M.
Sulaiman, M.N
Mustapha, A.
Mustapha , N.
author_sort Hossin, M.
building UNIMAS Institutional Repository
collection Online Access
description Problem statement: Typically, the accuracy metric is often applied for optimizing the heuristic or stochastic classification models. However, the use of accuracy metric might lead the searching process to the sub-optimal solutions due to its less discriminating values and it is also not robust to the changes of class distribution. Approach: To solve these detrimental effects, we propose a novel performance metric which combines the beneficial properties of accuracy metric with the extended recall and precision metrics. We call this new performance metric as Optimized Accuracy with Recall-Precision (OARP). Results: In this study, we demonstrate that the OARP metric is theoretically better than the accuracy metric using four generated examples. We also demonstrate empirically that a naïve stochastic classification algorithm, which is Monte Carlo Sampling (MCS) algorithm trained with the OARP metric, is able to obtain better predictive results than the one trained with the conventional accuracy metric. Additionally, the t-test analysis also shows a clear advantage of the MCS model trained with the OARP metric over the accuracy metric alone for all binary data sets. Conclusion: The experiments have proved that the OARP metric leads stochastic classifiers such as the MCS towards a better training model, which in turn will improve the predictive results of any heuristic or stochastic classification models.
first_indexed 2025-11-15T06:04:19Z
format Article
id unimas-3432
institution Universiti Malaysia Sarawak
institution_category Local University
language English
last_indexed 2025-11-15T06:04:19Z
publishDate 2011
publisher Science Publications
recordtype eprints
repository_type Digital Repository
spelling unimas-34322015-09-18T07:15:16Z http://ir.unimas.my/id/eprint/3432/ A Novel Performance Metric for Building an Optimized Classifier Hossin, M. Sulaiman, M.N Mustapha, A. Mustapha , N. AC Collections. Series. Collected works Problem statement: Typically, the accuracy metric is often applied for optimizing the heuristic or stochastic classification models. However, the use of accuracy metric might lead the searching process to the sub-optimal solutions due to its less discriminating values and it is also not robust to the changes of class distribution. Approach: To solve these detrimental effects, we propose a novel performance metric which combines the beneficial properties of accuracy metric with the extended recall and precision metrics. We call this new performance metric as Optimized Accuracy with Recall-Precision (OARP). Results: In this study, we demonstrate that the OARP metric is theoretically better than the accuracy metric using four generated examples. We also demonstrate empirically that a naïve stochastic classification algorithm, which is Monte Carlo Sampling (MCS) algorithm trained with the OARP metric, is able to obtain better predictive results than the one trained with the conventional accuracy metric. Additionally, the t-test analysis also shows a clear advantage of the MCS model trained with the OARP metric over the accuracy metric alone for all binary data sets. Conclusion: The experiments have proved that the OARP metric leads stochastic classifiers such as the MCS towards a better training model, which in turn will improve the predictive results of any heuristic or stochastic classification models. Science Publications 2011 Article NonPeerReviewed text en http://ir.unimas.my/id/eprint/3432/1/A%20Novel%20Performance%20Metric%20for%20Building%20an%20Optimized%20Classifier.pdf Hossin, M. and Sulaiman, M.N and Mustapha, A. and Mustapha , N. (2011) A Novel Performance Metric for Building an Optimized Classifier. Journal of Computer Science 7 (4) : 582-590, 2011, 7 (4). pp. 582-590. http://www.thescipub.com/abstract/10.3844/jcssp.2011.582.590 DOI : 10.3844/jcssp.2011.582.590
spellingShingle AC Collections. Series. Collected works
Hossin, M.
Sulaiman, M.N
Mustapha, A.
Mustapha , N.
A Novel Performance Metric for Building an Optimized Classifier
title A Novel Performance Metric for Building an Optimized Classifier
title_full A Novel Performance Metric for Building an Optimized Classifier
title_fullStr A Novel Performance Metric for Building an Optimized Classifier
title_full_unstemmed A Novel Performance Metric for Building an Optimized Classifier
title_short A Novel Performance Metric for Building an Optimized Classifier
title_sort novel performance metric for building an optimized classifier
topic AC Collections. Series. Collected works
url http://ir.unimas.my/id/eprint/3432/
http://ir.unimas.my/id/eprint/3432/
http://ir.unimas.my/id/eprint/3432/
http://ir.unimas.my/id/eprint/3432/1/A%20Novel%20Performance%20Metric%20for%20Building%20an%20Optimized%20Classifier.pdf