On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis
This paper presents two methods for calculating competence of a classifier in the feature space. The idea of the first method is based on relating the response of the classifier with the response obtained by a random guessing. The measure of competence reflects this relation and rates the classifier...
| Main Authors: | , , |
|---|---|
| Format: | Conference Paper |
| Published: |
2010
|
| Online Access: | http://hdl.handle.net/20.500.11937/38320 |
| _version_ | 1848755288597856256 |
|---|---|
| author | Kurzynski, M. Woloszynski, Tomasz Lysiak, R. |
| author_facet | Kurzynski, M. Woloszynski, Tomasz Lysiak, R. |
| author_sort | Kurzynski, M. |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | This paper presents two methods for calculating competence of a classifier in the feature space. The idea of the first method is based on relating the response of the classifier with the response obtained by a random guessing. The measure of competence reflects this relation and rates the classifier with respect to the random guessing in a continuous manner. In the second method, first a probabilistic reference classifier (PRC) is constructed which, on average, acts like the classifier evaluated. Next the competence of the classifier evaluated is calculated as the probability of correct classification of the respective PRC. Two multiclassifier systems (MCS) were developed using proposed measures of competence in a dynamic fashion. The performance of proposed MCS's were compared against six multiple classifier systems using six databases taken from the UCI Machine Learning Repository and Ludmila Kuncheva Collection. The experimental results clearly show the effectiveness of the proposed dynamic selection methods regardless of the ensamble type used (homogeneous or heterogeneous). ©2010 IEEE. |
| first_indexed | 2025-11-14T08:53:55Z |
| format | Conference Paper |
| id | curtin-20.500.11937-38320 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T08:53:55Z |
| publishDate | 2010 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-383202017-09-13T14:09:30Z On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis Kurzynski, M. Woloszynski, Tomasz Lysiak, R. This paper presents two methods for calculating competence of a classifier in the feature space. The idea of the first method is based on relating the response of the classifier with the response obtained by a random guessing. The measure of competence reflects this relation and rates the classifier with respect to the random guessing in a continuous manner. In the second method, first a probabilistic reference classifier (PRC) is constructed which, on average, acts like the classifier evaluated. Next the competence of the classifier evaluated is calculated as the probability of correct classification of the respective PRC. Two multiclassifier systems (MCS) were developed using proposed measures of competence in a dynamic fashion. The performance of proposed MCS's were compared against six multiple classifier systems using six databases taken from the UCI Machine Learning Repository and Ludmila Kuncheva Collection. The experimental results clearly show the effectiveness of the proposed dynamic selection methods regardless of the ensamble type used (homogeneous or heterogeneous). ©2010 IEEE. 2010 Conference Paper http://hdl.handle.net/20.500.11937/38320 10.1109/ISCIT.2010.5665153 restricted |
| spellingShingle | Kurzynski, M. Woloszynski, Tomasz Lysiak, R. On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis |
| title | On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis |
| title_full | On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis |
| title_fullStr | On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis |
| title_full_unstemmed | On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis |
| title_short | On two measures of classifier competence for dynamic ensemble selection - Experimental comparative analysis |
| title_sort | on two measures of classifier competence for dynamic ensemble selection - experimental comparative analysis |
| url | http://hdl.handle.net/20.500.11937/38320 |