Robust combining methods in committee neural networks
Combining a set of suitable experts can improve the generalization performance of the group when compared to single experts alone. The classical problem in this area is to answer the question about how to combine the ensemble members or the individuals. Different methods for combining the outputs of...
| Main Authors: | , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
IEEE
2011
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/45558/ http://psasir.upm.edu.my/id/eprint/45558/1/Robust%20combining%20methods%20in%20committee%20neural%20networks.pdf |
| _version_ | 1848850516820361216 |
|---|---|
| author | Kenari, Seyed Ali Jafari Mashohor, Syamsiah |
| author_facet | Kenari, Seyed Ali Jafari Mashohor, Syamsiah |
| author_sort | Kenari, Seyed Ali Jafari |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | Combining a set of suitable experts can improve the generalization performance of the group when compared to single experts alone. The classical problem in this area is to answer the question about how to combine the ensemble members or the individuals. Different methods for combining the outputs of the experts in a committee machine (ensemble) are reported in the literature. The popular method to determine the error in every prediction is Mean Square Error (MSE), which is heavily influenced by outliers that can be found in many real data such as geosciences data. In this paper we introduce Robust Committee Neural Networks (RCNNs). Our proposed approach is the Huber and Bisquare function to determine the error between measured and predicted value which is less influenced by outliers. Therefore, we have used a Genetic Algorithm (GA) method to combine the individuals with the Huber and Bisquare as the fitness functions. The results show that the Root Mean Square Error (RMSE) and R-square values for these two functions are improved compared to the MSE as the fitness function and the proposed combiner outperformed other five existing training algorithms. |
| first_indexed | 2025-11-15T10:07:32Z |
| format | Conference or Workshop Item |
| id | upm-45558 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T10:07:32Z |
| publishDate | 2011 |
| publisher | IEEE |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-455582020-08-07T02:25:25Z http://psasir.upm.edu.my/id/eprint/45558/ Robust combining methods in committee neural networks Kenari, Seyed Ali Jafari Mashohor, Syamsiah Combining a set of suitable experts can improve the generalization performance of the group when compared to single experts alone. The classical problem in this area is to answer the question about how to combine the ensemble members or the individuals. Different methods for combining the outputs of the experts in a committee machine (ensemble) are reported in the literature. The popular method to determine the error in every prediction is Mean Square Error (MSE), which is heavily influenced by outliers that can be found in many real data such as geosciences data. In this paper we introduce Robust Committee Neural Networks (RCNNs). Our proposed approach is the Huber and Bisquare function to determine the error between measured and predicted value which is less influenced by outliers. Therefore, we have used a Genetic Algorithm (GA) method to combine the individuals with the Huber and Bisquare as the fitness functions. The results show that the Root Mean Square Error (RMSE) and R-square values for these two functions are improved compared to the MSE as the fitness function and the proposed combiner outperformed other five existing training algorithms. IEEE 2011 Conference or Workshop Item PeerReviewed text en http://psasir.upm.edu.my/id/eprint/45558/1/Robust%20combining%20methods%20in%20committee%20neural%20networks.pdf Kenari, Seyed Ali Jafari and Mashohor, Syamsiah (2011) Robust combining methods in committee neural networks. In: 2011 IEEE Symposium on Computers & Informatics (ISCI 2011), 20-22 Mar. 2011, Kuala Lumpur, Malaysia. (pp. 18-22). 10.1109/ISCI.2011.5958876 |
| spellingShingle | Kenari, Seyed Ali Jafari Mashohor, Syamsiah Robust combining methods in committee neural networks |
| title | Robust combining methods in committee neural networks |
| title_full | Robust combining methods in committee neural networks |
| title_fullStr | Robust combining methods in committee neural networks |
| title_full_unstemmed | Robust combining methods in committee neural networks |
| title_short | Robust combining methods in committee neural networks |
| title_sort | robust combining methods in committee neural networks |
| url | http://psasir.upm.edu.my/id/eprint/45558/ http://psasir.upm.edu.my/id/eprint/45558/ http://psasir.upm.edu.my/id/eprint/45558/1/Robust%20combining%20methods%20in%20committee%20neural%20networks.pdf |