An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification
Sentiment classification is increasingly used to automatically identify a positive or negative sentiment in a text review. In classification, feature selection had always been a critical and challenging problem. Most of the related feature selection for sentiment classification techniques unable to...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/31646/ http://umpir.ump.edu.my/id/eprint/31646/2/An%20enhanced%20hybrid%20feature%20selection%20technique%20using%20term%20frequency-inverse%20document%20frequency%20and%20support%20vector%20machine-recursive%20feature%20elimination%20for%20sentiment%20classification.pdf |
| _version_ | 1848823820377391104 |
|---|---|
| author | Nur Syafiqah, Mohd Nafis Suryanti, Awang |
| author_facet | Nur Syafiqah, Mohd Nafis Suryanti, Awang |
| author_sort | Nur Syafiqah, Mohd Nafis |
| building | UMP Institutional Repository |
| collection | Online Access |
| description | Sentiment classification is increasingly used to automatically identify a positive or negative sentiment in a text review. In classification, feature selection had always been a critical and challenging problem. Most of the related feature selection for sentiment classification techniques unable to overcome problems of evaluating the significant features that will reduce the classification performance. This paper proposes an enhanced hybrid feature selection technique to improve the sentiment classification based on machine learning approaches. First, two customer review datasets namely Sentiment Labelled and large IMDB are retrieved and pre-processed. Next, the proposed feature selection technique which is the hybridization of Term Frequency-Inverse Document Frequency (TF-IDF) and Supports Vector Machine (SVM-RFE) is developed and tested on these two datasets. TF-IDF aims to measure features importance. The SVM-RFE iteratively evaluates and ranks the features. For sentiment classification, only the k-top features from the ranked features will be used. Finally, the Support Vector Machine (SVM) classifier is deployed to observe the performance of the proposed technique. The performance is measured using accuracy, precision, recall, and F-measure. The experimental results show promising performances with 84.54% to 89.56% in the measurements especially from the large IMDB dataset. The results also outperformed other related techniques in certain datasets. Consequently, the proposed technique able to reduce from 19.25% to 70.5% of the features to be classified. This reduction rate is significant in optimally utilizing the computational resources while maintaining the efficiency of the classification performance. |
| first_indexed | 2025-11-15T03:03:12Z |
| format | Article |
| id | ump-31646 |
| institution | Universiti Malaysia Pahang |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T03:03:12Z |
| publishDate | 2021 |
| publisher | IEEE |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | ump-316462024-01-05T08:39:51Z http://umpir.ump.edu.my/id/eprint/31646/ An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification Nur Syafiqah, Mohd Nafis Suryanti, Awang T Technology (General) Sentiment classification is increasingly used to automatically identify a positive or negative sentiment in a text review. In classification, feature selection had always been a critical and challenging problem. Most of the related feature selection for sentiment classification techniques unable to overcome problems of evaluating the significant features that will reduce the classification performance. This paper proposes an enhanced hybrid feature selection technique to improve the sentiment classification based on machine learning approaches. First, two customer review datasets namely Sentiment Labelled and large IMDB are retrieved and pre-processed. Next, the proposed feature selection technique which is the hybridization of Term Frequency-Inverse Document Frequency (TF-IDF) and Supports Vector Machine (SVM-RFE) is developed and tested on these two datasets. TF-IDF aims to measure features importance. The SVM-RFE iteratively evaluates and ranks the features. For sentiment classification, only the k-top features from the ranked features will be used. Finally, the Support Vector Machine (SVM) classifier is deployed to observe the performance of the proposed technique. The performance is measured using accuracy, precision, recall, and F-measure. The experimental results show promising performances with 84.54% to 89.56% in the measurements especially from the large IMDB dataset. The results also outperformed other related techniques in certain datasets. Consequently, the proposed technique able to reduce from 19.25% to 70.5% of the features to be classified. This reduction rate is significant in optimally utilizing the computational resources while maintaining the efficiency of the classification performance. IEEE 2021-03-26 Article PeerReviewed pdf en cc_by_4 http://umpir.ump.edu.my/id/eprint/31646/2/An%20enhanced%20hybrid%20feature%20selection%20technique%20using%20term%20frequency-inverse%20document%20frequency%20and%20support%20vector%20machine-recursive%20feature%20elimination%20for%20sentiment%20classification.pdf Nur Syafiqah, Mohd Nafis and Suryanti, Awang (2021) An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification. IEEE Access, 9. pp. 52177-52192. ISSN 2169-3536. (Published) https://doi.org/10.1109/ACCESS.2021.3069001 https://doi.org/10.1109/ACCESS.2021.3069001 |
| spellingShingle | T Technology (General) Nur Syafiqah, Mohd Nafis Suryanti, Awang An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| title | An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| title_full | An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| title_fullStr | An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| title_full_unstemmed | An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| title_short | An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| title_sort | enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification |
| topic | T Technology (General) |
| url | http://umpir.ump.edu.my/id/eprint/31646/ http://umpir.ump.edu.my/id/eprint/31646/ http://umpir.ump.edu.my/id/eprint/31646/ http://umpir.ump.edu.my/id/eprint/31646/2/An%20enhanced%20hybrid%20feature%20selection%20technique%20using%20term%20frequency-inverse%20document%20frequency%20and%20support%20vector%20machine-recursive%20feature%20elimination%20for%20sentiment%20classification.pdf |