Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis
Sentiment analysis plays a crucial role in assessing public perception across various sectors, including the high-rise property industry. Understanding public sentiment provides essential insights for stakeholders, enabling data-driven and informed decision-making. This study examines the applicabil...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IADITI - International Association for Digital Transformation and Technological Innovation
2025
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/43834/ http://umpir.ump.edu.my/id/eprint/43834/1/Battle%20of%20sentiment%20lexicons_Wordnet%2C%20sentiwordnet%2C%20textblob%20and%20vader%20in%20web%20forum%20analysis.pdf |
| _version_ | 1848826970523041792 |
|---|---|
| author | Ahmad Taufik, Nursal Mohd Faizal, Omar Mohd Nasrun, Mohd Nawi Mohamad Sukeri, Khalid Mohd Hanizun, Hanafi Rafikullah, Deraman |
| author_facet | Ahmad Taufik, Nursal Mohd Faizal, Omar Mohd Nasrun, Mohd Nawi Mohamad Sukeri, Khalid Mohd Hanizun, Hanafi Rafikullah, Deraman |
| author_sort | Ahmad Taufik, Nursal |
| building | UMP Institutional Repository |
| collection | Online Access |
| description | Sentiment analysis plays a crucial role in assessing public perception across various sectors, including the high-rise property industry. Understanding public sentiment provides essential insights for stakeholders, enabling data-driven and informed decision-making. This study examines the applicability and effectiveness of lexicon-based sentiment analysis tools in measuring public sentiment toward high-rise properties in Malaysia. Objectives: The study aims to investigate the effectiveness of four lexicon-based sentiment analysis tools, namely WordNet, TextBlob, SentiWordNet, and Valence Aware Dictionary and Sentiment Reasoner (VADER). It seeks to evaluate their classification performance and accuracy in identifying positive, negative, and neutral sentiments expressed in public reviews. Methods: The research employed a real-world case study to analyze public sentiment toward high-rise properties. Reviews were classified using the four lexicon dictionaries, and their performance was assessed by comparing their ability to identify positive, negative, and neutral sentiments. Results: The analysis revealed that all four lexicon-based tools identified a higher proportion of positive reviews than negative or neutral ones. WordNet recorded the largest number of positive sentiments, closely followed by SentiWordNet and VADER. When identifying negative sentiments, VADER emerged as the most effective, followed by WordNet and SentiWordNet. For neutral sentiments, VADER detected the highest number of reviews, while SentiWordNet and WordNet identified fewer instances. Overall, VADER demonstrated superior performance compared to the other tools. However, the study also highlighted limitations in VADER’s performance, such as restricted vocabulary, difficulty in detecting sarcasm, ambiguity, and challenges with misspelled or short terms, which occasionally led to misclassifications. Conclusions: This study provides valuable insights for researchers, practitioners, and policymakers involved in analyzing public sentiment toward high-rise properties in Malaysia. By understanding the strengths and limitations of lexicon-based sentiment analysis tools, stakeholders can enhance their decision-making processes through more precise sentiment classification Copyright © 2024 by Author/s and Licensed by JISEM. |
| first_indexed | 2025-11-15T03:53:17Z |
| format | Article |
| id | ump-43834 |
| institution | Universiti Malaysia Pahang |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-15T03:53:17Z |
| publishDate | 2025 |
| publisher | IADITI - International Association for Digital Transformation and Technological Innovation |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | ump-438342025-02-17T08:04:07Z http://umpir.ump.edu.my/id/eprint/43834/ Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis Ahmad Taufik, Nursal Mohd Faizal, Omar Mohd Nasrun, Mohd Nawi Mohamad Sukeri, Khalid Mohd Hanizun, Hanafi Rafikullah, Deraman HD28 Management. Industrial Management T Technology (General) Sentiment analysis plays a crucial role in assessing public perception across various sectors, including the high-rise property industry. Understanding public sentiment provides essential insights for stakeholders, enabling data-driven and informed decision-making. This study examines the applicability and effectiveness of lexicon-based sentiment analysis tools in measuring public sentiment toward high-rise properties in Malaysia. Objectives: The study aims to investigate the effectiveness of four lexicon-based sentiment analysis tools, namely WordNet, TextBlob, SentiWordNet, and Valence Aware Dictionary and Sentiment Reasoner (VADER). It seeks to evaluate their classification performance and accuracy in identifying positive, negative, and neutral sentiments expressed in public reviews. Methods: The research employed a real-world case study to analyze public sentiment toward high-rise properties. Reviews were classified using the four lexicon dictionaries, and their performance was assessed by comparing their ability to identify positive, negative, and neutral sentiments. Results: The analysis revealed that all four lexicon-based tools identified a higher proportion of positive reviews than negative or neutral ones. WordNet recorded the largest number of positive sentiments, closely followed by SentiWordNet and VADER. When identifying negative sentiments, VADER emerged as the most effective, followed by WordNet and SentiWordNet. For neutral sentiments, VADER detected the highest number of reviews, while SentiWordNet and WordNet identified fewer instances. Overall, VADER demonstrated superior performance compared to the other tools. However, the study also highlighted limitations in VADER’s performance, such as restricted vocabulary, difficulty in detecting sarcasm, ambiguity, and challenges with misspelled or short terms, which occasionally led to misclassifications. Conclusions: This study provides valuable insights for researchers, practitioners, and policymakers involved in analyzing public sentiment toward high-rise properties in Malaysia. By understanding the strengths and limitations of lexicon-based sentiment analysis tools, stakeholders can enhance their decision-making processes through more precise sentiment classification Copyright © 2024 by Author/s and Licensed by JISEM. IADITI - International Association for Digital Transformation and Technological Innovation 2025 Article PeerReviewed pdf en cc_by_4 http://umpir.ump.edu.my/id/eprint/43834/1/Battle%20of%20sentiment%20lexicons_Wordnet%2C%20sentiwordnet%2C%20textblob%20and%20vader%20in%20web%20forum%20analysis.pdf Ahmad Taufik, Nursal and Mohd Faizal, Omar and Mohd Nasrun, Mohd Nawi and Mohamad Sukeri, Khalid and Mohd Hanizun, Hanafi and Rafikullah, Deraman (2025) Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis. Journal of Information Systems Engineering and Management, 10. pp. 84-93. ISSN 2468-4376. (Published) https://doi.org/10.52783/jisem.v10i2s.203 https://doi.org/10.52783/jisem.v10i2s.203 |
| spellingShingle | HD28 Management. Industrial Management T Technology (General) Ahmad Taufik, Nursal Mohd Faizal, Omar Mohd Nasrun, Mohd Nawi Mohamad Sukeri, Khalid Mohd Hanizun, Hanafi Rafikullah, Deraman Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis |
| title | Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis |
| title_full | Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis |
| title_fullStr | Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis |
| title_full_unstemmed | Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis |
| title_short | Battle of sentiment lexicons: Wordnet, sentiwordnet, textblob and vader in web forum analysis |
| title_sort | battle of sentiment lexicons: wordnet, sentiwordnet, textblob and vader in web forum analysis |
| topic | HD28 Management. Industrial Management T Technology (General) |
| url | http://umpir.ump.edu.my/id/eprint/43834/ http://umpir.ump.edu.my/id/eprint/43834/ http://umpir.ump.edu.my/id/eprint/43834/ http://umpir.ump.edu.my/id/eprint/43834/1/Battle%20of%20sentiment%20lexicons_Wordnet%2C%20sentiwordnet%2C%20textblob%20and%20vader%20in%20web%20forum%20analysis.pdf |