Position score weighting technique for mining web content outliers.
The existing mining web content outlier methods used stemming algorithm to preprocess the web documents and leave the domain dictionary in their root words. The stemming algorithm was usually used to reduce derived words to their stem, base or root form. The stemming algorithm sometimes does not lea...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
CESER Publications
2013
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/30631/ http://psasir.upm.edu.my/id/eprint/30631/1/Position%20score%20weighting%20technique%20for%20mining%20web%20content%20outliers.pdf |
| _version_ | 1848846732929007616 |
|---|---|
| author | Mustapha, Norwati Mustapha, Aida |
| author_facet | Mustapha, Norwati Mustapha, Aida |
| author_sort | Mustapha, Norwati |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | The existing mining web content outlier methods used stemming algorithm to preprocess the web documents and leave the domain dictionary in their root words. The stemming algorithm was usually used to reduce derived words to their stem, base or root form. The stemming algorithm sometimes does not leave a real word after removing the stem and it caused a problem to match words in the full word profile with the domain dictionary. Therefore this study uses stemmed domain dictionary and applies it with Term Frequency with Position Score (TF.PS) weighting technique which is derived from TF.IDF weighting technique from Information Retrieval (IR) in dissimilarity measure phase to see the efficiency of these technique for determining the outliers in the web content. The dataset is from The 20 Newsgroups Dataset. The result for stemmed domain dictionary with TF.PS weighting technique achieves up to 98.19% of accuracy and 90% of F1-Measure which is higher than previous techniques. |
| first_indexed | 2025-11-15T09:07:24Z |
| format | Article |
| id | upm-30631 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| language | English English |
| last_indexed | 2025-11-15T09:07:24Z |
| publishDate | 2013 |
| publisher | CESER Publications |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-306312015-10-08T06:52:10Z http://psasir.upm.edu.my/id/eprint/30631/ Position score weighting technique for mining web content outliers. Mustapha, Norwati Mustapha, Aida The existing mining web content outlier methods used stemming algorithm to preprocess the web documents and leave the domain dictionary in their root words. The stemming algorithm was usually used to reduce derived words to their stem, base or root form. The stemming algorithm sometimes does not leave a real word after removing the stem and it caused a problem to match words in the full word profile with the domain dictionary. Therefore this study uses stemmed domain dictionary and applies it with Term Frequency with Position Score (TF.PS) weighting technique which is derived from TF.IDF weighting technique from Information Retrieval (IR) in dissimilarity measure phase to see the efficiency of these technique for determining the outliers in the web content. The dataset is from The 20 Newsgroups Dataset. The result for stemmed domain dictionary with TF.PS weighting technique achieves up to 98.19% of accuracy and 90% of F1-Measure which is higher than previous techniques. CESER Publications 2013 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/30631/1/Position%20score%20weighting%20technique%20for%20mining%20web%20content%20outliers.pdf Mustapha, Norwati and Mustapha, Aida (2013) Position score weighting technique for mining web content outliers. International Journal of Applied Mathematics and Statistics, 36 (6). pp. 77-86. ISSN 0973-7545 http://www.ceser.in/ceserp/index.php/ijamas/issue/view/180 English |
| spellingShingle | Mustapha, Norwati Mustapha, Aida Position score weighting technique for mining web content outliers. |
| title | Position score weighting technique for mining web content outliers. |
| title_full | Position score weighting technique for mining web content outliers. |
| title_fullStr | Position score weighting technique for mining web content outliers. |
| title_full_unstemmed | Position score weighting technique for mining web content outliers. |
| title_short | Position score weighting technique for mining web content outliers. |
| title_sort | position score weighting technique for mining web content outliers. |
| url | http://psasir.upm.edu.my/id/eprint/30631/ http://psasir.upm.edu.my/id/eprint/30631/ http://psasir.upm.edu.my/id/eprint/30631/1/Position%20score%20weighting%20technique%20for%20mining%20web%20content%20outliers.pdf |