Applying semantic similarity measures to enhance topic-specific web crawling
As the Internet grows rapidly, finding desirable information becomes a tedious and time consuming task. Topic-specific web crawlers, as utopian solutions, tackle this issue through traversing the Web and collecting information related to the topic of interest. In this regard, various methods are pro...
| Main Authors: | , , |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
IEEE (IEEEXplore)
2013
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/41318/ |
| _version_ | 1848849663325634560 |
|---|---|
| author | Pesaranghader, Ali Mustapha, Norwati Pesaranghader, Ahmad |
| author_facet | Pesaranghader, Ali Mustapha, Norwati Pesaranghader, Ahmad |
| author_sort | Pesaranghader, Ali |
| building | UPM Institutional Repository |
| collection | Online Access |
| description | As the Internet grows rapidly, finding desirable information becomes a tedious and time consuming task. Topic-specific web crawlers, as utopian solutions, tackle this issue through traversing the Web and collecting information related to the topic of interest. In this regard, various methods are proposed. Nevertheless, they hardly consider desired sense of the given topic which would certainly play an important role to find relevant web pages. In this paper, we attempt to improve topic-specific web crawling by disambiguating the sense of the topic. This would avoid crawling irrelevant links interlaced with other senses of the topic. For this purpose, by considering links hypertext semantic, we employ Lin semantic similarity measure in our crawler, named LinCrawler, to distinguish topic sense-related links from the others. Moreover, we compare LinCrawler against TFCrawler which only considers frequency of terms in hypertexts. Experimental results show LinCrawler outperforms TFCrawler to collect more relevant web pages. |
| first_indexed | 2025-11-15T09:53:58Z |
| format | Conference or Workshop Item |
| id | upm-41318 |
| institution | Universiti Putra Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-15T09:53:58Z |
| publishDate | 2013 |
| publisher | IEEE (IEEEXplore) |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | upm-413182015-11-03T08:41:17Z http://psasir.upm.edu.my/id/eprint/41318/ Applying semantic similarity measures to enhance topic-specific web crawling Pesaranghader, Ali Mustapha, Norwati Pesaranghader, Ahmad As the Internet grows rapidly, finding desirable information becomes a tedious and time consuming task. Topic-specific web crawlers, as utopian solutions, tackle this issue through traversing the Web and collecting information related to the topic of interest. In this regard, various methods are proposed. Nevertheless, they hardly consider desired sense of the given topic which would certainly play an important role to find relevant web pages. In this paper, we attempt to improve topic-specific web crawling by disambiguating the sense of the topic. This would avoid crawling irrelevant links interlaced with other senses of the topic. For this purpose, by considering links hypertext semantic, we employ Lin semantic similarity measure in our crawler, named LinCrawler, to distinguish topic sense-related links from the others. Moreover, we compare LinCrawler against TFCrawler which only considers frequency of terms in hypertexts. Experimental results show LinCrawler outperforms TFCrawler to collect more relevant web pages. IEEE (IEEEXplore) 2013 Conference or Workshop Item NonPeerReviewed Pesaranghader, Ali and Mustapha, Norwati and Pesaranghader, Ahmad (2013) Applying semantic similarity measures to enhance topic-specific web crawling. In: 2013 13th International Conference on Intelligent Systems Design and Applications (ISDA), 8-10 Dec. 2013, Bangi, Selangor, Malaysia. (pp. 205-212). 10.1109/ISDA.2013.6920736 |
| spellingShingle | Pesaranghader, Ali Mustapha, Norwati Pesaranghader, Ahmad Applying semantic similarity measures to enhance topic-specific web crawling |
| title | Applying semantic similarity measures to enhance topic-specific web crawling |
| title_full | Applying semantic similarity measures to enhance topic-specific web crawling |
| title_fullStr | Applying semantic similarity measures to enhance topic-specific web crawling |
| title_full_unstemmed | Applying semantic similarity measures to enhance topic-specific web crawling |
| title_short | Applying semantic similarity measures to enhance topic-specific web crawling |
| title_sort | applying semantic similarity measures to enhance topic-specific web crawling |
| url | http://psasir.upm.edu.my/id/eprint/41318/ http://psasir.upm.edu.my/id/eprint/41318/ |