Combination of semantic word similarity metrics in video retrieval

Multimedia Information Retrieval is one of the most challenging issues. Search for knowledge in the form of video is the main focus of this study. In recent years, there has been a tremendous need to query and process large amount of video data that cannot be easily described. There is a mismatch be...

Full description

Bibliographic Details
Main Authors: Memar, Sara, Affendey, Lilly Suriani, Mustapha, Norwati, C. Doraisamy, Shyamala
Format: Article
Language:English
Published: Praise Worthy Prize 2011
Online Access:http://psasir.upm.edu.my/id/eprint/22464/
http://psasir.upm.edu.my/id/eprint/22464/1/Combination%20of%20semantic%20word%20similarity%20metrics%20in%20video%20retrieval.pdf
_version_ 1848844491755094016
author Memar, Sara
Affendey, Lilly Suriani
Mustapha, Norwati
C. Doraisamy, Shyamala
author_facet Memar, Sara
Affendey, Lilly Suriani
Mustapha, Norwati
C. Doraisamy, Shyamala
author_sort Memar, Sara
building UPM Institutional Repository
collection Online Access
description Multimedia Information Retrieval is one of the most challenging issues. Search for knowledge in the form of video is the main focus of this study. In recent years, there has been a tremendous need to query and process large amount of video data that cannot be easily described. There is a mismatch between the low-level interpretation of video frames and the way users express their information needs. This issue leads to the problem named semantic gap. To bridge semantic gap, concept-based video retrieval has been considered as a feasible alternative technique for video search. In order to retrieve a desirable video shot, a query should be defined based on users’ needs. In spite of the fact that query can be on object, motion, texture, color and so on, queries which are expressed in terms of semantic concepts are more intuitive and realistic for end users. Therefore, a concept-based video retrieval model based on the combination of the knowledge-based and corpus-based semantic word similarity measures is proposed with respect to bridging semantic gap and supporting semantic queries. In this study, Latent Semantic Analysis (LSA) which is a corpus-based semantic similarity measure is compared to previously utilized corpus-based measures. In addition, we experiment a combination of LSA with a knowledge-based semantic similarity measure in order to improve the retrieval effectiveness. For evaluation purpose, TRECVID 2005 dataset is utilized as well. As experimental results show, combination of knowledge-based and corpus-based outperforms individual one with MAP of 16.29%.
first_indexed 2025-11-15T08:31:46Z
format Article
id upm-22464
institution Universiti Putra Malaysia
institution_category Local University
language English
last_indexed 2025-11-15T08:31:46Z
publishDate 2011
publisher Praise Worthy Prize
recordtype eprints
repository_type Digital Repository
spelling upm-224642016-06-08T09:00:44Z http://psasir.upm.edu.my/id/eprint/22464/ Combination of semantic word similarity metrics in video retrieval Memar, Sara Affendey, Lilly Suriani Mustapha, Norwati C. Doraisamy, Shyamala Multimedia Information Retrieval is one of the most challenging issues. Search for knowledge in the form of video is the main focus of this study. In recent years, there has been a tremendous need to query and process large amount of video data that cannot be easily described. There is a mismatch between the low-level interpretation of video frames and the way users express their information needs. This issue leads to the problem named semantic gap. To bridge semantic gap, concept-based video retrieval has been considered as a feasible alternative technique for video search. In order to retrieve a desirable video shot, a query should be defined based on users’ needs. In spite of the fact that query can be on object, motion, texture, color and so on, queries which are expressed in terms of semantic concepts are more intuitive and realistic for end users. Therefore, a concept-based video retrieval model based on the combination of the knowledge-based and corpus-based semantic word similarity measures is proposed with respect to bridging semantic gap and supporting semantic queries. In this study, Latent Semantic Analysis (LSA) which is a corpus-based semantic similarity measure is compared to previously utilized corpus-based measures. In addition, we experiment a combination of LSA with a knowledge-based semantic similarity measure in order to improve the retrieval effectiveness. For evaluation purpose, TRECVID 2005 dataset is utilized as well. As experimental results show, combination of knowledge-based and corpus-based outperforms individual one with MAP of 16.29%. Praise Worthy Prize 2011 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/22464/1/Combination%20of%20semantic%20word%20similarity%20metrics%20in%20video%20retrieval.pdf Memar, Sara and Affendey, Lilly Suriani and Mustapha, Norwati and C. Doraisamy, Shyamala (2011) Combination of semantic word similarity metrics in video retrieval. International Review on Computers and Software, 6 (3). pp. 299-305. ISSN 1828-6003; ESSN: 1828-6011 http://www.praiseworthyprize.org/latest_issues/IRECOS-latest/IRECOS_vol_6_n_3.html#Combination_of_Semantic_Word_Similarity_Metrics_in_Video_Retrieval_
spellingShingle Memar, Sara
Affendey, Lilly Suriani
Mustapha, Norwati
C. Doraisamy, Shyamala
Combination of semantic word similarity metrics in video retrieval
title Combination of semantic word similarity metrics in video retrieval
title_full Combination of semantic word similarity metrics in video retrieval
title_fullStr Combination of semantic word similarity metrics in video retrieval
title_full_unstemmed Combination of semantic word similarity metrics in video retrieval
title_short Combination of semantic word similarity metrics in video retrieval
title_sort combination of semantic word similarity metrics in video retrieval
url http://psasir.upm.edu.my/id/eprint/22464/
http://psasir.upm.edu.my/id/eprint/22464/
http://psasir.upm.edu.my/id/eprint/22464/1/Combination%20of%20semantic%20word%20similarity%20metrics%20in%20video%20retrieval.pdf