(1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval

In many contexts of Information Retrieval (IR), term weights play an important role in retrieving the relevant documents responding to users' queries. The term weight measures the importance or the information content of a keyword existing in the documents in the IR system. The term weight can...

Full description

Bibliographic Details
Main Authors: Ibrahim, Osman Ali Sadek, Landa-Silva, Dario
Other Authors: Angelov, Plamen
Format: Book Section
Published: Springer 2016
Online Access:https://eprints.nottingham.ac.uk/35587/
_version_ 1848795114733830144
author Ibrahim, Osman Ali Sadek
Landa-Silva, Dario
author2 Angelov, Plamen
author_facet Angelov, Plamen
Ibrahim, Osman Ali Sadek
Landa-Silva, Dario
author_sort Ibrahim, Osman Ali Sadek
building Nottingham Research Data Repository
collection Online Access
description In many contexts of Information Retrieval (IR), term weights play an important role in retrieving the relevant documents responding to users' queries. The term weight measures the importance or the information content of a keyword existing in the documents in the IR system. The term weight can be divided into two parts, the Global Term Weight (GTW) and the Local Term Weight (LTW). The GTW is a value assigned to each index term to indicate the topic of the documents. It has the discrimination value of the term to discriminate between documents in the same collection. The LTW is a value that measures the contribution of the index term in the document. This paper proposes an approach, based on an evolutionary gradient strategy, for evolving the Global Term Weights (GTWs) of the collection and using Term Frequency-Average Term Occurrence (TF-ATO) as the Local Term Weights (LTWs). This approach reduces the problem size for the term weights evolution which reduces the computational time helping to achieve an improved IR effectiveness compared to other Evolutionary Computation (EC) approaches in the literature. The paper also investigates the limitation that the relevance judgment can have in this approach by conducting two sets of experiments, for partially and fully evolved GTWs. The proposed approach outperformed the Okapi BM25 and TF-ATO with DA weighting schemes methods in terms of Mean Average Precision (MAP), Average Precision (AP) and Normalized Discounted Cumulative Gain (NDCG).
first_indexed 2025-11-14T19:26:57Z
format Book Section
id nottingham-35587
institution University of Nottingham Malaysia Campus
institution_category Local University
last_indexed 2025-11-14T19:26:57Z
publishDate 2016
publisher Springer
recordtype eprints
repository_type Digital Repository
spelling nottingham-355872020-05-04T18:13:10Z https://eprints.nottingham.ac.uk/35587/ (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval Ibrahim, Osman Ali Sadek Landa-Silva, Dario In many contexts of Information Retrieval (IR), term weights play an important role in retrieving the relevant documents responding to users' queries. The term weight measures the importance or the information content of a keyword existing in the documents in the IR system. The term weight can be divided into two parts, the Global Term Weight (GTW) and the Local Term Weight (LTW). The GTW is a value assigned to each index term to indicate the topic of the documents. It has the discrimination value of the term to discriminate between documents in the same collection. The LTW is a value that measures the contribution of the index term in the document. This paper proposes an approach, based on an evolutionary gradient strategy, for evolving the Global Term Weights (GTWs) of the collection and using Term Frequency-Average Term Occurrence (TF-ATO) as the Local Term Weights (LTWs). This approach reduces the problem size for the term weights evolution which reduces the computational time helping to achieve an improved IR effectiveness compared to other Evolutionary Computation (EC) approaches in the literature. The paper also investigates the limitation that the relevance judgment can have in this approach by conducting two sets of experiments, for partially and fully evolved GTWs. The proposed approach outperformed the Okapi BM25 and TF-ATO with DA weighting schemes methods in terms of Mean Average Precision (MAP), Average Precision (AP) and Normalized Discounted Cumulative Gain (NDCG). Springer Angelov, Plamen Gegov, Alexander Jayne, Chrisina Shen, Qiang 2016-09-07 Book Section PeerReviewed Ibrahim, Osman Ali Sadek and Landa-Silva, Dario (2016) (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval. In: Advances in computational intelligence systems: contributions presented at the 16th UK Workshop on Computational Intelligence, September 7–9, 2016, Lancaster, UK. Advances in intelligent systems and computing (513). Springer, Cham, pp. 387-405. ISBN 9783319465616 http://link.springer.com/chapter/10.1007/978-3-319-46562-3_25 doi:10.1007/978-3-319-46562-3_25 doi:10.1007/978-3-319-46562-3_25
spellingShingle Ibrahim, Osman Ali Sadek
Landa-Silva, Dario
(1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
title (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
title_full (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
title_fullStr (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
title_full_unstemmed (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
title_short (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
title_sort (1+1)-evolutionary gradient strategy to evolve global term weights in information retrieval
url https://eprints.nottingham.ac.uk/35587/
https://eprints.nottingham.ac.uk/35587/
https://eprints.nottingham.ac.uk/35587/