Does document relevance affect the searcher's perception 0f time?
Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' effor...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
2017
|
| Online Access: | https://eprints.nottingham.ac.uk/45049/ |
| _version_ | 1848797057671757824 |
|---|---|
| author | Luo, Cheng Liu, Yiqun Sakai, Tetsuya Zhou, Ke Zhang, Fan Li, Xue Ma, Shaoping |
| author_facet | Luo, Cheng Liu, Yiqun Sakai, Tetsuya Zhou, Ke Zhang, Fan Li, Xue Ma, Shaoping |
| author_sort | Luo, Cheng |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' efforts in search processes. Psychological studies have reported that the time perception of human beings can be affected by many stimuli, such as attention and motivation, which are closely related to many cognitive factors in search. Considering the fact that users' search experiences are affected by their subjective feelings of time, rather than the objective time measured by timing devices, it is necessary to look into the different factors that have impacts on search users' perception of time. In this work, we make a first step towards revealing the time perception mechanism of search users with the following contributions: (1) We establish an experimental research framework to measure the subjective perception of time while reading documents in search scenario, which originates from but is also different from traditional time perception measurements in psychological studies. (2) With the framework, we show that while users are reading result documents, document relevance has small yet visible effect on search users' perception of time. By further examining the impact of other factors, we demonstrate that the effect on relevant documents can also be influenced by individuals and tasks. (3) We conduct a preliminary experiment in which the difference between perceived time and dwell time is taken into consideration in a search evaluation task. We found that the revised framework achieved a better correlation with users' satisfaction feedbacks. This work may help us better understand the time perception mechanism of search users and provide insights in how to better incorporate time factor in search evaluation studies. |
| first_indexed | 2025-11-14T19:57:49Z |
| format | Conference or Workshop Item |
| id | nottingham-45049 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| last_indexed | 2025-11-14T19:57:49Z |
| publishDate | 2017 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-450492020-05-04T18:36:09Z https://eprints.nottingham.ac.uk/45049/ Does document relevance affect the searcher's perception 0f time? Luo, Cheng Liu, Yiqun Sakai, Tetsuya Zhou, Ke Zhang, Fan Li, Xue Ma, Shaoping Time plays an essential role in multiple areas of Information Retrieval (IR) studies such as search evaluation, user behavior analysis, temporal search result ranking and query understanding. Especially, in search evaluation studies, time is usually adopted as a measure to quantify users' efforts in search processes. Psychological studies have reported that the time perception of human beings can be affected by many stimuli, such as attention and motivation, which are closely related to many cognitive factors in search. Considering the fact that users' search experiences are affected by their subjective feelings of time, rather than the objective time measured by timing devices, it is necessary to look into the different factors that have impacts on search users' perception of time. In this work, we make a first step towards revealing the time perception mechanism of search users with the following contributions: (1) We establish an experimental research framework to measure the subjective perception of time while reading documents in search scenario, which originates from but is also different from traditional time perception measurements in psychological studies. (2) With the framework, we show that while users are reading result documents, document relevance has small yet visible effect on search users' perception of time. By further examining the impact of other factors, we demonstrate that the effect on relevant documents can also be influenced by individuals and tasks. (3) We conduct a preliminary experiment in which the difference between perceived time and dwell time is taken into consideration in a search evaluation task. We found that the revised framework achieved a better correlation with users' satisfaction feedbacks. This work may help us better understand the time perception mechanism of search users and provide insights in how to better incorporate time factor in search evaluation studies. 2017-02-02 Conference or Workshop Item PeerReviewed Luo, Cheng, Liu, Yiqun, Sakai, Tetsuya, Zhou, Ke, Zhang, Fan, Li, Xue and Ma, Shaoping (2017) Does document relevance affect the searcher's perception 0f time? In: 10th ACM International Conference on Web Search and Data Mining, 6-10 February 2017, Cambridge, UK. https://doi.org/10.1145/3018661.3018694 10.1145/3018661.3018694 10.1145/3018661.3018694 10.1145/3018661.3018694 |
| spellingShingle | Luo, Cheng Liu, Yiqun Sakai, Tetsuya Zhou, Ke Zhang, Fan Li, Xue Ma, Shaoping Does document relevance affect the searcher's perception 0f time? |
| title | Does document relevance affect the searcher's perception 0f time? |
| title_full | Does document relevance affect the searcher's perception 0f time? |
| title_fullStr | Does document relevance affect the searcher's perception 0f time? |
| title_full_unstemmed | Does document relevance affect the searcher's perception 0f time? |
| title_short | Does document relevance affect the searcher's perception 0f time? |
| title_sort | does document relevance affect the searcher's perception 0f time? |
| url | https://eprints.nottingham.ac.uk/45049/ https://eprints.nottingham.ac.uk/45049/ https://eprints.nottingham.ac.uk/45049/ |