Layered evaluation in recommender systems: A retrospective assessment
Evaluation of recommender systems has only lately started to become more systematic, since the emphasis has long been on the experimental evaluation of algorithmic performance. Recent studies have proposed adopting a layered evaluation approach, according to which recommender systems may be decompos...
| Main Authors: | , , |
|---|---|
| Format: | Journal Article |
| Published: |
2014
|
| Online Access: | https://www.editlib.org/p/148267 http://hdl.handle.net/20.500.11937/38553 |
| _version_ | 1848755351116054528 |
|---|---|
| author | Manouselis, N. Karagiannidis, C. Sampson, Demetrios |
| author_facet | Manouselis, N. Karagiannidis, C. Sampson, Demetrios |
| author_sort | Manouselis, N. |
| building | Curtin Institutional Repository |
| collection | Online Access |
| description | Evaluation of recommender systems has only lately started to become more systematic, since the emphasis has long been on the experimental evaluation of algorithmic performance. Recent studies have proposed adopting a layered evaluation approach, according to which recommender systems may be decomposed into several components, evaluating each of them separately. Nevertheless, there are still no evaluation studies of recommender systems that apply a layered evaluation framework to explore how all the different components or layers of such a system may be assessed. This paper introduces layered evaluation and examines how a previously proposed layered evaluation framework for adaptive systems can be applied in the case of recommender systems. It presents the possible adaptation of this layered framework that may fit the interaction components of recommender systems. Then, it focuses on a specific recommender system and carries out a retrospective analysis of its past evaluation results under the new prism that the layered evaluation approach brings. Our analysis indicates that implementing a layeredbased evaluation of recommender systems has the potential to facilitate a more detailed and informed evaluation of such systems, allowing researchers and developers to better understand how to improve them. |
| first_indexed | 2025-11-14T08:54:55Z |
| format | Journal Article |
| id | curtin-20.500.11937-38553 |
| institution | Curtin University Malaysia |
| institution_category | Local University |
| last_indexed | 2025-11-14T08:54:55Z |
| publishDate | 2014 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | curtin-20.500.11937-385532017-01-30T14:23:00Z Layered evaluation in recommender systems: A retrospective assessment Manouselis, N. Karagiannidis, C. Sampson, Demetrios Evaluation of recommender systems has only lately started to become more systematic, since the emphasis has long been on the experimental evaluation of algorithmic performance. Recent studies have proposed adopting a layered evaluation approach, according to which recommender systems may be decomposed into several components, evaluating each of them separately. Nevertheless, there are still no evaluation studies of recommender systems that apply a layered evaluation framework to explore how all the different components or layers of such a system may be assessed. This paper introduces layered evaluation and examines how a previously proposed layered evaluation framework for adaptive systems can be applied in the case of recommender systems. It presents the possible adaptation of this layered framework that may fit the interaction components of recommender systems. Then, it focuses on a specific recommender system and carries out a retrospective analysis of its past evaluation results under the new prism that the layered evaluation approach brings. Our analysis indicates that implementing a layeredbased evaluation of recommender systems has the potential to facilitate a more detailed and informed evaluation of such systems, allowing researchers and developers to better understand how to improve them. 2014 Journal Article http://hdl.handle.net/20.500.11937/38553 https://www.editlib.org/p/148267 restricted |
| spellingShingle | Manouselis, N. Karagiannidis, C. Sampson, Demetrios Layered evaluation in recommender systems: A retrospective assessment |
| title | Layered evaluation in recommender systems: A retrospective assessment |
| title_full | Layered evaluation in recommender systems: A retrospective assessment |
| title_fullStr | Layered evaluation in recommender systems: A retrospective assessment |
| title_full_unstemmed | Layered evaluation in recommender systems: A retrospective assessment |
| title_short | Layered evaluation in recommender systems: A retrospective assessment |
| title_sort | layered evaluation in recommender systems: a retrospective assessment |
| url | https://www.editlib.org/p/148267 http://hdl.handle.net/20.500.11937/38553 |