Impact of Consuming Suggested Items on the Assessment of Recommendations in User Studies on Recommender Systems
Sarit Kraus (Hrsg). Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence IJCAI 2019; Macao, 10-16 August 2019. Darmstadt: International Joint Conferences on Artificial Intelligence 2019 S. 6201 - 6205
Erscheinungsjahr: 2019
ISBN/ISSN: 978-0-9992411-4-1
Publikationstyp: Diverses (Konferenzbeitrag)
Sprache: Deutsch
Doi/URN: 10.24963/ijcai.2019/863
Inhaltszusammenfassung
User studies are increasingly considered important in research on recommender systems. Although participants typically cannot consume any of the recommended items, they are often asked to assess the quality of recommendations and of other aspects related to user experience by means of questionnaires. Not being able to listen to recommended songs or to watch suggested movies, might however limit the validity of the obtained results. Consequently, we have investigated the effect of consuming su...User studies are increasingly considered important in research on recommender systems. Although participants typically cannot consume any of the recommended items, they are often asked to assess the quality of recommendations and of other aspects related to user experience by means of questionnaires. Not being able to listen to recommended songs or to watch suggested movies, might however limit the validity of the obtained results. Consequently, we have investigated the effect of consuming suggested items. In two user studies conducted in different domains, we showed that consumption may lead to differences in the assessment of recommendations and in questionnaire answers. Apparently, adequately measuring user experience is in some cases not possible without allowing users to consume items. On the other hand, participants sometimes seem to approximate the actual value of recommendations reasonably well depending on domain and provided information.» weiterlesen» einklappen