The relationship between user perception and user behaviour in interactive information retrieval evaluation
Mengdie Zhuang, Elaine G. Toms, Gianluca Demartini
Published in 8th European Conference on Information Retrieval (ECIR 2016), 2016
Measures of user behaviour and user perception have been used to evaluate interactive information retrieval systems. However, there have been few efforts taken to understand the relationship between these two. In this paper, we investigated both using user actions from log files, and the results of the User Engagement Scale, both of which came from a study of people interacting with a novel interface to an image collection, but with a non-purposeful task. Our results suggest that selected behavioural actions are associated with select- ed user perceptions (i.e., focused attention, felt involvement, and novelty), while typical search and browse actions have no association with aesthetics and perceived usability. This is a novel finding that can lead toward a more system- atic user-centered evaluation.
Recommended citation: Zhuang, M., Toms, E. and Demartini, G. (2016) The Relationship between User Perception and User Behaviour in Interactive Information Retrieval Evaluation. In: Advances in Information Retrieval. 38th European Conference on Information Retrieval, 20 -23 Mar 2016, Padua, Italy. Lecture Notes in Computer Science. Springer International Publishing , pp. 293-305.