English
Related papers

Related papers: Evaluating Conversational Recommender Systems via …

200 papers

Traditional offline evaluation methods for recommender systems struggle to capture the complexity of modern platforms due to sparse behavioural signals, noisy data, and limited modelling of user personality traits. While simulation…

Information Retrieval · Computer Science 2025-06-06 Chenglong Ma , Ziqi Xu , Yongli Ren , Danula Hettiachchi , Jeffrey Chan

Preference elicitation plays a central role in interactive recommender systems. Most preference elicitation approaches use either item queries that ask users to select preferred items from a slate, or attribute queries that ask them to…

Information Retrieval · Computer Science 2023-11-07 Erdem Biyik , Fan Yao , Yinlam Chow , Alex Haig , Chih-wei Hsu , Mohammad Ghavamzadeh , Craig Boutilier

Job interviews play a critical role in shaping one's career, yet practicing interview skills can be challenging, especially without access to human coaches or peers for feedback. Recent advancements in large language models (LLMs) present…

Human-Computer Interaction · Computer Science 2024-11-05 Taufiq Daryanto , Xiaohan Ding , Lance T. Wilhelm , Sophia Stil , Kirk McInnis Knutsen , Eugenia H. Rho

Artificial Intelligence is being employed by humans to collaboratively solve complicated tasks for search and rescue, manufacturing, etc. Efficient teamwork can be achieved by understanding user preferences and recommending different…

Information Retrieval · Computer Science 2023-01-20 Lakshita Dodeja , Pradyumna Tambwekar , Erin Hedlund-Botti , Matthew Gombolay

Much of the complexity of Recommender Systems (RSs) comes from the fact that they are used as part of more complex applications and affect user experience through a varied range of user interfaces. However, research focused almost…

Human-in-the-loop topic modelling incorporates users' knowledge into the modelling process, enabling them to refine the model iteratively. Recent research has demonstrated the value of user feedback, but there are still issues to consider,…

Computation and Language · Computer Science 2023-04-05 Zheng Fang , Lama Alqazlan , Du Liu , Yulan He , Rob Procter

Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any…

Information Retrieval · Computer Science 2021-04-29 Zeyang Liu , Ke Zhou , Max L. Wilson

Conversational recommendation systems have recently gain a lot of attention, as users can continuously interact with the system over multiple conversational turns. However, conversational recommendation systems are based on complex neural…

Machine Learning · Computer Science 2020-11-11 Stefanos Antaris , Dimitrios Rafailidis , Mohammad Aliannejadi

The majority of recommendation algorithms are evaluated on the basis of historic benchmark datasets. Evaluation on historic benchmark datasets is quick and cheap to conduct, yet excludes the viewpoint of users who actually consume…

Information Retrieval · Computer Science 2022-12-15 Tobias Eichinger , Ananta Lamichhane

User ratings play a significant role in spoken dialogue systems. Typically, such ratings tend to be averaged across all users and then utilized as feedback to improve the system or personalize its behavior. While this method can be useful…

Computation and Language · Computer Science 2022-06-02 Alexandros Papangelis , Nicole Chartier , Pankaj Rajan , Julia Hirschberg , Dilek Hakkani-Tur

It has been reported that virtual reality can be a useful tool for ergonomics study. The proposed integrated simulation system aims at measuring operator's performance in an interactive way for 2D control panel design. By incorporating some…

Human-Computer Interaction · Computer Science 2007-09-05 Ying Wang , Wei Zhang , Fouad Bennis , Damien Chablat

Modern recommendation systems typically follow two complementary paradigms: collaborative filtering, which models long-term user preferences from historical interactions, and conversational recommendation systems (CRS), which interact with…

Information Retrieval · Computer Science 2025-06-24 Vinaik Chhetri , Yousaf Reza , Moghis Fereidouni , Srijata Maji , Umar Farooq , AB Siddique

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

Human-Computer Interaction · Computer Science 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

Simulation has emerged as a popular method to study the long-term societal consequences of recommender systems. This approach allows researchers to specify their theoretical model explicitly and observe the evolution of system-level…

Computers and Society · Computer Science 2021-07-29 Eli Lucherini , Matthew Sun , Amy Winecoff , Arvind Narayanan

User-machine interaction is crucial for information retrieval, especially for spoken content retrieval, because spoken content is difficult to browse, and speech recognition has a high degree of uncertainty. In interactive retrieval, the…

Computation and Language · Computer Science 2018-04-03 Pei-Hung Chung , Kuan Tung , Ching-Lun Tai , Hung-Yi Lee

User reviews on e-commerce and review sites are crucial for making purchase decisions, although creating detailed reviews is time-consuming and labor-intensive. In this study, we propose a novel use of dialogue systems to facilitate user…

Human-Computer Interaction · Computer Science 2026-03-10 Yoshiki Tanaka , Michimasa Inaba

In online platforms, recommender systems are responsible for directing users to relevant contents. In order to enhance the users' engagement, recommender systems adapt their output to the reactions of the users, who are in turn affected by…

Social and Information Networks · Computer Science 2019-09-10 Wilbert Samuel Rossi , Jan Willem Polderman , Paolo Frasca

AI is promising in assisting UX evaluators with analyzing usability tests, but its judgments are typically presented as non-interactive visualizations. Evaluators may have questions about test recordings, but have no way of asking them.…

Human-Computer Interaction · Computer Science 2023-03-08 Emily Kuang , Ehsan Jahangirzadeh Soure , Mingming Fan , Jian Zhao , Kristen Shinohara

User simulation has long played a vital role in computer science due to its potential to support a wide range of applications. Language, as the primary medium of human communication, forms the foundation of social interaction and behavior.…

We consider interactive tools that help users search for their most preferred item in a large collection of options. In particular, we examine example-critiquing, a technique for enabling users to incrementally construct preference models…

Artificial Intelligence · Computer Science 2011-10-04 B. Faltings , P. Pu , P. Viappiani