English
Related papers

Related papers: Identifying Breakdowns in Conversational Recommend…

200 papers

Simulating human conversations using large language models (LLMs) has emerged as a scalable methodology for modeling human social interaction. However, simulating human conversations is challenging because they inherently involve…

Computation and Language · Computer Science 2026-03-19 Ryo Kamoi , Ameya Godbole , Longqi Yang , Rui Zhang , Mengting Wan , Pei Zhou

Recommender systems research is concerned with many aspects of recommender system behavior and effects than simply its effectiveness, and simulation can be a powerful tool for uncovering these effects. In this brief position paper, I…

Information Retrieval · Computer Science 2021-10-05 Michael D. Ekstrand

Intelligent dialogue systems are expected as a new interface between humans and machines. Such an intelligent dialogue system should estimate the user's internal state (UIS) in dialogues and change its response appropriately according to…

Computation and Language · Computer Science 2020-12-08 Takashi Kodama , Ribeka Tanaka , Sadao Kurohashi

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

Computation and Language · Computer Science 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

Conversational recommender systems (CRS) increasingly rely on user simulators for automated evaluation of sales agents. A key requirement for such simulators is the ability to model human decision-making. However, most existing simulation…

Information Retrieval · Computer Science 2026-05-08 Yuan-Chi Li , Li-Chi Chen , Sung-Yi Wu , Yu-Che Tsai , Shou-De Lin

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

This paper presents Dialogos, a real-time system for human-machine spoken dialogue on the telephone in task-oriented domains. The system has been tested in a large trial with inexperienced users and it has proved robust enough to allow…

A key distinguishing feature of conversational recommender systems over traditional recommender systems is their ability to elicit user preferences using natural language. Currently, the predominant approach to preference elicitation is to…

Information Retrieval · Computer Science 2025-04-09 Ivica Kostric , Krisztian Balog , Filip Radlinski

Using offline datasets to evaluate conversational agents often fails to cover rare scenarios or to support testing new policies. This has motivated the use of controllable user simulators for targeted, counterfactual evaluation, typically…

Artificial Intelligence · Computer Science 2026-05-13 Guy Tennenholtz , Ofer Meshi , Amir Globerson , Uri Shalit , Jihwan Jeong , Craig Boutilier

Simulation has emerged as a popular method to study the long-term societal consequences of recommender systems. This approach allows researchers to specify their theoretical model explicitly and observe the evolution of system-level…

Computers and Society · Computer Science 2021-07-29 Eli Lucherini , Matthew Sun , Amy Winecoff , Arvind Narayanan

Progress in conversational information access (CIA) systems has been hindered by the difficulty of evaluating such systems with reproducible experiments. While user simulation offers a promising solution, the lack of infrastructure and…

Information Retrieval · Computer Science 2025-10-27 Nolwenn Bernard , Sharath Chandra Etagi Suresh , Krisztian Balog , ChengXiang Zhai

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Traditional recommender systems primarily rely on a single type of user-item interaction, such as item purchases or ratings, to predict user preferences. However, in real-world scenarios, users engage in a variety of behaviors, such as…

Information Retrieval · Computer Science 2025-03-11 Kyungho Kim , Sunwoo Kim , Geon Lee , Jinhong Jung , Kijung Shin

Modeling user sequential behaviors has recently attracted increasing attention in the recommendation domain. Existing methods mostly assume coherent preference in the same sequence. However, user personalities are volatile and easily…

Information Retrieval · Computer Science 2022-04-01 Weiqi Shao , Xu Chen , Long Xia , Jiashu Zhao , Dawei Yin

Cyber-physical systems like autonomous vehicles are tested in simulation before deployment, using domain-specific programs for scenario specification. To aid the testing of autonomous vehicles in simulation, we design a natural language…

Computation and Language · Computer Science 2025-09-09 Rimvydas Rubavicius , Antonio Valerio Miceli-Barone , Alex Lascarides , Subramanian Ramamoorthy

Conversational Recommender Systems (CRSs) engage users in multi-turn interactions to deliver personalized recommendations. The emergence of large language models (LLMs) further enhances these systems by enabling more natural and dynamic…

Computation and Language · Computer Science 2025-04-18 Xiaoyan Zhao , Yang Deng , Wenjie Wang , Hongzhan lin , Hong Cheng , Rui Zhang , See-Kiong Ng , Tat-Seng Chua

Conversational Recommender Systems (CRS) provide personalized services through multi-turn interactions, yet most existing methods overlook users' heterogeneous decision-making styles and knowledge levels, which constrains both accuracy and…

Information Retrieval · Computer Science 2025-09-10 Yaying Luo , Hui Fang , Zhu Sun

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

Human-Computer Interaction · Computer Science 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

Many conversational domains require the system to present nuanced information to users. Such systems must follow up what they say to address clarification questions and repair misunderstandings. In this work, we explore this interactive…

Computation and Language · Computer Science 2023-08-04 Baber Khalid , Matthew Stone

Using chatbots to deliver recommendations is increasingly popular. The design of recommendation chatbots has primarily been taking an information-centric approach by focusing on the recommended content per se. Limited attention is on how…

Computation and Language · Computer Science 2022-11-14 Kai-Hui Liang , Weiyan Shi , Yoojung Oh , Hao-Chuan Wang , Jingwen Zhang , Zhou Yu