English
Related papers

Related papers: UserSimCRS: A User Simulation Toolkit for Evaluati…

200 papers

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

This survey aims at providing a comprehensive overview of the recent trends in the field of modeling and simulation (M&S) of interactions between users and recommender systems and applications of the M&S to the performance improvement of…

Conversational recommender systems (CRSs) provide users with an interactive means to express preferences and receive real-time personalized recommendations. The success of these systems is heavily influenced by the preference elicitation…

Human-Computer Interaction · Computer Science 2025-04-22 Ivica Kostric , Krisztian Balog , Ujwal Gadiraju

There is growing interest in exploring user simulation as an alternative to gathering and scoring real user-chatbot interactions for AI chatbot evaluation. For this purpose, it is important to ensure the realism of the simulation, i.e., the…

Computation and Language · Computer Science 2026-05-05 Yu Lu Liu , Hyokun Yun , Tanya Roosta , Ziang Xiao

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

User Simulators are one of the major tools that enable offline training of task-oriented dialogue systems. For this task the Agenda-Based User Simulator (ABUS) is often used. The ABUS is based on hand-crafted rules and its output is in…

Computation and Language · Computer Science 2018-05-21 Florian Kreyssig , Inigo Casanueva , Pawel Budzianowski , Milica Gasic

Due to the advantages in the cost-efficiency and reproducibility, user simulation has become a promising solution to the user-centric evaluation of information retrieval systems. Nonetheless, accurately simulating user search behaviors has…

Information Retrieval · Computer Science 2024-10-30 Erhan Zhang , Xingzhu Wang , Peiyuan Gong , Yankai Lin , Jiaxin Mao

The conversational recommender systems (CRSs) have received extensive attention in recent years. However, most of the existing works focus on various deep learning models, which are largely limited by the requirement of large-scale…

Information Retrieval · Computer Science 2022-03-21 Jun Quan , Ze Wei , Qiang Gan , Jingqi Yao , Jingyi Lu , Yuchen Dong , Yiming Liu , Yi Zeng , Chao Zhang , Yongzhi Li , Huang Hu , Yingying He , Yang Yang , Daxin Jiang

Large language models (LLMs) are increasingly prevalent in recommender systems, where LLMs can be used to generate personalized recommendations. Here, we examine how different LLM-generated explanations for movie recommendations affect…

Human-Computer Interaction · Computer Science 2025-08-20 Yuanjun Feng , Stefan Feuerriegel , Yash Raj Shrestha

We present SalesSim, a framework and testbed for evaluating the ability of Multimodal Large Language Models (MLLMs) to simulate realistic, persona-driven customer behavior in multi-turn, multi-modal, tool-augmented online retail…

Computation and Language · Computer Science 2026-05-12 Yada Pruksachatkun , Elaine Wan , Lyanna Chen , Kai-Wei Chang , Chien-Sheng Wu

The chit-chat-based conversational recommendation systems (CRS) provide item recommendations to users through natural language interactions. To better understand user's intentions, external knowledge graphs (KG) have been introduced into…

Computation and Language · Computer Science 2021-05-19 Tong Zhang , Yong Liu , Peixiang Zhong , Chen Zhang , Hao Wang , Chunyan Miao

E-commerce pre-sales dialogue aims to understand and elicit user needs and preferences for the items they are seeking so as to provide appropriate recommendations. Conversational recommender systems (CRSs) learn user representation and…

Computation and Language · Computer Science 2024-10-21 Yuanxing Liu , Wei-Nan Zhang , Yifan Chen , Yuchi Zhang , Haopeng Bai , Fan Feng , Hengbin Cui , Yongbin Li , Wanxiang Che

This paper introduces RecAI, a practical toolkit designed to augment or even revolutionize recommender systems with the advanced capabilities of Large Language Models (LLMs). RecAI provides a suite of tools, including Recommender AI Agent,…

Information Retrieval · Computer Science 2024-03-12 Jianxun Lian , Yuxuan Lei , Xu Huang , Jing Yao , Wei Xu , Xing Xie

Conversational recommendation systems (CRS) engage with users by inferring user preferences from dialog history, providing accurate recommendations, and generating appropriate responses. Previous CRSs use knowledge graph (KG) based…

Computation and Language · Computer Science 2021-12-16 Bowen Yang , Cong Han , Yu Li , Lei Zuo , Zhou Yu

Progress in conversational information access (CIA) systems has been hindered by the difficulty of evaluating such systems with reproducible experiments. While user simulation offers a promising solution, the lack of infrastructure and…

Information Retrieval · Computer Science 2025-10-27 Nolwenn Bernard , Sharath Chandra Etagi Suresh , Krisztian Balog , ChengXiang Zhai

Usability is a key factor in the effectiveness of recommender systems. However, the analysis of user interfaces is a time-consuming process that requires expertise. Recent advances in multimodal large language models (LLMs) offer promising…

Human-Computer Interaction · Computer Science 2025-11-19 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Thi Ngoc Trang Tran

Conversational recommender system (CRS), which combines the techniques of dialogue system and recommender system, has obtained increasing interest recently. In contrast to traditional recommender system, it learns the user preference better…

Information Retrieval · Computer Science 2024-08-05 Yunwen Xia , Hui Fang , Jie Zhang , Chong Long

In Conversational Recommendation Systems (CRS), the central question is how the conversational agent can naturally ask for user preferences and provide suitable recommendations. Existing works mainly follow the hierarchical architecture,…

Computation and Language · Computer Science 2023-10-24 Xian Li , Hongguang Shi , Yunfei Wang , Yeqin Zhang , Xubin Li , Cam-Tu Nguyen

Recommender systems are ubiquitous yet often difficult for users to control, and adjust if recommendation quality is poor. This has motivated conversational recommender systems (CRSs), with control provided through natural language…

Information Retrieval · Computer Science 2023-11-21 Megan Leszczynski , Shu Zhang , Ravi Ganti , Krisztian Balog , Filip Radlinski , Fernando Pereira , Arun Tejasvi Chaganty

Traditional recommendation systems estimate user preference on items from past interaction history, thus suffering from the limitations of obtaining fine-grained and dynamic user preference. Conversational recommendation system (CRS) brings…

Information Retrieval · Computer Science 2020-07-02 Wenqiang Lei , Gangyi Zhang , Xiangnan He , Yisong Miao , Xiang Wang , Liang Chen , Tat-Seng Chua