English
Related papers

Related papers: Decision-aware User Simulation Agent for Evaluatin…

200 papers

Recommender systems are software applications that help users to find items of interest in situations of information overload. Current research often assumes a one-shot interaction paradigm, where the users' preferences are estimated based…

Human-Computer Interaction · Computer Science 2021-06-01 Dietmar Jannach , Ahtsham Manzoor , Wanling Cai , Li Chen

Recommendation systems focus on helping users find items of interest in the situations of information overload, where users' preferences are typically estimated by the past observed behaviors. In contrast, conversational recommendation…

Computation and Language · Computer Science 2022-03-29 Ting-Chun Wang , Shang-Yu Su , Yun-Nung Chen

Large Language Models (LLMs) have shown strong potential in generating natural language explanations for recommender systems. However, existing methods often overlook the sequential dynamics of user behavior and rely on evaluation metrics…

Information Retrieval · Computer Science 2026-03-26 Gangyi Zhang , Runzhe Teng , Chongming Gao

Recently, there has been an emergence of employing LLM-powered agents as believable human proxies, based on their remarkable decision-making capability. However, existing studies mainly focus on simulating human dialogue. Human non-verbal…

Information Retrieval · Computer Science 2023-10-16 Junjie Zhang , Yupeng Hou , Ruobing Xie , Wenqi Sun , Julian McAuley , Wayne Xin Zhao , Leyu Lin , Ji-Rong Wen

Conversational Recommender Systems (CRSs) are receiving growing research attention across domains, yet their user experience (UX) evaluation remains limited. Existing reviews largely overlook empirical UX studies, particularly in adaptive…

Information Retrieval · Computer Science 2025-08-07 Raj Mahmud , Yufeng Wu , Abdullah Bin Sawad , Shlomo Berkovsky , Mukesh Prasad , A. Baki Kocaballi

Recommender systems are the cornerstone of today's information dissemination, yet a disconnect between offline metrics and online performance greatly hinders their development. Addressing this challenge, we envision a recommendation…

Information Retrieval · Computer Science 2024-11-11 An Zhang , Yuxin Chen , Leheng Sheng , Xiang Wang , Tat-Seng Chua

We present SalesSim, a framework and testbed for evaluating the ability of Multimodal Large Language Models (MLLMs) to simulate realistic, persona-driven customer behavior in multi-turn, multi-modal, tool-augmented online retail…

Computation and Language · Computer Science 2026-05-12 Yada Pruksachatkun , Elaine Wan , Lyanna Chen , Kai-Wei Chang , Chien-Sheng Wu

In this paper, we present a systematic effort to design, evaluate, and implement a realistic conversational recommender system (CRS). The objective of our system is to allow users to input free-form text to request recommendations, and then…

Artificial Intelligence · Computer Science 2025-01-03 Se-eun Yoon , Xiaokai Wei , Yexi Jiang , Rachit Pareek , Frank Ong , Kevin Gao , Julian McAuley , Michelle Gong

While LLMs have demonstrated remarkable capabilities in text generation and reasoning, their ability to simulate human decision-making -- particularly in political contexts -- remains an open question. However, modeling voter behavior…

Computation and Language · Computer Science 2025-04-11 Chenxiao Yu , Jinyi Ye , Yuangang Li , Zheng Li , Emilio Ferrara , Xiyang Hu , Yue Zhao

Cognitive biases often shape human decisions. While large language models (LLMs) have been shown to reproduce well-known biases, a more critical question is whether LLMs can predict biases at the individual level and emulate the dynamics of…

Artificial Intelligence · Computer Science 2026-02-27 Stephen Pilli , Vivek Nallur

Effective decision-making in complex systems requires synthesizing diverse perspectives to address multifaceted challenges under uncertainty. This study introduces an agentic Large Language Models (LLMs) framework for simulating decision…

Artificial Intelligence · Computer Science 2026-03-20 Antoine Dolant , Praveen Kumar

Despite widespread interests in reinforcement-learning for task-oriented dialogue systems, several obstacles can frustrate research and development progress. First, reinforcement learners typically require interaction with the environment,…

Machine Learning · Computer Science 2017-11-15 Xiujun Li , Zachary C. Lipton , Bhuwan Dhingra , Lihong Li , Jianfeng Gao , Yun-Nung Chen

While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is…

Information Retrieval · Computer Science 2025-02-18 Yi Fang , Wenjie Wang , Yang Zhang , Fengbin Zhu , Qifan Wang , Fuli Feng , Xiangnan He

Recent agent-based recommendation frameworks aim to simulate user behaviors by incorporating memory mechanisms and prompting strategies, but they struggle with hallucinating non-existent items and full-catalog ranking. Besides, a largely…

Information Retrieval · Computer Science 2026-02-25 Mingdai Yang , Nurendra Choudhary , Jiangshu Du , Edward W. Huang , Philip S. Yu , Karthik Subbian , Danai Koutra

Task-oriented dialogue systems (TDSs) are assessed mainly in an offline setting or through human evaluation. The evaluation is often limited to single-turn or is very time-intensive. As an alternative, user simulators that mimic user…

Computation and Language · Computer Science 2023-11-06 Weiwei Sun , Shuyu Guo , Shuo Zhang , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

With the recent advances in Reinforcement Learning (RL), there have been tremendous interests in employing RL for recommender systems. However, directly training and evaluating a new RL-based recommendation algorithm needs to collect users'…

Information Retrieval · Computer Science 2019-09-11 Xiangyu Zhao , Long Xia , Lixin Zou , Dawei Yin , Jiliang Tang

Environments built for people are increasingly operated by a new class of economic actors: LLM-powered software agents making decisions on our behalf. These decisions range from our purchases to travel plans to medical treatment selection.…

Artificial Intelligence · Computer Science 2026-02-25 Manuel Cherep , Chengtian Ma , Abigail Xu , Maya Shaked , Pattie Maes , Nikhil Singh

Digital platforms such as social media and e-commerce websites adopt Recommender Systems to provide value to the user. However, the social consequences deriving from their adoption are still unclear. Many scholars argue that recommenders…

Information Retrieval · Computer Science 2024-09-26 Erica Coppolillo , Simone Mungari , Ettore Ritacco , Francesco Fabbri , Marco Minici , Francesco Bonchi , Giuseppe Manco

Information access systems, such as search engines, recommender systems, and conversational assistants, have become integral to our daily lives as they help us satisfy our information needs. However, evaluating the effectiveness of these…

Human-Computer Interaction · Computer Science 2026-04-21 Krisztian Balog , ChengXiang Zhai

As recommendation systems become increasingly standard for online platforms, simulations provide an avenue for understanding the impacts of these systems on individuals and society. When constructing a recommendation system simulation,…

Information Retrieval · Computer Science 2021-09-07 Allison J. B. Chaney