English
Related papers

Related papers: RecUserSim: A Realistic and Diverse User Simulator…

200 papers

The technical foundations of recommender systems have progressed from collaborative filtering to complex neural models and, more recently, large language models. Despite these technological advances, deployed systems often underserve their…

Information Retrieval · Computer Science 2026-03-10 Kesha Ou , Chenghao Wu , Xiaolei Wang , Bowen Zheng , Wayne Xin Zhao , Weitao Li , Long Zhang , Sheng Chen , Ji-Rong Wen

Conversational recommender systems (CRS) generate recommendations through an interactive process. However, not all CRS approaches use human conversations as their source of interaction data; the majority of prior CRS work simulates…

Computation and Language · Computer Science 2023-09-15 Chuang Li , Hengchang Hu , Yan Zhang , Min-Yen Kan , Haizhou Li

Large language models (LLMs) are increasingly used in interactive applications, and human evaluation remains the gold standard for assessing their performance in multi-turn conversations. Since human studies are costly, time-consuming, and…

Computation and Language · Computer Science 2025-10-10 Yao Dou , Michel Galley , Baolin Peng , Chris Kedzie , Weixin Cai , Alan Ritter , Chris Quirk , Wei Xu , Jianfeng Gao

User simulation has been a cost-effective technique for evaluating conversational recommender systems. However, building a human-like simulator is still an open challenge. In this work, we focus on how users reformulate their utterances…

Information Retrieval · Computer Science 2022-05-05 Shuo Zhang , Mu-Chun Wang , Krisztian Balog

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning, generalization, and simulating human-like behavior across a wide range of tasks. These strengths present new opportunities to enhance traditional…

Information Retrieval · Computer Science 2025-12-01 Nachiket Subbaraman , Jaskinder Sarai , Aniruddh Nath , Lichan Hong , Lukasz Heldt , Li Wei , Zhe Zhao

A common approach to personalization in large language models (LLMs) is to incorporate a subset of the user memory into the prompt at inference time to guide the model's generation. Existing methods select these subsets primarily using…

Artificial Intelligence · Computer Science 2026-04-17 Jillian Fisher , Jennifer Neville , Chan Young Park

User Simulators play a pivotal role in training and evaluating task-oriented dialogue systems. Traditional user simulators typically rely on human-engineered agendas, resulting in generated responses that often lack diversity and…

Computation and Language · Computer Science 2024-05-24 Xiang Luo , Zhiwen Tang , Jin Wang , Xuejie Zhang

LLM recommendation agents increasingly produce structured recommendation reports: sets of items accompanied by natural-language justifications. Yet existing evaluations often reduce this setting to reranking small shortlisted candidate sets…

Information Retrieval · Computer Science 2026-05-20 Imad Aouali , Flavian Vasile , Otmane Sakhi , Alexandre Gilotte , Benjamin Heymann

Conversational recommender systems (CRS) based on Large Language Models (LLMs) need to constantly be aligned to the user preferences to provide satisfying and context-relevant item recommendations. The traditional supervised fine-tuning…

Machine Learning · Computer Science 2025-08-08 Zhongheng Yang , Aijia Sun , Yushang Zhao , Yinuo Yang , Dannier Li , Chengrui Zhou

Simulating society with large language models (LLMs), we argue, requires more than generating plausible behavior; it demands cognitively grounded reasoning that is structured, revisable, and traceable. LLM-based agents are increasingly used…

Computers and Society · Computer Science 2025-10-27 Chance Jiajie Li , Jiayi Wu , Zhenze Mo , Ao Qu , Yuhan Tang , Kaiya Ivy Zhao , Yulu Gan , Jie Fan , Jiangbo Yu , Jinhua Zhao , Paul Liang , Luis Alonso , Kent Larson

Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most…

Information Retrieval · Computer Science 2024-11-04 Qidong Liu , Xian Wu , Yejing Wang , Zijian Zhang , Feng Tian , Yefeng Zheng , Xiangyu Zhao

We present a methodology to systematically test conversational recommender systems with regards to conversational breakdowns. It involves examining conversations generated between the system and simulated users for a set of pre-defined…

Information Retrieval · Computer Science 2024-05-24 Nolwenn Bernard , Krisztian Balog

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is…

Information Retrieval · Computer Science 2025-02-18 Yi Fang , Wenjie Wang , Yang Zhang , Fengbin Zhu , Qifan Wang , Fuli Feng , Xiangnan He

Recommender systems utilizing explicit feedback have witnessed significant advancements and widespread applications over the past years. However, generating recommendations in few-shot scenarios remains a persistent challenge. Recently,…

Information Retrieval · Computer Science 2023-12-22 Zhoumeng Wang

Synthetic users are cost-effective proxies for real users in the evaluation of conversational recommender systems. Large language models show promise in simulating human-like behavior, raising the question of their ability to represent a…

Computation and Language · Computer Science 2024-03-27 Se-eun Yoon , Zhankui He , Jessica Maria Echterhoff , Julian McAuley

With the recent advances in Reinforcement Learning (RL), there have been tremendous interests in employing RL for recommender systems. However, directly training and evaluating a new RL-based recommendation algorithm needs to collect users'…

Information Retrieval · Computer Science 2019-09-11 Xiangyu Zhao , Long Xia , Lixin Zou , Dawei Yin , Jiliang Tang

[Context and Motivation] Online user feedback provides valuable information to support requirements engineering (RE). However, analyzing online user feedback is challenging due to its large volume and noise. Large language models (LLMs)…

Software Engineering · Computer Science 2025-10-28 Manjeshwar Aniruddh Mallya , Alessio Ferrari , Mohammad Amin Zadenoori , Jacek Dąbrowski

Conversational recommender systems (CRS) have advanced with large language models, showing strong results in domains like movies. These domains typically involve fixed content and passive consumption, where user preferences can be matched…

Information Retrieval · Computer Science 2026-02-26 Zheng Hui , Xiaokai Wei , Yexi Jiang , Kevin Gao , Chen Wang , Frank Ong , Se-eun Yoon , Rachit Pareek , Michelle Gong

Large Language Models (LLMs) have become indispensable for evaluating writing. However, text feedback they provide is often unintelligible, generic, and not specific to user criteria. Inspired by structured rubrics in education and…

Human-Computer Interaction · Computer Science 2026-02-16 Jingwen Bai , Wei Soon Cheong , Philippe Muller , Brian Y Lim