English
Related papers

Related papers: SalesSim: Benchmarking and Aligning Multimodal Lan…

200 papers

Making big purchases requires consumers to research or consult a salesperson to gain domain expertise. However, existing conversational recommender systems (CRS) often overlook users' lack of background knowledge, focusing solely on…

Computation and Language · Computer Science 2023-10-30 Lidiya Murakhovs'ka , Philippe Laban , Tian Xie , Caiming Xiong , Chien-Sheng Wu

Large Language Models (LLMs) are increasingly used to simulate how specific users respond to a given context, enabling more user-centric applications that rely on user feedback. However, existing user simulators mostly imitate surface-level…

Computation and Language · Computer Science 2026-03-05 Shirley Wu , Evelyn Choi , Arpandeep Khatua , Zhanghan Wang , Joy He-Yueya , Tharindu Cyril Weerasooriya , Wei Wei , Diyi Yang , Jure Leskovec , James Zou

LLM-based user simulation is the primary mechanism for end-to-end agent evaluation, yet simulated users are poor proxies for real humans: unconstrained LLM defaults produce a Formalism Ceiling (style match rates of 6-8% against real users),…

Human-Computer Interaction · Computer Science 2026-05-21 Ming Zhu , Juntao Tan , Rithesh Murthy , Jielin Qiu , Liangwei Yang , Wenting Zhao , Silvio Savarese , Shelby Heinecke , Huan Wang

Large language models (LLMs) are essential tools that users employ across various scenarios, so evaluating their performance and guiding users in selecting the suitable service is important. Although many benchmarks exist, they mainly focus…

Computation and Language · Computer Science 2024-09-23 Jiayin Wang , Fengran Mo , Weizhi Ma , Peijie Sun , Min Zhang , Jian-Yun Nie

Multimodal Large Language Models (MLLMs) are reshaping how modern agentic systems reason over sequential user-behavior data. However, whether textual or image representations of user behavior data are more effective for maximizing MLLM…

Artificial Intelligence · Computer Science 2025-11-07 Tianning Dong , Luyi Ma , Varun Vasudevan , Jason Cho , Sushant Kumar , Kannan Achan

We present StockSim, an open-source simulation platform for systematic evaluation of large language models (LLMs) in realistic financial decision-making scenarios. Unlike previous toolkits that offer limited scope, StockSim delivers a…

Computational Engineering, Finance, and Science · Computer Science 2025-07-15 Charidimos Papadakis , Giorgos Filandrianos , Angeliki Dimitriou , Maria Lymperaiou , Konstantinos Thomas , Giorgos Stamou

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

Simulating consumer decision-making is vital for designing and evaluating marketing strategies before costly real-world deployment. However, post-event analyses and rule-based agent-based models (ABMs) struggle to capture the complexity of…

Artificial Intelligence · Computer Science 2025-10-22 Man-Lin Chu , Lucian Terhorst , Kadin Reed , Tom Ni , Weiwei Chen , Rongyu Lin

Large language models (LLMs) are poised to revolutionize the domain of online fashion retail, enhancing customer experience and discovery of fashion online. LLM-powered conversational agents introduce a new way of discovery by directly…

Information Retrieval · Computer Science 2024-08-20 Antonis Maronikolakis , Ana Peleteiro Ramallo , Weiwei Cheng , Thomas Kober

In an ideal design pipeline, user interface (UI) design is intertwined with user research to validate decisions, yet studies are often resource-constrained during early exploration. Recent advances in multimodal large language models…

While advances in fairness and alignment have helped mitigate overt biases exhibited by large language models (LLMs) when explicitly prompted, we hypothesize that these models may still exhibit implicit biases when simulating human…

Computation and Language · Computer Science 2025-01-30 Yuxuan Li , Hirokazu Shirado , Sauvik Das

Conversational Recommender System (CRS) interacts with users through natural language to understand their preferences and provide personalized recommendations in real-time. CRS has demonstrated significant potential, prompting researchers…

Artificial Intelligence · Computer Science 2024-03-26 Lixi Zhu , Xiaowen Huang , Jitao Sang

Conversational shopping agents represent a critical consumer-facing application of Large Language Model (LLM)-powered agents, yet how to effectively apply post-training Reinforcement Learning (RL) to optimize such agents remains…

Information Retrieval · Computer Science 2026-03-09 Yiruo Cheng , Kelong Mao , Tianhao Li , Jiejun Tan , Ji-Rong Wen , Zhicheng Dou

Doctor-patient consultations require multi-turn, context-aware communication tailored to diverse patient personas. Training or evaluating doctor LLMs in such settings requires realistic patient interaction systems. However, existing…

Artificial Intelligence · Computer Science 2025-10-30 Daeun Kyung , Hyunseung Chung , Seongsu Bae , Jiho Kim , Jae Ho Sohn , Taerim Kim , Soo Kyung Kim , Edward Choi

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the development of agents that support human-machine dialogue interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhenfei Yin , Jiong Wang , Jianjian Cao , Zhelun Shi , Dingning Liu , Mukai Li , Lu Sheng , Lei Bai , Xiaoshui Huang , Zhiyong Wang , Jing Shao , Wanli Ouyang

Large Language Model (LLM) agents are increasingly deployed in settings where they interact with a wide variety of people, including users who are unclear, impatient, or reluctant to share information. However, collecting real interaction…

Artificial Intelligence · Computer Science 2026-05-14 Harshita Chopra , Kshitish Ghate , Aylin Caliskan , Tadayoshi Kohno , Chirag Shah , Natasha Jaques

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Large Language Models (LLMs) have emerged as personalized assistants for users across a wide range of tasks -- from offering writing support to delivering tailored recommendations or consultations. Over time, the interaction history between…

Computation and Language · Computer Science 2025-10-28 Bowen Jiang , Zhuoqun Hao , Young-Min Cho , Bryan Li , Yuan Yuan , Sihao Chen , Lyle Ungar , Camillo J. Taylor , Dan Roth

Multimodal Large Language Models (MLLMs) serve as daily assistants for millions. However, their ability to generate responses aligned with individual preferences remains limited. Prior approaches enable only static, single-turn…

Computation and Language · Computer Science 2026-04-16 Chang Nie , Chaoyou Fu , Yifan Zhang , Haihua Yang , Caifeng Shan

In online second-hand marketplaces, multi-turn bargaining is a crucial part of seller-buyer interactions. Large Language Models (LLMs) can act as seller agents, negotiating with buyers on behalf of sellers under given business constraints.…

Artificial Intelligence · Computer Science 2025-09-09 Issue Yishu Wang , Kakam Chong , Xiaofeng Wang , Xu Yan , DeXin Kong , Chen Ju , Ming Chen , Shuai Xiao , Shuguang Han , jufeng chen