English
Related papers

Related papers: MUSE: Multi-Domain Chinese User Simulation via Sel…

200 papers

Despite widespread interests in reinforcement-learning for task-oriented dialogue systems, several obstacles can frustrate research and development progress. First, reinforcement learners typically require interaction with the environment,…

Machine Learning · Computer Science 2017-11-15 Xiujun Li , Zachary C. Lipton , Bhuwan Dhingra , Lihong Li , Jianfeng Gao , Yun-Nung Chen

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai

Conversational recommender systems (CRS) enhance user experience through multi-turn interactions, yet evaluating CRS remains challenging. User simulators can provide comprehensive evaluations through interactions with CRS, but building…

Human-Computer Interaction · Computer Science 2025-08-01 Luyu Chen , Quanyu Dai , Zeyu Zhang , Xueyang Feng , Mingyu Zhang , Pengcheng Tang , Xu Chen , Yue Zhu , Zhenhua Dong

Due to the excellent capacities of large language models (LLMs), it becomes feasible to develop LLM-based agents for reliable user simulation. Considering the scarcity and limit (e.g., privacy issues) of real user data, in this paper, we…

Information Retrieval · Computer Science 2024-02-28 Ruiyang Ren , Peng Qiu , Yingqi Qu , Jing Liu , Wayne Xin Zhao , Hua Wu , Ji-Rong Wen , Haifeng Wang

Spoken language models (SLMs) have advanced rapidly in recent years, accompanied by a growing number of evaluation benchmarks. However, most existing benchmarks emphasize task completion and capability scaling, while remaining poorly…

Computation and Language · Computer Science 2026-01-13 Zehan Li , Hongjie Chen , Qing Wang , Yuxin Zhang , Jing Zhou , Hang Lv , Mengjie Du , Yaodong Song , Jie Lian , Jian Kang , Jie Li , Yongxiang Li , Xuelong Li

Conversational recommendation systems (CRSs) use multi-turn interaction to capture user preferences and provide personalized recommendations. A fundamental challenge in CRSs lies in effectively understanding user preferences from…

Information Retrieval · Computer Science 2025-04-30 Xiaolei Wang , Chunxuan Xia , Junyi Li , Fanzhe Meng , Lei Huang , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

While Large Language Models (LLMs) enable complex autonomous behavior, current agents remain constrained by static, human-designed prompts that limit adaptability. Existing self-improving frameworks attempt to bridge this gap but typically…

Artificial Intelligence · Computer Science 2026-01-21 Xinmeng Hou , Peiliang Gong , Bohao Qu , Wuqi Wang , Qing Guo , Yang Liu

Natural language programming is a promising approach to enable end users to instruct new tasks for intelligent agents. However, our formative study found that end users would often use unclear, ambiguous or vague concepts when naturally…

Human-Computer Interaction · Computer Science 2020-07-15 Toby Jia-Jun Li , Marissa Radensky , Justin Jia , Kirielle Singarajah , Tom M. Mitchell , Brad A. Myers

The rapid adoption of complex Artificial Intelligence (AI) and Machine Learning (ML) models has led to their characterization as black boxes due to the difficulty of explaining their internal decision-making processes. This lack of…

Machine Learning · Computer Science 2026-01-13 Silvia Ruiz-España , Laura Arnal , François Signol , Juan-Carlos Perez-Cortes , Joaquim Arlandis

Existing user simulators (USs) for task-oriented dialogue systems only model user behaviour on semantic and natural language levels without considering the user persona and emotions. Optimising dialogue systems with generic user policies,…

We propose a novel approach, MUSE, to illustrate textual attributes visually via portrait generation. MUSE takes a set of attributes written in text, in addition to facial features extracted from a photo of the subject as input. We propose…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Xiaodan Hu , Pengfei Yu , Kevin Knight , Heng Ji , Bo Li , Honghui Shi

Designing effective reward functions remains a central challenge in reinforcement learning, especially in multi-objective environments. In this work, we propose Multi-Objective Reward Shaping with Exploration (MORSE), a general framework…

Machine Learning · Computer Science 2025-12-18 Yuqing Xie , Jiayu Chen , Wenhao Tang , Ya Zhang , Chao Yu , Yu Wang

Benchmarks are paramount for gauging progress in the domain of Mobile GUI Agents. In practical scenarios, users frequently fail to articulate precise directives containing full task details at the onset, and their expressions are typically…

User Satisfaction Estimation (USE) is an important yet challenging task in goal-oriented conversational systems. Whether the user is satisfied with the system largely depends on the fulfillment of the user's needs, which can be implicitly…

Computation and Language · Computer Science 2022-02-08 Yang Deng , Wenxuan Zhang , Wai Lam , Hong Cheng , Helen Meng

Current conversational AI systems often provide generic, one-size-fits-all interactions that overlook individual user characteristics and lack adaptive dialogue management. To address this gap, we introduce \textbf{HumAIne-chatbot}, an…

Human-Computer Interaction · Computer Science 2025-09-25 Georgios Makridis , George Fragiadakis , Jorge Oliveira , Tomaz Saraiva , Philip Mavrepis , Georgios Fatouros , Dimosthenis Kyriazis

Realistic user simulation is crucial for training and evaluating multi-turn dialogue systems, yet creating simulators that accurately replicate human behavior remains a significant challenge. An effective simulator must expose the failure…

Computation and Language · Computer Science 2026-05-07 Ziyi Zhu , Olivier Tieleman , Caitlin A. Stamatis , Luka Smyth , Thomas D. Hull , Daniel R. Cahn , Jinghong Chen , Matteo Malgaroli

User simulation is important for developing and evaluating human-centered AI, yet current student simulation in educational applications has significant limitations. Existing approaches focus on single learning experiences and do not…

Computers and Society · Computer Science 2026-01-27 Zhengyuan Liu , Stella Xin Yin , Bryan Chen Zhengyu Tan , Roy Ka-Wei Lee , Guimei Liu , Dion Hoe-Lian Goh , Wenya Wang , Nancy F. Chen

The traditional user-centered design process can hardly keep up with the ever faster technical development and increasingly diverse user preferences. As a solution, we propose to augment the tried-and-tested approach of conducting user…

Human-Computer Interaction · Computer Science 2023-02-23 Florian Fischer , Arthur Fleig , Markus Klar , Viktorija Paneva , Jörg Müller

How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be two critical issues in building a task-oriented dialogue system. In this paper, we propose a novel manual-guided dialogue scheme…

Computation and Language · Computer Science 2022-08-17 Ryuichi Takanobu , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Minlie Huang

Hundreds of millions of Chinese people have become social network users in recent years, and aligning the accounts of common Chinese users across multiple social networks is valuable to many inter-network applications, e.g., cross-network…

Social and Information Networks · Computer Science 2020-06-19 Junxing Zhu , Xiang Wang , Qiang Liu , Xiaoyong Li , Chengcheng Shao , Bin Zhou