English
Related papers

Related papers: A User Simulator for Task-Completion Dialogues

200 papers

Dialogue systems have many applications such as customer support or question answering. Typically they have been limited to shallow single turn interactions. However more advanced applications such as career coaching or planning a trip…

This paper presents a novel application of large language models in user simulation for task-oriented dialog systems, specifically focusing on an in-context learning approach. By harnessing the power of these models, the proposed approach…

Computation and Language · Computer Science 2023-06-02 Silvia Terragni , Modestas Filipavicius , Nghia Khau , Bruna Guedes , André Manso , Roland Mathis

Dialogue assistants are rapidly becoming an indispensable daily aid. To avoid the significant effort needed to hand-craft the required dialogue flow, the Dialogue Management (DM) module can be cast as a continuous Markov Decision Process…

Task-oriented proactive dialogue agents play a pivotal role in recruitment, particularly for steering conversations towards specific business outcomes, such as acquiring social-media contacts for private-channel conversion. Although…

Artificial Intelligence · Computer Science 2026-01-09 Zhiyong Cao , Dunqiang Liu , Qi Dai , Haojun Xu , Huaiyan Xu , Huan He , Yafei Liu , Siyuan Liu , XiaoLin Lin , Ke Ma , Ruqian Shi , Sijia Yao , Hao Wang , Sicheng Zhou

Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost-efficiency, making it a viable choice for large-scale…

Information Retrieval · Computer Science 2021-05-11 Weiwei Sun , Shuo Zhang , Krisztian Balog , Zhaochun Ren , Pengjie Ren , Zhumin Chen , Maarten de Rijke

Reinforcement learning has been widely adopted to model dialogue managers in task-oriented dialogues. However, the user simulator provided by state-of-the-art dialogue frameworks are only rough approximations of human behaviour. The ability…

Computation and Language · Computer Science 2023-02-23 Thibault Cordier , Tanguy Urvoy , Fabrice Lefevre , Lina M. Rojas-Barahona

Task-oriented dialog systems have been applied in various tasks, such as automated personal assistants, customer service providers and tutors. These systems work well when users have clear and explicit intentions that are well-aligned to…

Computation and Language · Computer Science 2018-01-09 Zhou Yu , Alan W Black , Alexander I. Rudnicky

We introduce end-to-end neural network based models for simulating users of task-oriented dialogue systems. User simulation in dialogue systems is crucial from two different perspectives: (i) automatic evaluation of different dialogue…

Computation and Language · Computer Science 2018-11-13 Izzeddin Gur , Dilek Hakkani-Tur , Gokhan Tur , Pararth Shah

Conversational information access is an emerging research area. Currently, human evaluation is used for end-to-end system evaluation, which is both very time and resource intensive at scale, and thus becomes a bottleneck of progress. As an…

Information Retrieval · Computer Science 2020-06-17 Shuo Zhang , Krisztian Balog

We present an extensible user simulation toolkit to facilitate automatic evaluation of conversational recommender systems. It builds on an established agenda-based approach and extends it with several novel elements, including user…

Information Retrieval · Computer Science 2023-01-25 Jafar Afzali , Aleksander Mark Drzewiecki , Krisztian Balog , Shuo Zhang

The recent paradigm shift toward large reasoning models (LRMs) as autonomous agents has intensified the demand for sophisticated, multi-turn tool-use capabilities. Yet, existing datasets and data-generation approaches are limited by static,…

Computation and Language · Computer Science 2026-01-14 Jungho Cho , Minbyul Jeong , Sungrae Park

Task-oriented dialogue systems can efficiently serve a large number of customers and relieve people from tedious works. However, existing task-oriented dialogue systems depend on handcrafted actions and states or extra semantic labels,…

Computation and Language · Computer Science 2017-11-13 Weiyan Wang , Yuxiang WU , Yu Zhang , Zhongqi Lu , Kaixiang Mo , Qiang Yang

Training dialog policies for speech-based virtual assistants requires a plethora of conversational data. The data collection phase is often expensive and time consuming due to human involvement. To address this issue, a common solution is…

Computation and Language · Computer Science 2019-11-11 Maryam Fazel-Zarandi , Longshaokan Wang , Aditya Tiwari , Spyros Matsoukas

User simulators serve as the critical interactive environment for agent post-training, and an ideal user simulator generalizes across domains and proactively engages in negotiation by challenging or bargaining. However, current methods…

Computation and Language · Computer Science 2026-01-15 Feng Zhang , Shijia Li , Chunmao Zhang , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu , Han Liu

Dialogue Policy Learning is a key component in a task-oriented dialogue system (TDS) that decides the next action of the system given the dialogue state at each turn. Reinforcement Learning (RL) is commonly chosen to learn the dialogue…

Computation and Language · Computer Science 2023-11-09 Wai-Chung Kwan , Hongru Wang , Huimin Wang , Kam-Fai Wong

Spoken dialogue systems allow humans to interact with machines using natural speech. As such, they have many benefits. By using speech as the primary communication medium, a computer interface can facilitate swift, human-like acquisition of…

Computation and Language · Computer Science 2016-09-12 Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

User simulation is essential for generating enough data to train a statistical spoken dialogue system. Previous models for user simulation suffer from several drawbacks, such as the inability to take dialogue history into account, the need…

Computation and Language · Computer Science 2016-07-04 Layla El Asri , Jing He , Kaheer Suleman

Dialogue policy optimisation via reinforcement learning requires a large number of training interactions, which makes learning with real users time consuming and expensive. Many set-ups therefore rely on a user simulator instead of humans.…

Computation and Language · Computer Science 2021-06-17 Hsien-chin Lin , Nurul Lubis , Songbo Hu , Carel van Niekerk , Christian Geishauser , Michael Heck , Shutong Feng , Milica Gašić

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

Information access systems, such as search engines, recommender systems, and conversational assistants, have become integral to our daily lives as they help us satisfy our information needs. However, evaluating the effectiveness of these…

Human-Computer Interaction · Computer Science 2026-04-21 Krisztian Balog , ChengXiang Zhai