English
Related papers

Related papers: A User Simulator for Task-Completion Dialogues

200 papers

Clarifying user needs is essential for existing task-oriented dialogue systems. However, in real-world applications, developers can never guarantee that all possible user demands are taken into account in the design phase. Consequently,…

Computation and Language · Computer Science 2019-06-13 Weikang Wang , Jiajun Zhang , Qian Li , Mei-Yuh Hwang , Chengqing Zong , Zhifei Li

Task-oriented dialogue systems (TDSs) are assessed mainly in an offline setting or through human evaluation. The evaluation is often limited to single-turn or is very time-intensive. As an alternative, user simulators that mimic user…

Computation and Language · Computer Science 2023-11-06 Weiwei Sun , Shuyu Guo , Shuo Zhang , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Due to the significance and value in human-computer interaction and natural language processing, task-oriented dialog systems are attracting more and more attention in both academic and industrial communities. In this paper, we survey…

Computation and Language · Computer Science 2020-06-24 Zheng Zhang , Ryuichi Takanobu , Qi Zhu , Minlie Huang , Xiaoyan Zhu

Testing conversational AI systems at scale across diverse domains necessitates realistic and diverse user interactions capturing a wide array of behavioral patterns. We present a novel multi-agent framework for realistic, explainable human…

Human-Computer Interaction · Computer Science 2026-01-23 Hareeshwar Karthikeyan

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

Conventionally, generation of natural language for dialogue agents may be viewed as a statistical learning problem: determine the patterns in human-provided data and generate appropriate responses with similar statistical properties.…

Computation and Language · Computer Science 2022-04-19 Siddharth Verma , Justin Fu , Mengjiao Yang , Sergey Levine

User Simulators play a pivotal role in training and evaluating task-oriented dialogue systems. Traditional user simulators typically rely on human-engineered agendas, resulting in generated responses that often lack diversity and…

Computation and Language · Computer Science 2024-05-24 Xiang Luo , Zhiwen Tang , Jin Wang , Xuejie Zhang

Human-computer interactive systems that rely on machine learning are becoming paramount to the lives of millions of people who use digital assistants on a daily basis. Yet, further advances are limited by the availability of data and the…

Machine Learning · Computer Science 2020-04-29 Katya Kudashkina , Valliappa Chockalingam , Graham W. Taylor , Michael Bowling

Despite many recent advances for the design of dialogue systems, a true bottleneck remains the acquisition of data required to train its components. Unlike many other language processing applications, dialogue systems require interactions…

Computation and Language · Computer Science 2018-10-03 Matthieu Riou , Bassam Jabaian , Stéphane Huet , Fabrice Lefèvre

Modern virtual personal assistants provide a convenient interface for completing daily tasks via voice commands. An important consideration for these assistants is the ability to recover from automatic speech recognition (ASR) and natural…

Computation and Language · Computer Science 2017-12-13 Maryam Fazel-Zarandi , Shang-Wen Li , Jin Cao , Jared Casale , Peter Henderson , David Whitney , Alborz Geramifard

We describe a two-step approach for dialogue management in task-oriented spoken dialogue systems. A unified neural network framework is proposed to enable the system to first learn by supervision from a set of dialogue data and then…

Computation and Language · Computer Science 2016-06-09 Pei-Hao Su , Milica Gasic , Nikola Mrksic , Lina Rojas-Barahona , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

Neural task-oriented dialogue systems often struggle to smoothly interface with a knowledge base. In this work, we seek to address this problem by proposing a new neural dialogue agent that is able to effectively sustain grounded,…

Computation and Language · Computer Science 2017-07-17 Mihail Eric , Christopher D. Manning

The next step for intelligent dialog agents is to escape their role as silent bystanders and become proactive. Well-defined proactive behavior may improve human-machine cooperation, as the agent takes a more active role during interaction…

Computation and Language · Computer Science 2023-06-23 Matthias Kraus , Nicolas Wagner , Ron Riekenbrauck , Wolfgang Minker

This paper proposes a neural network-based user simulator that can provide a multimodal interactive environment for training Reinforcement Learning (RL) agents in collaborative tasks involving multiple modes of communication. The simulator…

Algorithms for text-generation in dialogue can be misguided. For example, in task-oriented settings, reinforcement learning that optimizes only task-success can lead to abysmal lexical diversity. We hypothesize this is due to poor…

Computation and Language · Computer Science 2022-10-17 Anthony Sicilia , Malihe Alikhani

Recommender systems play a central role in numerous real-life applications, yet evaluating their performance remains a significant challenge due to the gap between offline metrics and online behaviors. Given the scarcity and limits (e.g.,…

Information Retrieval · Computer Science 2025-04-18 Nicolas Bougie , Narimasa Watanabe

Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen…

Machine Learning · Computer Science 2024-02-09 Floris den Hengst , Mark Hoogendoorn , Frank van Harmelen , Joost Bosman

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. A part of this effort is the policy optimisation task, which attempts to find a policy describing how to…

Computation and Language · Computer Science 2018-02-13 Gellért Weisz , Paweł Budzianowski , Pei-Hao Su , Milica Gašić

Task-oriented dialogue systems aim to fulfill user goals through natural language interactions. They are ideally evaluated with human users, which however is unattainable to do at every iteration of the development phase. Simulated users…

Computation and Language · Computer Science 2022-09-05 Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Carel van Niekerk , Michael Heck , Shutong Feng , Milica Gašić

Conversational search has seen increased recent attention in both the IR and NLP communities. It seeks to clarify and solve users' search needs through multi-turn natural language interactions. However, most existing systems are trained and…

Information Retrieval · Computer Science 2024-02-12 Zhenduo Wang , Zhichao Xu , Qingyao Ai , Vivek Srikumar