English
Related papers

Related papers: Task-oriented Dialogue Systems: performance vs. qu…

200 papers

Task-oriented dialogues often require agents to enact complex, multi-step procedures in order to meet user requests. While large language models have found success automating these dialogues in constrained environments, their widespread…

Computation and Language · Computer Science 2023-06-08 Julia White , Arushi Raghuvanshi , Yada Pruksachatkun

User Satisfaction Modeling (USM) is one of the popular choices for task-oriented dialogue systems evaluation, where user satisfaction typically depends on whether the user's task goals were fulfilled by the system. Task-oriented dialogue…

Computation and Language · Computer Science 2023-05-29 Yue Feng , Yunlong Jiao , Animesh Prasad , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai

Most existing dialogue corpora and models have been designed to fit into 2 predominant categories : task-oriented dialogues portray functional goals, such as making a restaurant reservation or booking a plane ticket, while…

Computation and Language · Computer Science 2023-11-27 Armand Stricker , Patrick Paroubek

Existing studies in conversational AI mostly treat task-oriented dialog (TOD) and question answering (QA) as separate tasks. Towards the goal of constructing a conversational agent that can complete user tasks and support information…

Computation and Language · Computer Science 2022-06-28 Miaoran Li , Baolin Peng , Jianfeng Gao , Zhu Zhang

Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to…

Computation and Language · Computer Science 2021-08-04 Xinmeng Li , Wansen Wu , Long Qin , Quanjun Yin

Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented dialogue system,…

Computation and Language · Computer Science 2021-07-08 Hyunmin Jeon , Gary Geunbae Lee

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

Large Pre-Trained Language Models have demonstrated state-of-the-art performance in different downstream tasks, including dialogue state tracking and end-to-end response generation. Nevertheless, most of the publicly available datasets and…

Computation and Language · Computer Science 2024-01-05 Seyed Mahed Mousavi , Gabriel Roccabruna , Simone Alghisi , Massimo Rizzoli , Mirco Ravanelli , Giuseppe Riccardi

Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat as separate domains. Towards building a human-like assistant that can converse naturally and seamlessly with users, it is important to build a…

Computation and Language · Computer Science 2022-05-12 Zhiyu Chen , Bing Liu , Seungwhan Moon , Chinnadhurai Sankar , Paul Crook , William Yang Wang

There is an increasing demand for task-oriented dialogue systems which can assist users in various activities such as booking tickets and restaurant reservations. In order to complete dialogues effectively, dialogue policy plays a key role…

Computation and Language · Computer Science 2019-09-23 Tian Lan , Xianling Mao , Heyan Huang

This paper studies the exposure bias problem in task-oriented dialog systems, where the model's generated content over multiple turns drives the dialog context away from the ground-truth distribution at training time, introducing error…

Computation and Language · Computer Science 2022-09-16 Yunyi Yang , Hong Ding , Qingyi Liu , Xiaojun Quan

During the past decade, several areas of speech and language understanding have witnessed substantial breakthroughs from the use of data-driven models. In the area of dialogue systems, the trend is less obvious, and most practical systems…

Computation and Language · Computer Science 2017-03-22 Iulian Vlad Serban , Ryan Lowe , Peter Henderson , Laurent Charlin , Joelle Pineau

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

Pre-trained language models have been successful in many scenarios. However, their usefulness in task-oriented dialogues is limited due to the intrinsic linguistic differences between general text and task-oriented dialogues. Current…

Computation and Language · Computer Science 2024-03-05 Weihao Zeng , Keqing He , Yejie Wang , Dayuan Fu , Weiran Xu

Task-oriented dialogue (TOD) models have made significant progress in recent years. However, previous studies primarily focus on datasets written by annotators, which has resulted in a gap between academic research and real-world spoken…

Computation and Language · Computer Science 2025-06-25 Shuzheng Si , Wentao Ma , Haoyu Gao , Yuchuan Wu , Ting-En Lin , Yinpei Dai , Hangyu Li , Rui Yan , Fei Huang , Yongbin Li

In the realm of dialogue systems, user simulation techniques have emerged as a game-changer, redefining the evaluation and enhancement of task-oriented dialogue (TOD) systems. These methods are crucial for replicating real user…

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

Computation and Language · Computer Science 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain…

Computation and Language · Computer Science 2020-10-07 Oluwatobi O. Olabiyi , Prarthana Bhattarai , C. Bayan Bruss , Zachary Kulis

Programmable task-oriented dialogue (TOD) agents enable language models to follow structured dialogue policies, but their effectiveness hinges on accurate state tracking. We present PyTOD, an agent that generates executable code to track…

Task-oriented dialog systems enable users to accomplish tasks using natural language. State-of-the-art systems respond to users in the same way regardless of their personalities, although personalizing dialogues can lead to higher levels of…

Computation and Language · Computer Science 2023-03-27 A. B. Siddique , M. H. Maqbool , Kshitija Taywade , Hassan Foroosh