English
Related papers

Related papers: Task-oriented Dialogue Systems: performance vs. qu…

200 papers

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the…

Computation and Language · Computer Science 2021-06-08 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Peng Xu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Data scarcity is one of the main problems when it comes to real-world applications of transformer-based models. This is especially evident for task-oriented dialogue (TOD) systems, which require specialized datasets, that are usually not…

Computation and Language · Computer Science 2025-02-25 Sebastian Steindl , Ulrich Schäfer , Bernd Ludwig

Task-oriented dialogue (TOD) systems facilitate goal-driven interactions between users and machines. While recent advances in deep learning have improved the performance, TOD systems often struggle in low-resource scenarios with limited…

Computation and Language · Computer Science 2025-07-08 Quang-Vinh Nguyen , Quang-Chieu Nguyen , Hoang Pham , Khac-Hoai Nam Bui

In light of recent advances in large language models (LLMs), the expectations for the next generation of virtual assistants include enhanced naturalness and adaptability across diverse usage scenarios. However, the creation of high-quality…

Computation and Language · Computer Science 2024-06-10 Yinhong Liu , Yimai Fang , David Vandyke , Nigel Collier

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

Many efforts have been made to construct dialog systems for different types of conversations, such as task-oriented dialog (TOD) and open-domain dialog (ODD). To better mimic human-level conversations that usually fuse various dialog modes,…

Computation and Language · Computer Science 2023-08-01 Miaoran Li , Baolin Peng , Michel Galley , Jianfeng Gao , Zhu Zhang

Dialogue systems are usually categorized into two types, open-domain and task-oriented. The first one focuses on chatting with users and making them engage in the conversations, where selecting a proper topic to fit the dialogue context is…

Computation and Language · Computer Science 2022-04-25 Ssu Chiu , Maolin Li , Yen-Ting Lin , Yun-Nung Chen

Large language models (LLMs) have been used for diverse tasks in natural language processing (NLP), yet remain under-explored for task-oriented dialogue systems (TODS), especially for end-to-end TODS. We present InstructTODS, a novel…

Computation and Language · Computer Science 2023-10-16 Willy Chung , Samuel Cahyawijaya , Bryan Wilie , Holy Lovenia , Pascale Fung

Recent works have shown considerable improvements in task-oriented dialogue (TOD) systems by utilizing pretrained large language models (LLMs) in an end-to-end manner. However, the biased behavior of each component in a TOD system and the…

Computation and Language · Computer Science 2023-11-15 Hsuan Su , Rebecca Qian , Chinnadhurai Sankar , Shahin Shayandeh , Shang-Tse Chen , Hung-yi Lee , Daniel M. Bikel

Consistency Identification has obtained remarkable success on open-domain dialogue, which can be used for preventing inconsistent response generation. However, in contrast to the rapid development in open-domain dialogue, few efforts have…

Computation and Language · Computer Science 2021-09-24 Libo Qin , Tianbao Xie , Shijue Huang , Qiguang Chen , Xiao Xu , Wanxiang Che

Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external factual knowledge…

Task-Oriented Dialogue (TOD) systems have become crucial components in interactive artificial intelligence applications. While recent advances have capitalized on pre-trained language models (PLMs), they exhibit limitations regarding…

Computation and Language · Computer Science 2023-12-11 Sungryull Sohn , Yiwei Lyu , Anthony Liu , Lajanugen Logeswaran , Dong-Ki Kim , Dongsub Shim , Honglak Lee

Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence of actions in a particular order. While prior work has…

Computation and Language · Computer Science 2023-11-15 Do June Min , Paloma Sodhi , Ramya Ramakrishnan

Recent technological advances have made it possible to build real-time, interactive spoken dialogue systems for a wide variety of applications. However, when users do not respect the limitations of such systems, performance typically…

Computation and Language · Computer Science 2007-05-23 Diane J. Litman , Shimei Pan

Task-Oriented Dialogue (TOD) systems are drawing more and more attention in recent studies. Current methods focus on constructing pre-trained models or fine-tuning strategies while the evaluation of TOD is limited by a policy mismatch…

Computation and Language · Computer Science 2022-10-27 Qinyuan Cheng , Linyang Li , Guofeng Quan , Feng Gao , Xiaofeng Mou , Xipeng Qiu

Large Language Model (LLM)-based agents have significantly impacted Task-Oriented Dialog Systems (TODS) but continue to face notable performance challenges, especially in zero-shot scenarios. While prior work has noted this performance gap,…

Computation and Language · Computer Science 2025-06-17 Avinash Baidya , Kamalika Das , Xiang Gao

Task-oriented dialog(TOD) aims to assist users in achieving specific goals through multi-turn conversation. Recently, good results have been obtained based on large pre-trained models. However, the labeled-data scarcity hinders the…

Computation and Language · Computer Science 2022-12-26 Zhitong Yang , Xing Ma , Anqi Liu , Zheyu Zhang

Task-oriented Dialog (ToD) systems have to solve multiple subgoals to accomplish user goals, whereas feedback is often obtained only at the end of the dialog. In this work, we propose SUIT (SUbgoal-aware ITerative Training), an iterative…

Computation and Language · Computer Science 2024-11-26 Magdalena Kaiser , Patrick Ernst , György Szarvas

Creating effective and reliable task-oriented dialog systems (ToDSs) is challenging, not only because of the complex structure of these systems, but also due to the scarcity of training data, especially when several modules need to be…

Computation and Language · Computer Science 2024-06-11 Christos Vlachos , Themos Stafylakis , Ion Androutsopoulos

In spoken Task-Oriented Dialogue (TOD) systems, the choice of the semantic representation describing the users' requests is key to a smooth interaction. Indeed, the system uses this representation to reason over a database and its domain…

Artificial Intelligence · Computer Science 2024-06-21 Lucas Druart , Valentin Vielzeuf , Yannick Estève