English
Related papers

Related papers: Is MultiWOZ a Solved Task? An Interactive TOD Eval…

200 papers

Task-oriented dialogue systems have made unprecedented progress with multiple state-of-the-art (SOTA) models underpinned by a number of publicly available MultiWOZ datasets. Dialogue state annotations are error-prone, leading to sub-optimal…

Computation and Language · Computer Science 2021-06-15 Ting Han , Ximing Liu , Ryuichi Takanobu , Yixin Lian , Chongxuan Huang , Dazhen Wan , Wei Peng , Minlie Huang

One of the difficulties in training dialogue systems is the lack of training data. We explore the possibility of creating dialogue data through the interaction between a dialogue system and a user simulator. Our goal is to develop a…

Computation and Language · Computer Science 2021-07-27 Bo-Hsiang Tseng , Yinpei Dai , Florian Kreyssig , Bill Byrne

Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented dialogue system,…

Computation and Language · Computer Science 2021-07-08 Hyunmin Jeon , Gary Geunbae Lee

An important unexplored aspect in previous work on user satisfaction estimation for Task-Oriented Dialogue (TOD) systems is their evaluation in terms of robustness for the identification of user dissatisfaction: current benchmarks for user…

Computation and Language · Computer Science 2024-08-21 Amin Abolghasemi , Zhaochun Ren , Arian Askari , Mohammad Aliannejadi , Maarten de Rijke , Suzan Verberne

Task-oriented dialogue systems have garnered significant attention due to their conversational ability to accomplish goals, such as booking airline tickets for users. Traditionally, task-oriented dialogue systems are conceptualized as…

Computation and Language · Computer Science 2025-11-18 Pu-Hai Yang , Heyan Huang , Heng-Da Xu , Fanshu Sun , Xian-Ling Mao , Chaoxu Mu

Even though machine learning has become the major scene in dialogue research community, the real breakthrough has been blocked by the scale of data available. To address this fundamental obstacle, we introduce the Multi-Domain Wizard-of-Oz…

Computation and Language · Computer Science 2020-04-21 Paweł Budzianowski , Tsung-Hsien Wen , Bo-Hsiang Tseng , Iñigo Casanueva , Stefan Ultes , Osman Ramadan , Milica Gašić

The goal of building intelligent dialogue systems has largely been separately pursued under two motives: task-oriented dialogue (TOD) systems, and open-domain systems for chit-chat (CC). Although previous TOD dialogue systems work well in…

Computation and Language · Computer Science 2022-05-13 Changhong Yu , Chunhong Zhang , Qi Sun

Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context…

In the realm of dialogue systems, user simulation techniques have emerged as a game-changer, redefining the evaluation and enhancement of task-oriented dialogue (TOD) systems. These methods are crucial for replicating real user…

Task-oriented dialogue (TOD) systems have assisted users on many tasks, including ticket booking and service inquiries. While existing TOD systems have shown promising performance in serving customer needs, these systems mostly assume that…

Computation and Language · Computer Science 2022-10-25 Zhiqiang Hu , Roy Kaa-Wei Lee , Nancy F. Chen

During task-oriented dialogues (TODs), human users naturally introduce chitchat that is beyond the immediate scope of the task, interfering with the flow of the conversation. To address this issue without the need for expensive manual data…

Computation and Language · Computer Science 2024-07-01 Armand Stricker , Patrick Paroubek

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain…

Computation and Language · Computer Science 2020-10-07 Oluwatobi O. Olabiyi , Prarthana Bhattarai , C. Bayan Bruss , Zachary Kulis

This paper explores SynTOD, a new synthetic data generation approach for developing end-to-end Task-Oriented Dialogue (TOD) Systems capable of handling complex tasks such as intent classification, slot filling, conversational…

Computation and Language · Computer Science 2024-04-24 Chris Samarinas , Pracha Promthaw , Atharva Nijasure , Hansi Zeng , Julian Killingback , Hamed Zamani

Popular dialog datasets such as MultiWOZ are created by providing crowd workers an instruction, expressed in natural language, that describes the task to be accomplished. Crowd workers play the role of a user and an agent to generate…

Computation and Language · Computer Science 2021-10-22 Biswesh Mohapatra , Gaurav Pandey , Danish Contractor , Sachindra Joshi

Achieving robust language technologies that can perform well across the world's many languages is a central goal of multilingual NLP. In this work, we take stock of and empirically analyse task performance disparities that exist between…

Computation and Language · Computer Science 2023-10-20 Songbo Hu , Han Zhou , Moy Yuan , Milan Gritta , Guchun Zhang , Ignacio Iacobacci , Anna Korhonen , Ivan Vulić

In task-oriented dialogue (ToD), a user holds a conversation with an artificial agent to complete a concrete task. Although this technology represents one of the central objectives of AI and has been the focus of ever more intense research…

Computation and Language · Computer Science 2022-05-27 Evgeniia Razumovskaia , Goran Glavaš , Olga Majewska , Edoardo M. Ponti , Anna Korhonen , Ivan Vulić

The MultiWOZ 2.0 dataset has greatly stimulated the research of task-oriented dialogue systems. However, its state annotations contain substantial noise, which hinders a proper evaluation of model performance. To address this issue, massive…

Computation and Language · Computer Science 2022-07-12 Fanghua Ye , Jarana Manotumruksa , Emine Yilmaz

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Task-oriented dialogue (TOD) systems have been widely used by mobile phone intelligent assistants to accomplish tasks such as calendar scheduling or hotel reservation. Current TOD systems usually focus on multi-turn text/speech interaction,…

Computation and Language · Computer Science 2024-03-04 Liangtai Sun , Xingyu Chen , Lu Chen , Tianle Dai , Zichen Zhu , Kai Yu

Many efforts have been made to construct dialog systems for different types of conversations, such as task-oriented dialog (TOD) and open-domain dialog (ODD). To better mimic human-level conversations that usually fuse various dialog modes,…

Computation and Language · Computer Science 2023-08-01 Miaoran Li , Baolin Peng , Michel Galley , Jianfeng Gao , Zhu Zhang