English
Related papers

Related papers: Is MultiWOZ a Solved Task? An Interactive TOD Eval…

200 papers

Task-oriented dialog systems empower users to accomplish their goals by facilitating intuitive and expressive natural language interactions. State-of-the-art approaches in task-oriented dialog systems formulate the problem as a conditional…

Computation and Language · Computer Science 2024-07-24 Adib Mosharrof , M. H. Maqbool , A. B. Siddique

Intent detection is a key part of any Natural Language Understanding (NLU) system of a conversational assistant. Detecting the correct intent is essential yet difficult for email conversations where multiple directives and intents are…

Computation and Language · Computer Science 2022-08-22 Soham Deshmukh , Charles Lee

Recently, there have merged a class of task-oriented dialogue (TOD) datasets collected through Wizard-of-Oz simulated games. However, the Wizard-of-Oz data are in fact simulated data and thus are fundamentally different from real-life…

Computation and Language · Computer Science 2022-10-19 Hong Liu , Hao Peng , Zhijian Ou , Juanzi Li , Yi Huang , Junlan Feng

MultiWOZ is a well-known task-oriented dialogue dataset containing over 10,000 annotated dialogues spanning 8 domains. It is extensively used as a benchmark for dialogue state tracking. However, recent works have reported presence of…

Computation and Language · Computer Science 2020-07-28 Xiaoxue Zang , Abhinav Rastogi , Srinivas Sunkara , Raghav Gupta , Jianguo Zhang , Jindong Chen

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

Computation and Language · Computer Science 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

Large Language Models (LLMs) achieve strong performance on many reasoning benchmarks, yet these evaluations typically focus on isolated tasks that differ from real-world usage in task-oriented dialogue (TOD). In this setting, LLMs must…

Computation and Language · Computer Science 2026-04-30 Ivan Kartáč , Mateusz Lango , Ondřej Dušek

Creating effective and reliable task-oriented dialog systems (ToDSs) is challenging, not only because of the complex structure of these systems, but also due to the scarcity of training data, especially when several modules need to be…

Computation and Language · Computer Science 2024-06-11 Christos Vlachos , Themos Stafylakis , Ion Androutsopoulos

Existing end-to-end modeling methods for modular task-oriented dialog systems are typically tailored to specific datasets, making it challenging to adapt to new dialog scenarios. In this work, we propose ESAinsTOD, a unified End-to-end…

Computation and Language · Computer Science 2026-03-11 Dechuan Teng , Chunlin Lu , Libo Qin , Wanxiang Che

The underlying difference of linguistic patterns between general text and task-oriented dialogue makes existing pre-trained language models less useful in practice. In this work, we unify nine human-human and multi-turn task-oriented…

Computation and Language · Computer Science 2020-10-02 Chien-Sheng Wu , Steven Hoi , Richard Socher , Caiming Xiong

Task-oriented dialogue (TOD) systems are commonly designed with the presumption that each utterance represents a single intent. However, this assumption may not accurately reflect real-world situations, where users frequently express…

Computation and Language · Computer Science 2024-03-28 Yejin Yoon , Jungyeon Lee , Kangsan Kim , Chanhee Park , Taeuk Kim

When learning task-oriented dialogue (ToD) agents, reinforcement learning (RL) techniques can naturally be utilized to train dialogue strategies to achieve user-specific goals. Prior works mainly focus on adopting advanced RL techniques to…

Computation and Language · Computer Science 2023-02-22 Yihao Feng , Shentao Yang , Shujian Zhang , Jianguo Zhang , Caiming Xiong , Mingyuan Zhou , Huan Wang

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

Computation and Language · Computer Science 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Most existing task-oriented dialog (TOD) systems track dialog states in terms of slots and values and use them to query a database to get relevant knowledge to generate responses. In real-life applications, user utterances are noisier, and…

Computation and Language · Computer Science 2023-05-23 Yucheng Cai , Hong Liu , Zhijian Ou , Yi Huang , Junlan Feng

The recent paradigm shift toward large reasoning models (LRMs) as autonomous agents has intensified the demand for sophisticated, multi-turn tool-use capabilities. Yet, existing datasets and data-generation approaches are limited by static,…

Computation and Language · Computer Science 2026-01-14 Jungho Cho , Minbyul Jeong , Sungrae Park

Clarifying user needs is essential for existing task-oriented dialogue systems. However, in real-world applications, developers can never guarantee that all possible user demands are taken into account in the design phase. Consequently,…

Computation and Language · Computer Science 2019-06-13 Weikang Wang , Jiajun Zhang , Qian Li , Mei-Yuh Hwang , Chengqing Zong , Zhifei Li

Large language models (LLMs) gained immense popularity due to their impressive capabilities in unstructured conversations. Empowering LLMs with advanced prompting strategies such as reasoning and acting (ReAct) (Yao et al., 2022) has shown…

Computation and Language · Computer Science 2025-03-18 Michelle Elizabeth , Morgan Veyret , Miguel Couceiro , Ondrej Dusek , Lina M. Rojas-Barahona

Task-oriented Dialogue (ToD) agents are mostly limited to a few widely-spoken languages, mainly due to the high cost of acquiring training data for each language. Existing low-cost approaches that rely on cross-lingual embeddings or naive…

Computation and Language · Computer Science 2023-02-21 Mehrad Moradshahi , Sina J. Semnani , Monica S. Lam

Large Language Models (LLMs) with API-calling capabilities enabled building effective Language Agents (LA), while also revolutionizing the conventional task-oriented dialogue (TOD) paradigm. However, current approaches face a critical…

An intelligent dialogue system in a multi-turn setting should not only generate the responses which are of good quality, but it should also generate the responses which can lead to long-term success of the dialogue. Although, the current…

Computation and Language · Computer Science 2023-01-12 Anant Khandelwal