English
Related papers

Related papers: CoCo: Controllable Counterfactuals for Evaluating …

200 papers

Data augmentation methods have been a promising direction to improve the performance of small models for low-resource dialogue state tracking. However, traditional methods rely on pre-defined user goals and neglect the importance of data…

Computation and Language · Computer Science 2024-06-14 Ming Gu , Yan Yang

Task oriented dialogue systems (TOD) complete particular tasks based on user preferences across natural language interactions. Considering the impressive performance of large language models (LLMs) in natural language processing (NLP)…

Computation and Language · Computer Science 2025-10-08 Arezoo Saedi , Afsaneh Fatemi , Mohammad Ali Nematbakhsh , Sophie Rosset , Anne Vilnat

Programmable task-oriented dialogue (TOD) agents enable language models to follow structured dialogue policies, but their effectiveness hinges on accurate state tracking. We present PyTOD, an agent that generates executable code to track…

Task-oriented dialog systems have witnessed substantial progress due to conversational pre-training techniques. Yet, two significant challenges persist. First, most systems primarily utilize the latest turn's state label for the generator.…

Computation and Language · Computer Science 2024-01-30 Longxiang Liu , Xiuxing Li , Yang Feng

Dialogue State Tracking is central to multi-domain task-oriented dialogue systems, responsible for extracting information from user utterances. We present a novel hybrid architecture that augments GPT-2 with representations derived from…

Computation and Language · Computer Science 2021-09-24 Weizhe Lin , Bo-Hsiang Tseng , Bill Byrne

An important unexplored aspect in previous work on user satisfaction estimation for Task-Oriented Dialogue (TOD) systems is their evaluation in terms of robustness for the identification of user dissatisfaction: current benchmarks for user…

Computation and Language · Computer Science 2024-08-21 Amin Abolghasemi , Zhaochun Ren , Arian Askari , Mohammad Aliannejadi , Maarten de Rijke , Suzan Verberne

Faithful generation in large language models (LLMs) is challenged by knowledge conflicts between parametric memory and external context. Existing contrastive decoding methods tuned specifically to handle conflict often lack adaptability and…

Computation and Language · Computer Science 2025-08-28 Anant Khandelwal , Manish Gupta , Puneet Agrawal

Dialogue State Tracking (DST) is an essential element of conversational AI with the objective of deeply understanding the conversation context and leading it toward answering user requests. Due to high demands for open-domain and multi-turn…

Computation and Language · Computer Science 2025-10-02 Samin Mahdipour Aghabagher , Saeedeh Momtazi

Dialogue state tracking (DST) plays an important role in task-oriented dialogue systems. However, collecting a large amount of turn-by-turn annotated dialogue data is costly and inefficient. In this paper, we propose a novel turn-level…

Computation and Language · Computer Science 2023-10-24 Zihan Zhang , Meng Fang , Fanghua Ye , Ling Chen , Mohammad-Reza Namazi-Rad

Dialog State Tracking (DST) is one of the most crucial modules for goal-oriented dialogue systems. In this paper, we introduce FastSGT (Fast Schema Guided Tracker), a fast and robust BERT-based model for state tracking in goal-oriented…

Machine Learning · Computer Science 2020-08-31 Vahid Noroozi , Yang Zhang , Evelina Bakhturina , Tomasz Kornuta

This paper presents a novel approach for multi-task learning of language understanding (LU) and dialogue state tracking (DST) in task-oriented dialogue systems. Multi-task training enables the sharing of the neural network layers…

Computation and Language · Computer Science 2018-11-14 Abhinav Rastogi , Raghav Gupta , Dilek Hakkani-Tur

Large-scale Wizard-Of-Oz dialogue datasets have enabled the training of deep learning-based dialogue systems. While they are successful as benchmark datasets, they lack certain types of utterances, which would make them more realistic. In…

Computation and Language · Computer Science 2024-12-11 Sebastian Steindl , Ulrich Schäfer , Bernd Ludwig

Dialogue State Tracking (DST) forms a core component of automated chatbot based systems designed for specific goals like hotel, taxi reservation, tourist information, etc. With the increasing need to deploy such systems in new domains,…

Computation and Language · Computer Science 2021-04-06 Saket Dingliwal , Bill Gao , Sanchit Agarwal , Chien-Wei Lin , Tagyoung Chung , Dilek Hakkani-Tur

We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends this graph. Programs include metacomputation operators for…

Most task-oriented dialogue (TOD) benchmarks assume users that know exactly how to use the system by constraining the user behaviors within the system's capabilities via strict user goals, namely "user familiarity" bias. This data bias…

Computation and Language · Computer Science 2024-07-02 Takyoung Kim , Jamin Shin , Young-Ho Kim , Sanghwan Bae , Sungdong Kim

This paper describes our approach to DSTC 9 Track 2: Cross-lingual Multi-domain Dialog State Tracking, the task goal is to build a Cross-lingual dialog state tracker with a training set in rich resource language and a testing set in low…

Computation and Language · Computer Science 2021-07-01 Min Mao , Jiasheng Liu , Jingyao Zhou , Haipang Wu

Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence of actions in a particular order. While prior work has…

Computation and Language · Computer Science 2023-11-15 Do June Min , Paloma Sodhi , Ramya Ramakrishnan

Fact-based dialogue generation is a task of generating a human-like response based on both dialogue context and factual texts. Various methods were proposed to focus on generating informative words that contain facts effectively. However,…

Computation and Language · Computer Science 2020-05-11 Ryota Tanaka , Akinobu Lee

The Dialog State Tracking Challenge 4 (DSTC 4) differentiates itself from the previous three editions as follows: the number of slot-value pairs present in the ontology is much larger, no spoken language understanding output is given, and…

Computation and Language · Computer Science 2016-05-10 Franck Dernoncourt , Ji Young Lee , Trung H. Bui , Hung H. Bui

Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model…

Computation and Language · Computer Science 2025-02-24 Christopher Richardson , Roshan Sharma , Neeraj Gaur , Parisa Haghani , Anirudh Sundar , Bhuvana Ramabhadran