中文
相关论文

相关论文: CoCo: Controllable Counterfactuals for Evaluating …

200 篇论文

In task-oriented multi-turn dialogue systems, dialogue state refers to a compact representation of the user goal in the context of dialogue history. Dialogue state tracking (DST) is to estimate the dialogue state at each turn. Due to the…

计算与语言 · 计算机科学 2020-09-23 Zhi Chen , Lu Chen , Yanbin Zhao , Su Zhu , Kai Yu

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing…

计算与语言 · 计算机科学 2020-04-14 Shuyang Gao , Sanchit Agarwal , Tagyoung Chung , Di Jin , Dilek Hakkani-Tur

While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap between seen slot values (i.e., values that occur in both…

计算与语言 · 计算机科学 2020-02-25 Xiaohui Song , Liangjun Zang , Yipeng Su , Xing Wu , Jizhong Han , Songlin Hu

While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the…

计算与语言 · 计算机科学 2022-08-01 Léo Jacqmin , Lina M. Rojas-Barahona , Benoit Favre

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

计算与语言 · 计算机科学 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

Counterfactual examples have proven to be valuable in the field of natural language processing (NLP) for both evaluating and improving the robustness of language models to spurious correlations in datasets. Despite their demonstrated…

机器学习 · 计算机科学 2023-11-01 Tiep Le , Vasudev Lal , Phillip Howard

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

计算与语言 · 计算机科学 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

Existing approaches to dialogue state tracking rely on pre-defined ontologies consisting of a set of all possible slot types and values. Though such approaches exhibit promising performance on single-domain benchmarks, they suffer from…

人工智能 · 计算机科学 2019-10-21 Liliang Ren , Jianmo Ni , Julian McAuley

Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems. The domain ontology (i.e., specification of domains, slots, and values) of a conversational AI system is generally incomplete, making the…

计算与语言 · 计算机科学 2020-06-23 Li Zhou , Kevin Small

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

计算与语言 · 计算机科学 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

Dialogue state tracking (DST) is an essential component in task-oriented dialogue systems, which estimates user goals at every dialogue turn. However, most previous approaches usually suffer from the following problems. Many discriminative…

计算与语言 · 计算机科学 2019-08-22 Qingbin Liu , Shizhu He , Kang Liu , Shengping Liu , Jun Zhao

A Dialogue State Tracker is a key component in dialogue systems which estimates the beliefs of possible user goals at each dialogue turn. Deep learning approaches using recurrent neural networks have shown state-of-the-art performance for…

计算与语言 · 计算机科学 2019-11-04 Vevake Balaraman , Bernardo Magnini

Dialogue state tracking (DST) is an essential sub-task for task-oriented dialogue systems. Recent work has focused on deep neural models for DST. However, the neural models require a large dataset for training. Furthermore, applying them to…

计算与语言 · 计算机科学 2022-10-06 Hyunmin Jeon , Gary Geunbae Lee

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

计算与语言 · 计算机科学 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

Recent studies in dialogue state tracking (DST) leverage historical information to determine states which are generally represented as slot-value pairs. However, most of them have limitations to efficiently exploit relevant context due to…

计算与语言 · 计算机科学 2020-12-22 Yong Shan , Zekang Li , Jinchao Zhang , Fandong Meng , Yang Feng , Cheng Niu , Jie Zhou

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

计算与语言 · 计算机科学 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is a major obstacle due to increased numbers of state candidates and dialogue…

计算与语言 · 计算机科学 2020-10-08 Su Zhu , Jieyu Li , Lu Chen , Kai Yu

Dialogue State Tracking (DST) is primarily evaluated using Joint Goal Accuracy (JGA) defined as the fraction of turns where the ground-truth dialogue state exactly matches the prediction. Generally in DST, the dialogue state or belief state…

计算与语言 · 计算机科学 2022-04-08 Suvodip Dey , Ramamohan Kummara , Maunendra Sankar Desarkar

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

计算与语言 · 计算机科学 2024-06-14 James D. Finch , Jinho D. Choi