English
Related papers

Related papers: Annotation Inconsistency and Entity Bias in MultiW…

200 papers

To advance multi-domain (cross-domain) dialogue modeling as well as alleviate the shortage of Chinese task-oriented datasets, we propose CrossWOZ, the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented dataset. It contains 6K…

Computation and Language · Computer Science 2020-03-02 Qi Zhu , Kaili Huang , Zheng Zhang , Xiaoyan Zhu , Minlie Huang

While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap between seen slot values (i.e., values that occur in both…

Computation and Language · Computer Science 2020-02-25 Xiaohui Song , Liangjun Zang , Yipeng Su , Xing Wu , Jizhong Han , Songlin Hu

Dialogue state tracking (DST) is an essential sub-task for task-oriented dialogue systems. Recent work has focused on deep neural models for DST. However, the neural models require a large dataset for training. Furthermore, applying them to…

Computation and Language · Computer Science 2022-10-06 Hyunmin Jeon , Gary Geunbae Lee

Dialog state tracking is used to estimate the current belief state of a dialog given all the preceding conversation. Machine reading comprehension, on the other hand, focuses on building systems that read passages of text and answer…

Computation and Language · Computer Science 2019-08-16 Shuyang Gao , Abhishek Sethi , Sanchit Agarwal , Tagyoung Chung , Dilek Hakkani-Tur

Dialogue systems need to deal with the unpredictability of user intents to track dialogue state and the heterogeneity of slots to understand user preferences. In this paper we investigate the hypothesis that solving these challenges as one…

Computation and Language · Computer Science 2023-08-14 Diogo Tavares , Pedro Azevedo , David Semedo , Ricardo Sousa , João Magalhães

This paper focuses on the EmoWoz dataset, an extension of MultiWOZ that provides emotion labels for the dialogues. MultiWOZ was partitioned initially for another purpose, resulting in a distributional shift when considering the new purpose…

Computation and Language · Computer Science 2023-03-24 Moeen Mostafavi , Michael D. Porter

Learning from free-text human feedback is essential for dialog systems, but annotated data is scarce and usually covers only a small fraction of error types known in conversational AI. Instead of collecting and annotating new datasets from…

Computation and Language · Computer Science 2023-10-25 Dominic Petrak , Nafise Sadat Moosavi , Ye Tian , Nikolai Rozanov , Iryna Gurevych

This paper presents a novel approach for multi-task learning of language understanding (LU) and dialogue state tracking (DST) in task-oriented dialogue systems. Multi-task training enables the sharing of the neural network layers…

Computation and Language · Computer Science 2018-11-14 Abhinav Rastogi , Raghav Gupta , Dilek Hakkani-Tur

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Dialogue state tracking (DST) aims to predict the current dialogue state given the dialogue history. Existing methods generally exploit the utterances of all dialogue turns to assign value for each slot. This could lead to suboptimal…

Computation and Language · Computer Science 2022-05-06 Yifan Wang , Jing Zhao , Junwei Bao , Chaoqun Duan , Youzheng Wu , Xiaodong He

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs is key to a smooth interaction. Traditionally TOD systems are composed of several modules that interact with one another. While each…

Computation and Language · Computer Science 2023-11-21 Lucas Druart , Léo Jacqmin , Benoît Favre , Lina Maria Rojas-Barahona , Valentin Vielzeuf

Recent advancements in Large Language Models (LLMs) have been reshaping Natural Language Processing (NLP) task in several domains. Their use in the field of Human Resources (HR) has still room for expansions and could be beneficial for…

Computation and Language · Computer Science 2024-02-05 Weijie Xu , Zicheng Huang , Wenxiang Hu , Xi Fang , Rajesh Kumar Cherukuri , Naumaan Nayyar , Lorenzo Malandri , Srinivasan H. Sengamedu

Recently, low-resource dialogue state tracking (DST) has received increasing attention. First obtaining state values then based on values to generate slot types has made great progress in this task. However, obtaining state values is still…

Computation and Language · Computer Science 2024-01-31 Ming Gu , Yan Yang , Chengcai Chen , Zhou Yu

Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and…

Computation and Language · Computer Science 2023-10-24 Praveen Venkateswaran , Evelyn Duesterwald , Vatche Isahagian

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this problem. In this paper, we hypothesize that dialogue summaries…

Computation and Language · Computer Science 2022-03-04 Jamin Shin , Hangyeol Yu , Hyeongdon Moon , Andrea Madotto , Juneyoung Park

Dialogue State Tracking (DST) is primarily evaluated using Joint Goal Accuracy (JGA) defined as the fraction of turns where the ground-truth dialogue state exactly matches the prediction. Generally in DST, the dialogue state or belief state…

Computation and Language · Computer Science 2022-04-08 Suvodip Dey , Ramamohan Kummara , Maunendra Sankar Desarkar

Recent advances in artificial intelligence, including the development of highly sophisticated large language models (LLM), have proven beneficial in many real-world applications. However, evidence of inherent bias encoded in these LLMs has…

Computation and Language · Computer Science 2023-09-19 Vithya Yogarajan , Gillian Dobbie , Timothy Pistotti , Joshua Bensemann , Kobe Knowles

We present a new approach to dialogue management using conversational knowledge graphs as core representation of the dialogue state. To this end, we introduce a new dataset, GraphWOZ, which comprises Wizard-of-Oz dialogues in which human…

Computation and Language · Computer Science 2022-11-24 Nicholas Thomas Walker , Stefan Ultes , Pierre Lison

Based on the recently proposed transferable dialogue state generator (TRADE) that predicts dialogue states from utterance-concatenated dialogue context, we propose a multi-task learning model with a simple yet effective utterance tagging…

Computation and Language · Computer Science 2020-04-30 Jun Quan , Deyi Xiong

Recent LLMs have enabled significant advancements for conversational agents. However, they are also well known to hallucinate, producing responses that seem plausible but are factually incorrect. On the other hand, users tend to over-rely…

Computation and Language · Computer Science 2025-07-01 Suvodip Dey , Yi-Jyun Sun , Gokhan Tur , Dilek Hakkani-Tur