中文
相关论文

相关论文: Mismatch between Multi-turn Dialogue and its Evalu…

200 篇论文

Dialogue state tracking (DST) is an important part of a spoken dialogue system. Existing DST models either ignore temporal feature dependencies across dialogue turns or fail to explicitly model temporal state dependencies in a dialogue. In…

计算与语言 · 计算机科学 2020-10-06 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

Recently, researchers have explored using the encoder-decoder framework to tackle dialogue state tracking (DST), which is a key component of task-oriented dialogue systems. However, they regard a multi-turn dialogue as a flat sequence,…

计算与语言 · 计算机科学 2021-07-27 Linhao Zhang , Houfeng Wang

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

计算与语言 · 计算机科学 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

Dialogue state tracking (DST) is an important step in dialogue management to keep track of users' beliefs. Existing works fine-tune all language model (LM) parameters to tackle the DST task, which requires significant data and computing…

计算与语言 · 计算机科学 2023-05-31 Mingyu Derek Ma , Jiun-Yu Kao , Shuyang Gao , Arpit Gupta , Di Jin , Tagyoung Chung , Nanyun Peng

Recent LLMs have enabled significant advancements for conversational agents. However, they are also well known to hallucinate, producing responses that seem plausible but are factually incorrect. On the other hand, users tend to over-rely…

计算与语言 · 计算机科学 2025-07-01 Suvodip Dey , Yi-Jyun Sun , Gokhan Tur , Dilek Hakkani-Tur

The latency in the current neural based dialogue state tracking models prohibits them from being used efficiently for deployment in production systems, albeit their highly accurate performance. This paper proposes a new scalable and…

计算与语言 · 计算机科学 2018-12-04 Elnaz Nouri , Ehsan Hosseini-Asl

This paper is concerned with dialogue state tracking (DST) in a task-oriented dialogue system. Building a DST module that is highly effective is still a challenging issue, although significant progresses have been made recently. This paper…

计算与语言 · 计算机科学 2021-06-01 Yue Feng , Yang Wang , Hang Li

The MultiWOZ 2.0 dataset has greatly stimulated the research of task-oriented dialogue systems. However, its state annotations contain substantial noise, which hinders a proper evaluation of model performance. To address this issue, massive…

计算与语言 · 计算机科学 2022-07-12 Fanghua Ye , Jarana Manotumruksa , Emine Yilmaz

An ideal dialogue system requires continuous skill acquisition and adaptation to new tasks while retaining prior knowledge. Dialogue State Tracking (DST), vital in these systems, often involves learning new services and confronting…

计算与语言 · 计算机科学 2024-10-17 Yujie Feng , Bo Liu , Xiaoyu Dong , Zexin Lu , Li-Ming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Task-Oriented Dialogue (TOD) systems are drawing more and more attention in recent studies. Current methods focus on constructing pre-trained models or fine-tuning strategies while the evaluation of TOD is limited by a policy mismatch…

计算与语言 · 计算机科学 2022-10-27 Qinyuan Cheng , Linyang Li , Guofeng Quan , Feng Gao , Xiaofeng Mou , Xipeng Qiu

Dialog State Tracking (DST) is one of the most crucial modules for goal-oriented dialogue systems. In this paper, we introduce FastSGT (Fast Schema Guided Tracker), a fast and robust BERT-based model for state tracking in goal-oriented…

机器学习 · 计算机科学 2020-08-31 Vahid Noroozi , Yang Zhang , Evelina Bakhturina , Tomasz Kornuta

Based on the recently proposed transferable dialogue state generator (TRADE) that predicts dialogue states from utterance-concatenated dialogue context, we propose a multi-task learning model with a simple yet effective utterance tagging…

计算与语言 · 计算机科学 2020-04-30 Jun Quan , Deyi Xiong

In contrast with goal-oriented dialogue, social dialogue has no clear measure of task success. Consequently, evaluation of these systems is notoriously hard. In this paper, we review current evaluation methods, focusing on automatic…

计算与语言 · 计算机科学 2017-09-14 Amanda Cercas Curry , Helen Hastie , Verena Rieser

Collecting and annotating task-oriented dialogues is time-consuming and costly; thus, zero and few shot learning could greatly benefit dialogue state tracking (DST). In this work, we propose an in-context learning (ICL) framework for…

计算与语言 · 计算机科学 2022-10-27 Yushi Hu , Chia-Hsuan Lee , Tianbao Xie , Tao Yu , Noah A. Smith , Mari Ostendorf

Dialogue policy optimization often obtains feedback until task completion in task-oriented dialogue systems. This is insufficient for training intermediate dialogue turns since supervision signals (or rewards) are only provided at the end…

计算与语言 · 计算机科学 2020-05-12 Xinting Huang , Jianzhong Qi , Yu Sun , Rui Zhang

Interest in dialog systems has grown substantially in the past decade. By extension, so too has interest in developing and improving intent classification and slot-filling models, which are two components that are commonly used in…

计算与语言 · 计算机科学 2022-07-28 Stefan Larson , Kevin Leach

In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to…

High-quality datasets for task-oriented dialog are crucial for the development of virtual assistants. Yet three of the most relevant large scale dialog datasets suffer from one common flaw: the dialog state update can be tracked, to a great…

计算与语言 · 计算机科学 2022-03-08 Alice Shoshana Jakobovits , Francesco Piccinno , Yasemin Altun

Dialog state tracking is a key component of many modern dialog systems, most of which are designed with a single, well-defined domain in mind. This paper shows that dialog data drawn from different dialog domains can be used to train a…