English
Related papers

Related papers: RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz D…

200 papers

Structured belief states are crucial for user goal tracking and database query in task-oriented dialog systems. However, training belief trackers often requires expensive turn-level annotations of every user utterance. In this paper we aim…

Computation and Language · Computer Science 2020-10-14 Yichi Zhang , Zhijian Ou , Huixin Wang , Junlan Feng

Dialogue policy optimization often obtains feedback until task completion in task-oriented dialogue systems. This is insufficient for training intermediate dialogue turns since supervision signals (or rewards) are only provided at the end…

Computation and Language · Computer Science 2020-05-12 Xinting Huang , Jianzhong Qi , Yu Sun , Rui Zhang

The adoption of pre-trained language models in task-oriented dialogue systems has resulted in significant enhancements of their text generation abilities. However, these architectures are slow to use because of the large number of trainable…

Computation and Language · Computer Science 2023-02-14 Radostin Cholakov , Todor Kolev

As a crucial component in task-oriented dialog systems, the Natural Language Generation (NLG) module converts a dialog act represented in a semantic form into a response in natural language. The success of traditional template-based or…

Computation and Language · Computer Science 2020-02-28 Baolin Peng , Chenguang Zhu , Chunyuan Li , Xiujun Li , Jinchao Li , Michael Zeng , Jianfeng Gao

Training task-oriented dialogue systems typically requires turn-level annotations for interacting with their APIs: e.g. a dialogue state and the system actions taken at each step. These annotations can be costly to produce, error-prone, and…

Computation and Language · Computer Science 2024-10-17 Brendan King , Jeffrey Flanigan

Pragmatic reasoning plays a pivotal role in deciphering implicit meanings that frequently arise in real-life conversations and is essential for the development of communicative social agents. In this paper, we introduce a novel challenge,…

Computation and Language · Computer Science 2023-06-21 Hengli Li , Song-Chun Zhu , Zilong Zheng

Annotating task-oriented dialogues is notorious for the expensive and difficult data collection process. Few-shot dialogue state tracking (DST) is a realistic solution to this problem. In this paper, we hypothesize that dialogue summaries…

Computation and Language · Computer Science 2022-03-04 Jamin Shin , Hangyeol Yu , Hyeongdon Moon , Andrea Madotto , Juneyoung Park

The MultiWOZ dataset (Budzianowski et al.,2018) is frequently used for benchmarking context-to-response abilities of task-oriented dialogue systems. In this work, we identify inconsistencies in data preprocessing and reporting of three…

Computation and Language · Computer Science 2021-06-11 Tomáš Nekvinda , Ondřej Dušek

Recent advancements in reference-free learned metrics for open-domain dialogue evaluation have been driven by the progress in pre-trained language models and the availability of dialogue data with high-quality human annotations. However,…

Computation and Language · Computer Science 2023-10-16 Chen Zhang , Luis Fernando D'Haro , Chengguang Tang , Ke Shi , Guohua Tang , Haizhou Li

In the realm of dialogue systems, user simulation techniques have emerged as a game-changer, redefining the evaluation and enhancement of task-oriented dialogue (TOD) systems. These methods are crucial for replicating real user…

Recently, research on open domain dialogue systems have attracted extensive interests of academic and industrial researchers. The goal of an open domain dialogue system is to imitate humans in conversations. Previous works on single turn…

Computation and Language · Computer Science 2024-10-29 Wei-Nan Zhang , Yiming Cui , Kaiyan Zhang , Yifa Wang , Qingfu Zhu , Lingzhi Li , Ting Liu

Disentangling conversations mixed together in a single stream of messages is a difficult task, made harder by the lack of large manually annotated datasets. We created a new dataset of 77,563 messages manually annotated with reply-structure…

While the English virtual assistants have achieved exciting performance with an enormous amount of training resources, the needs of non-English-speakers have not been satisfied well. Up to Dec 2021, Alexa, one of the most popular smart…

Computation and Language · Computer Science 2021-12-24 Michael Sun , Kaili Huang , Mehrad Moradshahi

Creating spoken dialogue datasets is methodologically challenging, and these challenges are amplified when the goal is to build multilingual, multi-parallel datasets at scale. This work introduces HEALTHDIAL, a large-scale, multilingual,…

Computation and Language · Computer Science 2026-05-29 Songbo Hu , Yinhong Liu , Ej Zhou , Evgeniia Razumovskaia , Xiaobin Wang , Alexander Fraser , Ivan Vulić , Anna Korhonen

Dialogue systems have been widely applied in many scenarios and are now more powerful and ubiquitous than ever before. With large neural models and massive available data, current dialogue systems have access to more knowledge than any…

Recent progress in task-oriented neural dialogue systems is largely focused on a handful of languages, as annotation of training data is tedious and expensive. Machine translation has been used to make systems multilingual, but this can…

Computation and Language · Computer Science 2021-09-29 Nikita Moghe , Mark Steedman , Alexandra Birch

The MultiWOZ 2.0 dataset has greatly boosted the research on dialogue state tracking (DST). However, substantial noise has been discovered in its state annotations. Such noise brings about huge challenges for training DST models robustly.…

Computation and Language · Computer Science 2022-03-15 Fanghua Ye , Yue Feng , Emine Yilmaz

With the rapid development of large language models, researchers have created increasingly advanced spoken dialogue systems that can naturally converse with humans. However, these systems still struggle to handle the full complexity of…

Computation and Language · Computer Science 2025-01-03 Xize Cheng , Dongjie Fu , Xiaoda Yang , Minghui Fang , Ruofan Hu , Jingyu Lu , Bai Jionghao , Zehan Wang , Shengpeng Ji , Rongjie Huang , Linjun Li , Yu Chen , Tao Jin , Zhou Zhao

Current dialogue systems are not very engaging for users, especially when trained end-to-end without relying on proactive reengaging scripted strategies. Zhang et al. (2018) showed that the engagement level of end-to-end dialogue models…

Computation and Language · Computer Science 2018-09-07 Pierre-Emmanuel Mazaré , Samuel Humeau , Martin Raison , Antoine Bordes

Embodied agents need to be able to interact in natural language understanding task descriptions and asking appropriate follow up questions to obtain necessary information to be effective at successfully accomplishing tasks for a wide range…

Computation and Language · Computer Science 2022-09-28 Spandana Gella , Aishwarya Padmakumar , Patrick Lange , Dilek Hakkani-Tur