English
Related papers

Related papers: Robust Task-Oriented Dialogue Generation with Cont…

200 papers

Task-oriented dialog presents a difficult challenge encompassing multiple problems including multi-turn language understanding and generation, knowledge retrieval and reasoning, and action prediction. Modern dialog systems typically begin…

Dialog policies, which determine a system's action based on the current state at each dialog turn, are crucial to the success of the dialog. In recent years, reinforcement learning (RL) has emerged as a promising option for dialog policy…

Reinforcement learning requires interaction with an environment, which is expensive for robots. This constraint necessitates approaches that work with limited environmental interaction by maximizing the reuse of previous experiences. We…

Artificial Intelligence · Computer Science 2024-04-05 Benedict Quartey , Ankit Shah , George Konidaris

The design of better automated dialogue evaluation metrics offers the potential of accelerate evaluation research on conversational AI. However, existing trainable dialogue evaluation models are generally restricted to classifiers trained…

Computation and Language · Computer Science 2021-04-19 Xiang Gao , Yizhe Zhang , Michel Galley , Bill Dolan

Despite the remarkable progress of deep neural networks (DNNs) in various visual tasks, their vulnerability to adversarial examples raises significant security concerns. Recent adversarial training methods leverage inverse adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Kejia Zhang , Juanjuan Weng , Shaozi Li , Zhiming Luo

In this paper, we introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through pre-trained language models (PLMs) have been shown to be…

Computation and Language · Computer Science 2022-10-28 Che Liu , Rui Wang , Junfeng Jiang , Yongbin Li , Fei Huang

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of…

Computation and Language · Computer Science 2017-04-25 Tsung-Hsien Wen , David Vandyke , Nikola Mrksic , Milica Gasic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , Steve Young

Much recent progress in task-oriented dialogue (ToD) systems has been driven by available annotation data across multiple domains for training. Over the last few years, there has been a move towards data curation for multilingual ToD…

Computation and Language · Computer Science 2022-04-04 Bosheng Ding , Junjie Hu , Lidong Bing , Sharifah Mahani Aljunied , Shafiq Joty , Luo Si , Chunyan Miao

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

Computation and Language · Computer Science 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao

Dialogue policy learning, a subtask that determines the content of system response generation and then the degree of task completion, is essential for task-oriented dialogue systems. However, the unbalanced distribution of system actions in…

Computation and Language · Computer Science 2021-06-29 Yunhao Li , Yunyi Yang , Xiaojun Quan , Jianxing Yu

Adversarial robustness evaluates the worst-case performance scenario of a machine learning model to ensure its safety and reliability. This study is the first to investigate the robustness of visually grounded dialog models towards textual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Lu Yu , Verena Rieser

In this paper, we propose Inverse Adversarial Training (IAT) algorithm for training neural dialogue systems to avoid generic responses and model dialogue history better. In contrast to standard adversarial training algorithms, IAT…

Computation and Language · Computer Science 2021-06-01 Wangchunshu Zhou , Qifei Li , Chenle Li

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

Computation and Language · Computer Science 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a classification task for an encoder with well representation…

Computation and Language · Computer Science 2021-12-03 Deshui Miao , Jiaqi Zhang , Wenbo Xie , Jian Song , Xin Li , Lijuan Jia , Ning Guo

Open-domain dialogue generation suffers from the data insufficiency problem due to the vast size of potential responses. In this paper, we propose to explore potential responses by counterfactual reasoning. Given an observed response, the…

Machine Learning · Computer Science 2020-10-12 Qingfu Zhu , Weinan Zhang , Ting Liu , William Yang Wang

In this work, we propose an adversarial learning method for reward estimation in reinforcement learning (RL) based task-oriented dialog models. Most of the current RL based task-oriented dialog systems require the access to a reward signal…

Computation and Language · Computer Science 2018-05-31 Bing Liu , Ian Lane

We recently reported evidence that large language models are capable of solving a wide range of text-based analogy problems in a zero-shot manner, indicating the presence of an emergent capacity for analogical reasoning. Two recent…

Computation and Language · Computer Science 2024-05-01 Taylor Webb , Keith J. Holyoak , Hongjing Lu

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

Computation and Language · Computer Science 2022-03-25 Hanjie Chen , Yangfeng Ji

Retrieval-based conversational systems learn to rank response candidates for a given dialogue context by computing the similarity between their vector representations. However, training on a single textual form of the multi-turn context…

Computation and Language · Computer Science 2022-04-19 Lahari Poddar , Peiyao Wang , Julia Reinspach