English
Related papers

Related papers: Memory-Augmented Recurrent Networks for Dialogue C…

200 papers

Long Short-Term Memory (LSTM) is a recurrent neural network (RNN) architecture that has been designed to address the vanishing and exploding gradient problems of conventional RNNs. Unlike feedforward neural networks, RNNs have cyclic…

Neural and Evolutionary Computing · Computer Science 2014-02-06 Haşim Sak , Andrew Senior , Françoise Beaufays

In the domain of sequence modelling, Recurrent Neural Networks (RNN) have been capable of achieving impressive results in a variety of application areas including visual question answering, part-of-speech tagging and machine translation.…

Machine Learning · Computer Science 2018-05-22 Tharindu Fernando , Simon Denman , Aaron McFadyen , Sridha Sridharan , Clinton Fookes

Conversation generation as a challenging task in Natural Language Generation (NLG) has been increasingly attracting attention over the last years. A number of recent works adopted sequence-to-sequence structures along with external…

Computation and Language · Computer Science 2021-08-23 Changzhen Ji , Yating Zhang , Xiaozhong Liu , Adam Jatowt , Changlong Sun , Conghui Zhu , Tiejun Zhao

We study response selection for multi-turn conversation in retrieval-based chatbots. Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may lose relationships…

Computation and Language · Computer Science 2017-05-16 Yu Wu , Wei Wu , Chen Xing , Ming Zhou , Zhoujun Li

Past work has long recognized the important role of context in guiding how humans search their memory. While context-based memory models can explain many memory phenomena, it remains unclear why humans develop such architectures over…

Neurons and Cognition · Quantitative Biology 2025-06-24 Nikolaus Salvatore , Qiong Zhang

Despite the success of neural dialogue systems in achieving high performance on the leader-board, they cannot meet users' requirements in practice, due to their poor reasoning skills. The underlying reason is that most neural dialogue…

Computation and Language · Computer Science 2021-09-24 Xu Wang , Hainan Zhang , Shuai Zhao , Yanyan Zou , Hongshen Chen , Zhuoye Ding , Bo Cheng , Yanyan Lan

Existing dialog systems are all monolingual, where features shared among different languages are rarely explored. In this paper, we introduce a novel multilingual dialogue system. Specifically, we augment the sequence to sequence framework…

Computation and Language · Computer Science 2019-10-08 Chen Chen , Lisong Qiu , Zhenxin Fu , Dongyan Zhao , Junfei Liu , Rui Yan

We describe a two-step approach for dialogue management in task-oriented spoken dialogue systems. A unified neural network framework is proposed to enable the system to first learn by supervision from a set of dialogue data and then…

Computation and Language · Computer Science 2016-06-09 Pei-Hao Su , Milica Gasic , Nikola Mrksic , Lina Rojas-Barahona , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

Multi-turn conversation understanding is a major challenge for building intelligent dialogue systems. This work focuses on retrieval-based response matching for multi-turn conversation whose related work simply concatenates the conversation…

Computation and Language · Computer Science 2018-11-07 Zhuosheng Zhang , Jiangtong Li , Pengfei Zhu , Hai Zhao , Gongshen Liu

Conversational modeling is an important task in natural language understanding and machine intelligence. Although previous approaches exist, they are often restricted to specific domains (e.g., booking an airline ticket) and require…

Computation and Language · Computer Science 2015-07-23 Oriol Vinyals , Quoc Le

Sequence-to-Sequence (seq2seq) models have become overwhelmingly popular in building end-to-end trainable dialogue systems. Though highly efficient in learning the backbone of human-computer communications, they suffer from the problem of…

Computation and Language · Computer Science 2018-10-09 Hui Su , Xiaoyu Shen , Wenjie Li , Dietrich Klakow

Transformer encoder-decoder models have achieved great performance in dialogue generation tasks, however, their inability to process long dialogue history often leads to truncation of the context To address this problem, we propose a novel…

Computation and Language · Computer Science 2023-05-24 Qingyang Wu , Zhou Yu

The effectiveness of recurrent neural networks can be largely influenced by their ability to store into their dynamical memory information extracted from input sequences at different frequencies and timescales. Such a feature can be…

Machine Learning · Computer Science 2020-07-01 Antonio Carta , Alessandro Sperduti , Davide Bacciu

The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested…

Computation and Language · Computer Science 2020-02-03 Jiwei Li

Some exciting new approaches to neural architectures for the analysis of conversation have been introduced over the past couple of years. These include neural architectures for detecting emotion, dialogue acts, and sentiment polarity. They…

Computation and Language · Computer Science 2022-04-01 Chloé Clavel , Matthieu Labeau , Justine Cassell

Neural machine translation (NMT) has achieved notable success in recent times, however it is also widely recognized that this approach has limitations with handling infrequent words and word pairs. This paper presents a novel…

Computation and Language · Computer Science 2017-08-08 Yang Feng , Shiyue Zhang , Andi Zhang , Dong Wang , Andrew Abel

Empathetic response generation aims to comprehend the cognitive and emotional states in dialogue utterances and generate proper responses. Psychological theories posit that comprehending emotional and cognitive states necessitates…

Computation and Language · Computer Science 2024-06-04 Zhou Yang , Zhaochun Ren , Yufeng Wang , Chao Chen , Haizhou Sun , Xiaofei Zhu , Xiangwen Liao

In this work, we propose contextual language models that incorporate dialog level discourse information into language modeling. Previous works on contextual language model treat preceding utterances as a sequence of inputs, without…

Computation and Language · Computer Science 2017-01-17 Bing Liu , Ian Lane

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual…

Computation and Language · Computer Science 2015-06-23 Alessandro Sordoni , Michel Galley , Michael Auli , Chris Brockett , Yangfeng Ji , Margaret Mitchell , Jian-Yun Nie , Jianfeng Gao , Bill Dolan

Retrieval-augmented Neural Machine Translation models have been successful in many translation scenarios. Different from previous works that make use of mutually similar but redundant translation memories~(TMs), we propose a new…

Computation and Language · Computer Science 2022-12-07 Xin Cheng , Shen Gao , Lemao Liu , Dongyan Zhao , Rui Yan