English
Related papers

Related papers: Guider l'attention dans les modeles de sequence a …

200 papers

Recently, topic-grounded dialogue system has attracted significant attention due to its effectiveness in predicting the next topic to yield better responses via the historical context and given topic sequence. However, almost all existing…

Computation and Language · Computer Science 2022-10-18 Xiaofei Wen , Wei Wei , Xian-Ling Mao

While sequence-to-sequence (seq2seq) models achieve state-of-the-art performance in many natural language processing tasks, they can be too slow for real-time applications. One performance bottleneck is predicting the most likely next token…

Computation and Language · Computer Science 2019-07-26 Chunyang Xiao , Christoph Teichmann , Konstantine Arkoudas

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deep understanding of conversational context, and generate…

Computation and Language · Computer Science 2019-10-21 Sam Shleifer , Manish Chablani , Namit Katariya , Anitha Kannan , Xavier Amatriain

Attention mechanism in sequence-to-sequence models is designed to model the alignments between acoustic features and output tokens in speech recognition. However, attention weights produced by models trained end to end do not always…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Gene-Ping Yang , Hao Tang

Researchers have recently started investigating deep neural networks for dialogue applications. In particular, generative sequence-to-sequence (Seq2Seq) models have shown promising results for unstructured tasks, such as word-level dialogue…

Computation and Language · Computer Science 2016-11-21 Iulian Vlad Serban , Ryan Lowe , Laurent Charlin , Joelle Pineau

Unsupervised style transfer aims to change the style of an input sentence while preserving its original content without using parallel training data. In current dominant approaches, owing to the lack of fine-grained control on the influence…

Computation and Language · Computer Science 2022-03-14 Chulun Zhou , Liangyu Chen , Jiachen Liu , Xinyan Xiao , Jinsong Su , Sheng Guo , Hua Wu

The context information such as product category plays a critical role in sequential recommendation. Recent years have witnessed a growing interest in context-aware sequential recommender systems. Existing studies often treat the contexts…

Information Retrieval · Computer Science 2020-01-15 Ke Sun , Tieyun Qian

Neural network based sequence-to-sequence models in an encoder-decoder framework have been successfully applied to solve Question Answering (QA) problems, predicting answers from statements and questions. However, almost all previous models…

Computation and Language · Computer Science 2017-09-05 Huayu Li , Martin Renqiang Min , Yong Ge , Asim Kadav

This paper deals with multi-lingual dialogue act (DA) recognition. The proposed approaches are based on deep neural networks and use word2vec embeddings for word representation. Two multi-lingual models are proposed for this task. The first…

Computation and Language · Computer Science 2019-04-12 Jiří Martínek , Pavel Král , Ladislav Lenc , Christophe Cerisara

Dialogue Act (DA) classification is the task of classifying utterances with respect to the function they serve in a dialogue. Existing approaches to DA classification model utterances without incorporating the turn changes among speakers…

Computation and Language · Computer Science 2021-09-14 Zihao He , Leili Tavabi , Kristina Lerman , Mohammad Soleymani

Generative seq2seq dialogue systems are trained to predict the next word in dialogues that have already occurred. They can learn from large unlabeled conversation datasets, build a deeper understanding of conversational context, and…

Computation and Language · Computer Science 2019-11-21 Sam Shleifer , Manish Chablani , Anitha Kannan , Namit Katariya , Xavier Amatriain

Sequence-to-Sequence (seq2seq) models have become overwhelmingly popular in building end-to-end trainable dialogue systems. Though highly efficient in learning the backbone of human-computer communications, they suffer from the problem of…

Computation and Language · Computer Science 2018-10-09 Hui Su , Xiaoyu Shen , Wenjie Li , Dietrich Klakow

With rapid development of neural networks, deep-learning has been extended to various natural language generation fields, such as machine translation, dialogue generation and even literature creation. In this paper, we propose a theme-aware…

Computation and Language · Computer Science 2019-06-06 Jie Wang , Xinyan Zhao

Dialogue Act (DA) classification is a challenging problem in dialogue interpretation, which aims to attach semantic labels to utterances and characterize the speaker's intention. Currently, many existing approaches formulate the DA…

Computation and Language · Computer Science 2018-11-14 Yao Wan , Wenqiang Yan , Jianwei Gao , Zhou Zhao , Jian Wu , Philip S. Yu

Self-attentional models are a new paradigm for sequence modelling tasks which differ from common sequence modelling methods, such as recurrence-based and convolution-based sequence learning, in the way that their architecture is only based…

Computation and Language · Computer Science 2019-09-13 Mansour Saffar Mehrjardi , Amine Trabelsi , Osmar R. Zaiane

Prior to deep learning the semantic parsing community has been interested in understanding and modeling the range of possible word alignments between natural language sentences and their corresponding meaning representations.…

Computation and Language · Computer Science 2022-11-15 Davide Locatelli , Ariadna Quattoni

Accurate prediction of suitable discourse connectives (however, furthermore, etc.) is a key component of any system aimed at building coherent and fluent discourses from shorter sentences and passages. As an example, a dialog system might…

Computation and Language · Computer Science 2018-02-02 Eric Malmi , Daniele Pighin , Sebastian Krause , Mikhail Kozhevnikov

Task-oriented dialogue focuses on conversational agents that participate in user-initiated dialogues on domain-specific topics. In contrast to chatbots, which simply seek to sustain open-ended meaningful discourse, existing task-oriented…

Computation and Language · Computer Science 2017-08-16 Mihail Eric , Christopher D. Manning

Spoken language understanding (SLU) is an essential component in conversational systems. Most SLU component treats each utterance independently, and then the following components aggregate the multi-turn information in the separate phases.…

Computation and Language · Computer Science 2017-12-12 Po-Chun Chen , Ta-Chung Chi , Shang-Yu Su , Yun-Nung Chen

End-to-end task-oriented dialog systems usually suffer from the challenge of incorporating knowledge bases. In this paper, we propose a novel yet simple end-to-end differentiable model called memory-to-sequence (Mem2Seq) to address this…

Computation and Language · Computer Science 2018-05-22 Andrea Madotto , Chien-Sheng Wu , Pascale Fung