English
Related papers

Related papers: Exploring the context of recurrent neural network …

200 papers

Conversational agents ("bots") are beginning to be widely used in conversational interfaces. To design a system that is capable of emulating human-like interactions, a conversational layer that can serve as a fabric for chat-like…

Artificial Intelligence · Computer Science 2016-06-23 Abhay Prakash , Chris Brockett , Puneet Agrawal

Neural network-based Open-ended conversational agents automatically generate responses based on predictive models learned from a large number of pairs of utterances. The generated responses are typically acceptable as a sentence but are…

Computation and Language · Computer Science 2019-05-16 Chenyang Huang , Osmar R. Zaïane

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Most research on dialogue has focused either on dialogue generation for openended chit chat or on state tracking for goal-directed dialogue. In this work, we explore a hybrid approach to goal-oriented dialogue generation that combines…

Computation and Language · Computer Science 2019-10-01 Ana Valeria Gonzalez , Isabelle Augenstein , Anders Søgaard

While recent neural encoder-decoder models have shown great promise in modeling open-domain conversations, they often generate dull and generic responses. Unlike past work that has focused on diversifying the output of the decoder at…

Computation and Language · Computer Science 2017-10-24 Tiancheng Zhao , Ran Zhao , Maxine Eskenazi

In this paper we consider the task of conversational semantic parsing over general purpose knowledge graphs (KGs) with millions of entities, and thousands of relation-types. We focus on models which are capable of interactively mapping user…

Computation and Language · Computer Science 2023-12-08 Parag Jain , Mirella Lapata

We introduce a neural architecture finetuned for the task of scenario context generation: The relevant location and time of an event or entity mentioned in text. Contextualizing information extraction helps to scope the validity of…

Computation and Language · Computer Science 2024-10-22 Enrique Noriega-Atala , Robert Vacareanu , Salena Torres Ashton , Adarsh Pyarelal , Clayton T. Morrison , Mihai Surdeanu

We propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder to map an input sentence into a…

Computation and Language · Computer Science 2017-07-28 Zhe Gan , Yunchen Pu , Ricardo Henao , Chunyuan Li , Xiaodong He , Lawrence Carin

This work combines information about the dialogue history encoded by pre-trained model with a meaning representation of the current system utterance to realize contextual language generation in task-oriented dialogues. We utilize the…

Computation and Language · Computer Science 2021-11-30 Ye Liu , Wolfgang Maier , Wolfgang Minker , Stefan Ultes

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

End-to-end neural TTS has achieved superior performance on reading style speech synthesis. However, it's still a challenge to build a high-quality conversational TTS due to the limitations of the corpus and modeling capability. This study…

Sound · Computer Science 2020-11-17 Haohan Guo , Shaofei Zhang , Frank K. Soong , Lei He , Lei Xie

In the task of machine translation, context information is one of the important factor. But considering the context information model dose not proposed. The paper propose a new model which can integrate context information and make…

Computation and Language · Computer Science 2019-04-02 Tetsuto Takano , Satoshi Yamane

Neural network based sequence-to-sequence models in an encoder-decoder framework have been successfully applied to solve Question Answering (QA) problems, predicting answers from statements and questions. However, almost all previous models…

Computation and Language · Computer Science 2017-09-05 Huayu Li , Martin Renqiang Min , Yong Ge , Asim Kadav

Large Language Models demonstrate outstanding performance in many language tasks but still face fundamental challenges in managing the non-linear flow of human conversation. The prevalent approach of treating dialogue history as a flat,…

Computation and Language · Computer Science 2026-04-20 Junan Hu , Shudan Guo , Wenqi Liu , Jianhua Yin , Yinwei Wei

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual…

Computation and Language · Computer Science 2015-06-23 Alessandro Sordoni , Michel Galley , Michael Auli , Chris Brockett , Yangfeng Ji , Margaret Mitchell , Jian-Yun Nie , Jianfeng Gao , Bill Dolan

Neural conversation models tend to generate safe, generic responses for most inputs. This is due to the limitations of likelihood-based decoding objectives in generation tasks with diverse outputs, such as conversation. To address this…

Computation and Language · Computer Science 2018-09-06 Ashutosh Baheti , Alan Ritter , Jiwei Li , Bill Dolan

This paper presents a deep learning architecture for the semantic decoder component of a Statistical Spoken Dialogue System. In a slot-filling dialogue, the semantic decoder predicts the dialogue act and a set of slot-value pairs from a set…

Artificial Intelligence · Computer Science 2016-10-14 Lina M. Rojas Barahona , Milica Gasic , Nikola Mrkšić , Pei-Hao Su , Stefan Ultes , Tsung-Hsien Wen , Steve Young

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

Encoder-decoder architecture is widely adopted for sequence-to-sequence modeling tasks. For machine translation, despite the evolution from long short-term memory networks to Transformer networks, plus the introduction and development of…

Computation and Language · Computer Science 2022-10-24 Yingbo Gao , Christian Herold , Zijian Yang , Hermann Ney

Neural generative models have been become increasingly popular when building conversational agents. They offer flexibility, can be easily adapted to new domains, and require minimal domain engineering. A common criticism of these systems is…

Computation and Language · Computer Science 2019-07-29 Chinnadhurai Sankar , Sandeep Subramanian , Christopher Pal , Sarath Chandar , Yoshua Bengio