English
Related papers

Related papers: Sequence to Backward and Forward Sequences: A Cont…

200 papers

While liking or upvoting a post on a mobile app is easy to do, replying with a written note is much more difficult, due to both the cognitive load of coming up with a meaningful response as well as the mechanics of entering the text. Here…

Social and Information Networks · Computer Science 2017-11-29 Parminder Bhatia , Marsal Gavalda , Arash Einolghozati

We propose a two-stage neural model to tackle question generation from documents. First, our model estimates the probability that word sequences in a document are ones that a human would pick when selecting candidate answers by training a…

Computation and Language · Computer Science 2018-05-31 Sandeep Subramanian , Tong Wang , Xingdi Yuan , Saizheng Zhang , Yoshua Bengio , Adam Trischler

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Users try to articulate their complex information needs during search sessions by reformulating their queries. To make this process more effective, search engines provide related queries to help users in specifying the information need in…

Information Retrieval · Computer Science 2017-11-15 Mostafa Dehghani , Sascha Rothe , Enrique Alfonseca , Pascal Fleury

Various encoder-decoder models have been applied to response generation in open-domain dialogs, but a majority of conventional models directly learn a mapping from lexical input to lexical output without explicitly modeling intermediate…

Computation and Language · Computer Science 2019-06-27 Tianyu Zhao , Shinsuke Mori , Tatsuya Kawahara

Neural generative models have become popular and achieved promising performance on short-text conversation tasks. They are generally trained to build a 1-to-1 mapping from the input post to its output response. However, a given post is…

Computation and Language · Computer Science 2019-02-22 Jun Gao , Wei Bi , Xiaojiang Liu , Junhui Li , Shuming Shi

In this paper, we present a hybrid model that combines a neural conversational model and a rule-based graph dialogue system that assists users in scheduling reminders through a chat conversation. The graph based system has high precision…

Computation and Language · Computer Science 2018-10-30 Aniruddha Tammewar , Monik Pamecha , Chirag Jain , Apurva Nagvenkar , Krupal Modi

Sequence-to-sequence translation methods based on generation with a side-conditioned language model have recently shown promising results in several tasks. In machine translation, models conditioned on source side words have been used to…

Computation and Language · Computer Science 2015-08-21 Kaisheng Yao , Geoffrey Zweig

Sequence-to-sequence learning with neural networks has become the de facto standard for sequence prediction tasks. This approach typically models the local distribution over the next word with a powerful neural network that can condition on…

Computation and Language · Computer Science 2021-11-17 Yoon Kim

We investigate the integration of a planning mechanism into sequence-to-sequence models using attention. We develop a model which can plan ahead in the future when it computes its alignments between input and output sequences, constructing…

Machine Learning · Computer Science 2017-11-29 Francis Dutil , Caglar Gulcehre , Adam Trischler , Yoshua Bengio

Query expansion with pseudo-relevance feedback (PRF) is a powerful approach to enhance the effectiveness in information retrieval. Recently, with the rapid advance of deep learning techniques, neural text generation has achieved promising…

Information Retrieval · Computer Science 2021-08-16 Minghui Huang , Dong Wang , Shuang Liu , Meizhen Ding

We present an efficient framework that can generate a coherent paragraph to describe a given video. Previous works on video captioning usually focus on video clips. They typically treat an entire video as a whole and generate the caption…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yilei Xiong , Bo Dai , Dahua Lin

Dialogue generation has been successfully learned from scratch by neural networks, but tends to produce the same general response, e.g., "what are you talking about?", in many conversations. To reduce this homogeneity, external knowledge…

Computation and Language · Computer Science 2021-04-07 Yi-Lin Tuan , Wei Wei , William Yang Wang

This paper proposes a novel Sequence-to-Sequence (Seq2Seq) model integrating the structure of Hidden Semi-Markov Models (HSMMs) into its attention mechanism. In speech synthesis, it has been shown that methods based on Seq2Seq models using…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-01 Yoshihiko Nankaku , Kenta Sumiya , Takenori Yoshimura , Shinji Takaki , Kei Hashimoto , Keiichiro Oura , Keiichi Tokuda

Developing an efficient retriever to retrieve knowledge from a large-scale knowledge base (KB) is critical for task-oriented dialogue systems to effectively handle localized and specialized tasks. However, widely used generative models such…

Computation and Language · Computer Science 2023-10-23 Weizhou Shen , Yingqi Gao , Canbin Huang , Fanqi Wan , Xiaojun Quan , Wei Bi

We present an empirical investigation of pre-trained Transformer-based auto-regressive language models for the task of open-domain dialogue generation. Training paradigm of pre-training and fine-tuning is employed to conduct the parameter…

Computation and Language · Computer Science 2020-03-10 Piji Li

Question generation (QG) is the task of generating a question from a reference sentence and a specified answer within the sentence. A major challenge in QG is to identify answer-relevant context words to finish the…

Computation and Language · Computer Science 2019-10-25 Jingjing Li , Yifan Gao , Lidong Bing , Irwin King , Michael R. Lyu

Sequence-to-Sequence (seq2seq) modeling has rapidly become an important general-purpose NLP tool that has proven effective for many text-generation and sequence-labeling tasks. Seq2seq builds on deep neural language modeling and inherits…

Computation and Language · Computer Science 2016-11-11 Sam Wiseman , Alexander M. Rush

Acquiring training data to improve the robustness of dialog systems can be a painstakingly long process. In this work, we propose a method to reduce the cost and effort of creating new conversational agents by artificially generating more…

Computation and Language · Computer Science 2022-05-05 Louis Marceau , Raouf Belbahar , Marc Queudot , Nada Naji , Eric Charton , Marie-Jean Meurs

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

Computation and Language · Computer Science 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing