English
Related papers

Related papers: Deep Recurrent Generative Decoder for Abstractive …

200 papers

With the rapid development of natural language processing technologies, more and more text steganographic methods based on automatic text generation technology have appeared in recent years. These models use the powerful self-learning and…

Multimedia · Computer Science 2020-01-08 Zhongliang Yang , Ke Wang , Jian Li , Yongfeng Huang , Yu-Jin Zhang

Auto-encoders compress input data into a latent-space representation and reconstruct the original data from the representation. This latent representation is not easily interpreted by humans. In this paper, we propose training an…

Computation and Language · Computer Science 2018-10-09 Yau-Shian Wang , Hung-Yi Lee

This article briefly explains our submitted approach to the DocEng'19 competition on extractive summarization. We implemented a recurrent neural network based model that learns to classify whether an article's sentence belongs to the…

Computation and Language · Computer Science 2019-11-15 Eduardo Brito , Max Lübbering , David Biesner , Lars Patrick Hillebrand , Christian Bauckhage

In this paper, we present a model for generating summaries of text documents with respect to a query. This is known as query-based summarization. We adapt an existing dataset of news article summaries for the task and train a…

Computation and Language · Computer Science 2017-12-19 Johan Hasselqvist , Niklas Helmertz , Mikael Kågebäck

Past work on story generation has demonstrated the usefulness of conditioning on a generation plan to generate coherent stories. However, these approaches have used heuristics or off-the-shelf models to first tag training stories with the…

Computation and Language · Computer Science 2020-10-08 Harsh Jhamtani , Taylor Berg-Kirkpatrick

We propose a new approach to generate multiple variants of the target summary with diverse content and varying lengths, then score and select admissible ones according to users' needs. Abstractive summarizers trained on single reference…

Computation and Language · Computer Science 2021-04-06 Kaiqiang Song , Bingqing Wang , Zhe Feng , Fei Liu

Deep generative replay has emerged as a promising approach for continual learning in decision-making tasks. This approach addresses the problem of catastrophic forgetting by leveraging the generation of trajectories from previously…

Machine Learning · Computer Science 2024-06-18 William Yue , Bo Liu , Peter Stone

Abstractive summary generation is a challenging task that requires the model to comprehend the source text and generate a concise and coherent summary that captures the essential information. In this paper, we explore the use of an…

Computation and Language · Computer Science 2023-05-26 Ali Raza , Hadia Sultan Raja , Usman Maratib

In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and careful hyperparameter…

Computation and Language · Computer Science 2019-12-13 Soheil Esmaeilzadeh , Gao Xian Peh , Angela Xu

Sentences produced by abstractive summarization systems can be ungrammatical and fail to preserve the original meanings, despite being locally fluent. In this paper we propose to remedy this problem by jointly generating a sentence and its…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Logan Lebanoff , Qipeng Guo , Xipeng Qiu , Xiangyang Xue , Chen Li , Dong Yu , Fei Liu

In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence problem. Another area of natural language processing that solves a…

Computation and Language · Computer Science 2018-10-23 Jacob Krantz , Jugal Kalita

Sequence to sequence (Seq2Seq) learning has recently been used for abstractive and extractive summarization. In current study, Seq2Seq models have been used for eBay product description summarization. We propose a novel Document-Context…

Computation and Language · Computer Science 2018-07-31 Chandra Khatri , Gyanit Singh , Nish Parikh

Text summarization aims to extract essential information from a piece of text and transform the text into a concise version. Existing unsupervised abstractive summarization models leverage recurrent neural networks framework while the…

Computation and Language · Computer Science 2020-10-20 Ziyi Yang , Chenguang Zhu , Robert Gmyr , Michael Zeng , Xuedong Huang , Eric Darve

Previous abstractive methods apply sequence-to-sequence structures to generate summary without a module to assist the system to detect vital mentions and relationships within a document. To address this problem, we utilize semantic graph to…

Computation and Language · Computer Science 2021-09-14 Qiwei Bi , Haoyuan Li , Kun Lu , Hanfang Yang

Autoregressive sequence models based on deep neural networks, such as RNNs, Wavenet and the Transformer attain state-of-the-art results on many tasks. However, they are difficult to parallelize and are thus slow at processing long…

Machine Learning · Computer Science 2018-06-11 Łukasz Kaiser , Aurko Roy , Ashish Vaswani , Niki Parmar , Samy Bengio , Jakob Uszkoreit , Noam Shazeer

We present a new topic model that generates documents by sampling a topic for one whole sentence at a time, and generating the words in the sentence using an RNN decoder that is conditioned on the topic of the sentence. We argue that this…

Computation and Language · Computer Science 2017-08-03 Ramesh Nallapati , Igor Melnyk , Abhishek Kumar , Bowen Zhou

A novel graph-to-tree conversion mechanism called the deep-tree generation (DTG) algorithm is first proposed to predict text data represented by graphs. The DTG method can generate a richer and more accurate representation for nodes (or…

Computation and Language · Computer Science 2018-09-06 Fenxiao Chen , Bin Wang , C. -C. Jay Kuo

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

A quality abstractive summary should not only copy salient source texts as summaries but should also tend to generate new conceptual words to express concrete details. Inspired by the popular pointer generator sequence-to-sequence model,…

Computation and Language · Computer Science 2019-10-21 Wang Wenbo , Gao Yang , Huang Heyan , Zhou Yuxiang

Neural summarization models suffer from the fixed-size input limitation: if text length surpasses the model's maximal number of input tokens, some document content (possibly summary-relevant) gets truncated Independently summarizing windows…

Computation and Language · Computer Science 2020-04-08 Leon Schüller , Florian Wilhelm , Nico Kreiling , Goran Glavaš