English
Related papers

Related papers: Neural Abstractive Text Summarization with Sequenc…

200 papers

Neural abstractive summarization models are flexible and can produce coherent summaries, but they are sometimes unfaithful and can be difficult to control. While previous studies attempt to provide different types of guidance to control the…

Computation and Language · Computer Science 2021-04-20 Zi-Yi Dou , Pengfei Liu , Hiroaki Hayashi , Zhengbao Jiang , Graham Neubig

Neural summarization models suffer from the fixed-size input limitation: if text length surpasses the model's maximal number of input tokens, some document content (possibly summary-relevant) gets truncated Independently summarizing windows…

Computation and Language · Computer Science 2020-04-08 Leon Schüller , Florian Wilhelm , Nico Kreiling , Goran Glavaš

We present an empirical study in favor of a cascade architecture to neural text summarization. Summarization practices vary widely but few other than news summarization can provide a sufficient amount of training data enough to meet the…

Computation and Language · Computer Science 2020-10-09 Logan Lebanoff , Franck Dernoncourt , Doo Soon Kim , Walter Chang , Fei Liu

Unlike extractive summarization, abstractive summarization has to fuse different parts of the source text, which inclines to create fake facts. Our preliminary study reveals nearly 30% of the outputs from a state-of-the-art neural…

Information Retrieval · Computer Science 2017-11-15 Ziqiang Cao , Furu Wei , Wenjie Li , Sujian Li

Novel neural architectures, training strategies, and the availability of large-scale corpora haven been the driving force behind recent progress in abstractive text summarization. However, due to the black-box nature of neural models,…

Computation and Language · Computer Science 2021-07-27 Jesse Vig , Wojciech Kryściński , Karan Goel , Nazneen Fatema Rajani

Abstractive neural summarization models have seen great improvements in recent years, as shown by ROUGE scores of the generated summaries. But despite these improved metrics, there is limited understanding of the strategies different models…

Computation and Language · Computer Science 2021-06-04 Matt Wilber , William Timkey , Marten Van Schijndel

Text summarization and text simplification are two major ways to simplify the text for poor readers, including children, non-native speakers, and the functionally illiterate. Text summarization is to produce a brief summary of the main…

Computation and Language · Computer Science 2017-10-09 Shuming Ma , Xu Sun

We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. The sentence encoder…

Computation and Language · Computer Science 2017-07-31 Qingyu Zhou , Nan Yang , Furu Wei , Ming Zhou

Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach…

Computation and Language · Computer Science 2018-05-23 Arman Cohan , Franck Dernoncourt , Doo Soon Kim , Trung Bui , Seokhwan Kim , Walter Chang , Nazli Goharian

A critical point of multi-document summarization (MDS) is to learn the relations among various documents. In this paper, we propose a novel abstractive MDS model, in which we represent multiple documents as a heterogeneous graph, taking…

Computation and Language · Computer Science 2021-10-22 Peng Cui , Le Hu

Accessing medical literature is difficult for laypeople as the content is written for specialists and contains medical jargon. Automated text simplification methods offer a potential means to address this issue. In this work, we propose a…

Computation and Language · Computer Science 2023-02-14 Junru Lu , Jiazheng Li , Byron C. Wallace , Yulan He , Gabriele Pergola

Neural models for abstractive summarization tend to achieve the best performance in the presence of highly specialized, summarization specific modeling add-ons such as pointer-generator, coverage-modeling, and inferencetime heuristics. We…

Computation and Language · Computer Science 2019-09-25 Sebastian Goodman , Zhenzhong Lan , Radu Soricut

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise control over…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Bingqing Wang , Zhe Feng , Liu Ren , Fei Liu

Abstractive text summarization aims to shorten long text documents into a human readable form that contains the most important facts from the original document. However, the level of actual abstraction as measured by novel phrases that do…

Computation and Language · Computer Science 2018-08-27 Wojciech Kryściński , Romain Paulus , Caiming Xiong , Richard Socher

Neural abstractive summarization models make summaries in an end-to-end manner, and little is known about how the source information is actually converted into summaries. In this paper, we define input sentences that contain essential…

Computation and Language · Computer Science 2024-02-08 Yoshi Suhara , Dimitris Alikaniotis

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST)…

Computation and Language · Computer Science 2020-07-28 Li Wang , Junlin Yao , Yunzhe Tao , Li Zhong , Wei Liu , Qiang Du

Most of the current abstractive text summarization models are based on the sequence-to-sequence model (Seq2Seq). The source content of social media is long and noisy, so it is difficult for Seq2Seq to learn an accurate semantic…

Computation and Language · Computer Science 2018-05-15 Shuming Ma , Xu Sun , Junyang Lin , Houfeng Wang

We present a method to produce abstractive summaries of long documents that exceed several thousand words via neural abstractive summarization. We perform a simple extractive step before generating a summary, which is then used to condition…

Computation and Language · Computer Science 2020-04-29 Sandeep Subramanian , Raymond Li , Jonathan Pilault , Christopher Pal

Text summarization (TS) is a natural language processing (NLP) subtask pertaining to the automatic formulation of a concise and coherent summary that covers the major concepts and topics from one or multiple documents. Recent advancements…

Computation and Language · Computer Science 2023-11-15 Nikolaos Giarelis , Charalampos Mastrokostas , Nikos Karacapilidis

Sequence-to-sequence (seq2seq) models have been successful across many NLP tasks, including ones that require predicting linguistic structure. However, recent work on compositional generalization has shown that seq2seq models achieve very…

Computation and Language · Computer Science 2022-10-25 Yuekun Yao , Alexander Koller