English
Related papers

Related papers: A Deep Reinforced Model for Abstractive Summarizat…

200 papers

Sentence summarization shortens given texts while maintaining core contents of the texts. Unsupervised approaches have been studied to summarize texts without human-written summaries. However, recent unsupervised models are extractive,…

Computation and Language · Computer Science 2022-12-22 Dongmin Hyun , Xiting Wang , Chanyoung Park , Xing Xie , Hwanjo Yu

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST)…

Computation and Language · Computer Science 2020-07-28 Li Wang , Junlin Yao , Yunzhe Tao , Li Zhong , Wei Liu , Qiang Du

Abstractive summarization models are commonly trained using maximum likelihood estimation, which assumes a deterministic (one-point) target distribution in which an ideal model will assign all the probability mass to the reference summary.…

Computation and Language · Computer Science 2022-04-01 Yixin Liu , Pengfei Liu , Dragomir Radev , Graham Neubig

We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important…

Computation and Language · Computer Science 2023-12-06 Yu Fu , Deyi Xiong , Yue Dong

Recently, the seq2seq abstractive summarization models have achieved good results on the CNN/Daily Mail dataset. Still, how to improve abstractive methods with extractive methods is a good research direction, since extractive methods have…

Computation and Language · Computer Science 2018-08-07 Niantao Xie , Sujian Li , Huiling Ren , Qibin Zhai

In this paper, we propose an adversarial process for abstractive text summarization, in which we simultaneously train a generative model G and a discriminative model D. In particular, we build the generator G as an agent of reinforcement…

Computation and Language · Computer Science 2017-11-28 Linqing Liu , Yao Lu , Min Yang , Qiang Qu , Jia Zhu , Hongyan Li

Abstractive summarization has been studied using neural sequence transduction methods with datasets of large, paired document-summary examples. However, such datasets are rare and the models trained from them do not generalize to other…

Computation and Language · Computer Science 2019-05-24 Eric Chu , Peter J. Liu

We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization,…

Computation and Language · Computer Science 2020-01-22 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Atsushi Otsuka , Hisako Asano , Junji Tomita , Hiroyuki Shindo , Yuji Matsumoto

Single document summarization is the task of producing a shorter version of a document while preserving its principal information content. In this paper we conceptualize extractive summarization as a sentence ranking task and propose a…

Computation and Language · Computer Science 2018-04-17 Shashi Narayan , Shay B. Cohen , Mirella Lapata

We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural…

Computation and Language · Computer Science 2021-08-31 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

Computation and Language · Computer Science 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

Automatic text summarization (TS) plays a pivotal role in condensing large volumes of information into concise, coherent summaries, facilitating efficient information retrieval and comprehension. This paper presents a novel framework for…

Computation and Language · Computer Science 2024-04-22 Bhavith Chandra Challagundla , Chakradhar Peddavenkatagari

Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly…

Computation and Language · Computer Science 2020-03-31 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Junji Tomita

Recent neural network approaches to summarization are largely either selection-based extraction or generation-based abstraction. In this work, we present a neural model for single-document summarization based on joint extraction and…

Computation and Language · Computer Science 2019-09-11 Jiacheng Xu , Greg Durrett

Pre-trained language model representations have been successful in a wide range of language understanding tasks. In this paper, we examine different strategies to integrate pre-trained representations into sequence to sequence models and…

Computation and Language · Computer Science 2019-04-02 Sergey Edunov , Alexei Baevski , Michael Auli

Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural…

Computation and Language · Computer Science 2023-11-30 Swaroop Nath , Harshad Khadilkar , Pushpak Bhattacharyya

Attention mechanism plays a dominant role in the sequence generation models and has been used to improve the performance of machine translation and abstractive text summarization. Different from neural machine translation, in the task of…

Computation and Language · Computer Science 2020-04-09 Piji Li , Lidong Bing , Zhongyu Wei , Wai Lam

Sequence to sequence (Seq2Seq) learning has recently been used for abstractive and extractive summarization. In current study, Seq2Seq models have been used for eBay product description summarization. We propose a novel Document-Context…

Computation and Language · Computer Science 2018-07-31 Chandra Khatri , Gyanit Singh , Nish Parikh

Neural models have become successful at producing abstractive summaries that are human-readable and fluent. However, these models have two critical shortcomings: they often don't respect the facts that are either included in the source…

Computation and Language · Computer Science 2020-06-30 Beliz Gunel , Chenguang Zhu , Michael Zeng , Xuedong Huang

As language models become more powerful, training and evaluation are increasingly bottlenecked by the data and metrics used for a particular task. For example, summarization models are often trained to predict human reference summaries and…

Computation and Language · Computer Science 2022-02-17 Nisan Stiennon , Long Ouyang , Jeff Wu , Daniel M. Ziegler , Ryan Lowe , Chelsea Voss , Alec Radford , Dario Amodei , Paul Christiano