English
Related papers

Related papers: Automated News Summarization Using Transformers

200 papers

So far and trying to reach human capabilities, research in automatic summarization has been based on hypothesis that are both enabling and limiting. Some of these limitations are: how to take into account and reflect (in the generated…

Computation and Language · Computer Science 2013-12-12 Henda Chorfi Ouertani

Text summarization (TS) is a natural language processing (NLP) subtask pertaining to the automatic formulation of a concise and coherent summary that covers the major concepts and topics from one or multiple documents. Recent advancements…

Computation and Language · Computer Science 2023-11-15 Nikolaos Giarelis , Charalampos Mastrokostas , Nikos Karacapilidis

A common method for extractive multi-document news summarization is to re-formulate it as a single-document summarization problem by concatenating all documents as a single meta-document. However, this method neglects the relative…

Computation and Language · Computer Science 2022-03-22 Chao Zhao , Tenghao Huang , Somnath Basu Roy Chowdhury , Muthu Kumar Chandrasekaran , Kathleen McKeown , Snigdha Chaturvedi

Unsupervised extractive document summarization aims to select important sentences from a document without using labeled summaries during training. Existing methods are mostly graph-based with sentences as nodes and edge weights measured by…

Computation and Language · Computer Science 2021-12-14 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei , Ming Zhou

We present SummaRuNNer, a Recurrent Neural Network (RNN) based sequence model for extractive summarization of documents and show that it achieves performance better than or comparable to state-of-the-art. Our model has the additional…

Computation and Language · Computer Science 2016-11-15 Ramesh Nallapati , Feifei Zhai , Bowen Zhou

The ability to fuse sentences is highly attractive for summarization systems because it is an essential step to produce succinct abstracts. However, to date, summarizers can fail on fusing sentences. They tend to produce few summary…

Computation and Language · Computer Science 2020-10-09 Logan Lebanoff , Franck Dernoncourt , Doo Soon Kim , Lidan Wang , Walter Chang , Fei Liu

We introduce MemSum (Multi-step Episodic Markov decision process extractive SUMmarizer), a reinforcement-learning-based extractive summarizer enriched at each step with information on the current extraction history. When MemSum iteratively…

Computation and Language · Computer Science 2022-03-17 Nianlong Gu , Elliott Ash , Richard H. R. Hahnloser

In this work, we model abstractive text summarization using Attentional Encoder-Decoder Recurrent Neural Networks, and show that they achieve state-of-the-art performance on two different corpora. We propose several novel models that…

Computation and Language · Computer Science 2016-08-29 Ramesh Nallapati , Bowen Zhou , Cicero Nogueira dos santos , Caglar Gulcehre , Bing Xiang

We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization,…

Computation and Language · Computer Science 2020-01-22 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Atsushi Otsuka , Hisako Asano , Junji Tomita , Hiroyuki Shindo , Yuji Matsumoto

This article briefly explains our submitted approach to the DocEng'19 competition on extractive summarization. We implemented a recurrent neural network based model that learns to classify whether an article's sentence belongs to the…

Computation and Language · Computer Science 2019-11-15 Eduardo Brito , Max Lübbering , David Biesner , Lars Patrick Hillebrand , Christian Bauckhage

With the increasing need for text summarization techniques that are both efficient and accurate, it becomes crucial to explore avenues that enhance the quality and precision of pre-trained models specifically tailored for summarizing…

Computation and Language · Computer Science 2023-07-17 G. M. Shahariar , Tonmoy Talukder , Rafin Alam Khan Sotez , Md. Tanvir Rouf Shawon

A quality abstractive summary should not only copy salient source texts as summaries but should also tend to generate new conceptual words to express concrete details. Inspired by the popular pointer generator sequence-to-sequence model,…

Computation and Language · Computer Science 2019-10-21 Wang Wenbo , Gao Yang , Huang Heyan , Zhou Yuxiang

Under special circumstances, summaries should conform to a particular style with patterns, such as court judgments and abstracts in academic papers. To this end, the prototype document-summary pairs can be utilized to generate better…

Computation and Language · Computer Science 2019-09-20 Shen Gao , Xiuying Chen , Piji Li , Zhangming Chan , Dongyan Zhao , Rui Yan

Neural abstractive summarization models are able to generate summaries which have high overlap with human references. However, existing models are not optimized for factual correctness, a critical metric in real-world applications. In this…

Computation and Language · Computer Science 2020-04-29 Yuhao Zhang , Derek Merck , Emily Bao Tsai , Christopher D. Manning , Curtis P. Langlotz

Neural models have become successful at producing abstractive summaries that are human-readable and fluent. However, these models have two critical shortcomings: they often don't respect the facts that are either included in the source…

Computation and Language · Computer Science 2020-06-30 Beliz Gunel , Chenguang Zhu , Michael Zeng , Xuedong Huang

Abstractive Text Summarization is the process of constructing semantically relevant shorter sentences which captures the essence of the overall meaning of the source text. It is actually difficult and very time consuming for humans to…

Computation and Language · Computer Science 2021-01-19 Mohan Bharath B , Aravindh Gowtham B , Akhil M

Text summarization can be classified into two approaches: extraction and abstraction. This paper focuses on extraction approach. The goal of text summarization based on extraction approach is sentence selection. One of the methods to obtain…

Information Retrieval · Computer Science 2009-06-26 Ladda Suanmali , Naomie Salim , Mohammed Salem Binwahlan

Automatic summarization techniques on meeting conversations developed so far have been primarily extractive, resulting in poor summaries. To improve this, we propose an approach to generate abstractive summaries by fusing important content…

Computation and Language · Computer Science 2016-09-25 Siddhartha Banerjee , Prasenjit Mitra , Kazunari Sugiyama

Transformer-based language models usually treat texts as linear sequences. However, most texts also have an inherent hierarchical structure, i.e., parts of a text can be identified using their position in this hierarchy. In addition,…

Computation and Language · Computer Science 2026-01-30 Qian Ruan , Malte Ostendorff , Georg Rehm

In recent years, automatic text summarization has witnessed significant advancement, particularly with the development of transformer-based models. However, the challenge of controlling the readability level of generated summaries remains…

Computation and Language · Computer Science 2025-03-17 Mehmet Samet Duran , Tevfik Aytekin