English
Related papers

Related papers: Document-Level Abstractive Summarization

200 papers

Abstractive summarization typically relies on large collections of paired articles and summaries. However, in many cases, parallel data is scarce and costly to obtain. We develop an abstractive summarization system that relies only on large…

Computation and Language · Computer Science 2020-03-04 Nikola I. Nikolov , Richard H. R. Hahnloser

Text summarization aims to compress a textual document to a short summary while keeping salient information. Extractive approaches are widely used in text summarization because of their fluency and efficiency. However, most of existing…

Computation and Language · Computer Science 2020-10-14 Peng Cui , Le Hu , Yuanchao Liu

Text summarization condenses a text to a shorter version while retaining the important informations. Abstractive summarization is a recent development that generates new phrases, rather than simply copying or rephrasing sentences within the…

Computation and Language · Computer Science 2018-02-06 André Cibils , Claudiu Musat , Andreea Hossman , Michael Baeriswyl

Automatic patent summarization approaches that help in the patent analysis and comprehension procedure are in high demand due to the colossal growth of innovations. The development of natural language processing (NLP), text mining, and deep…

Computation and Language · Computer Science 2025-06-17 Nevidu Jayatilleke , Ruvan Weerasinghe

One of the most pressing issues that have arisen due to the rapid growth of the Internet is known as information overloading. Simplifying the relevant information in the form of a summary will assist many people because the material on any…

Computation and Language · Computer Science 2022-04-06 Divakar Yadav , Jalpa Desai , Arun Kumar Yadav

The parallelism of Transformer-based models comes at the cost of their input max-length. Some studies proposed methods to overcome this limitation, but none of them reported the effectiveness of summarization as an alternative. In this…

Computation and Language · Computer Science 2024-03-20 Mirza Alim Mutasodirin , Radityo Eko Prasojo

A notable challenge in Multi-Document Summarization (MDS) is the extremely-long length of the input. In this paper, we present an extract-then-abstract Transformer framework to overcome the problem. Specifically, we leverage pre-trained…

Computation and Language · Computer Science 2022-05-05 Yun-Zhu Song , Yi-Syuan Chen , Hong-Han Shuai

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

In this research work, we present a method to generate summaries of long scientific documents that uses the advantages of both extractive and abstractive approaches. Before producing a summary in an abstractive manner, we perform the…

Computation and Language · Computer Science 2020-06-15 Vladislav Tretyak , Denis Stepanov

Automatic text summarization, the automated process of shortening a text while reserving the main ideas of the document(s), is a critical research area in natural language processing. The aim of this literature review is to survey the…

Computation and Language · Computer Science 2018-04-13 Yue Dong

Extractive summarization for long documents is challenging due to the extended structured input context. The long-distance sentence dependency hinders cross-sentence relations modeling, the critical step of extractive summarization. This…

Computation and Language · Computer Science 2022-10-11 Haopeng Zhang , Xiao Liu , Jiawei Zhang

The substantial growth of textual content in diverse domains and platforms has led to a considerable need for Automatic Text Summarization (ATS) techniques that aid in the process of text analysis. The effectiveness of text summarization…

Computation and Language · Computer Science 2025-03-03 Nevidu Jayatilleke , Ruvan Weerasinghe , Nipuna Senanayake

Text summarization aims to generate a headline or a short summary consisting of the major information of the source text. Recent studies employ the sequence-to-sequence framework to encode the input with a neural network and generate…

Computation and Language · Computer Science 2020-03-26 Haiyang Xu , Yahao He , Kun Han , Junwen Chen , Xiangang Li

We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural…

Computation and Language · Computer Science 2021-08-31 Chujie Zheng , Kunpeng Zhang , Harry Jiannan Wang , Ling Fan , Zhe Wang

Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, and (2) composing a…

The Query Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled data for training the…

Computation and Language · Computer Science 2021-12-23 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

Transformer-based models have consistently produced substantial performance gains across a variety of NLP tasks, compared to shallow models. However, deep models are orders of magnitude more computationally expensive than shallow models,…

Computation and Language · Computer Science 2023-05-30 Janko Vidaković , Filip Karlo Došilović , Domagoj Pluščec

Sequence to sequence (Seq2Seq) learning has recently been used for abstractive and extractive summarization. In current study, Seq2Seq models have been used for eBay product description summarization. We propose a novel Document-Context…

Computation and Language · Computer Science 2018-07-31 Chandra Khatri , Gyanit Singh , Nish Parikh

Large-scale learning of transformer language models has yielded improvements on a variety of natural language understanding tasks. Whether they can be effectively adapted for summarization, however, has been less explored, as the learned…

Computation and Language · Computer Science 2019-06-04 Andrew Hoang , Antoine Bosselut , Asli Celikyilmaz , Yejin Choi

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

Computation and Language · Computer Science 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon