English
Related papers

Related papers: Neural Abstractive Text Summarization with Sequenc…

200 papers

Large-scale learning of transformer language models has yielded improvements on a variety of natural language understanding tasks. Whether they can be effectively adapted for summarization, however, has been less explored, as the learned…

Computation and Language · Computer Science 2019-06-04 Andrew Hoang , Antoine Bosselut , Asli Celikyilmaz , Yejin Choi

Current abstractive summarization models either suffer from a lack of clear interpretability or provide incomplete rationales by only highlighting parts of the source document. To this end, we propose the Summarization Program (SP), an…

Computation and Language · Computer Science 2023-02-03 Swarnadeep Saha , Shiyue Zhang , Peter Hase , Mohit Bansal

The ability to generate natural language sequences from source code snippets has a variety of applications such as code summarization, documentation, and retrieval. Sequence-to-sequence (seq2seq) models, adopted from neural machine…

Machine Learning · Computer Science 2019-02-22 Uri Alon , Shaked Brody , Omer Levy , Eran Yahav

Text summarization is a fundamental task in natural language processing that aims to condense large amounts of textual information into concise and coherent summaries. With the exponential growth of content and the need to extract key…

Computation and Language · Computer Science 2023-06-26 Öykü Berfin Mercan , Sena Nur Cavsak , Aysu Deliahmetoglu , Senem Tanberk

In this work, we introduce temporal hierarchies to the sequence to sequence (seq2seq) model to tackle the problem of abstractive summarization of scientific articles. The proposed Multiple Timescale model of the Gated Recurrent Unit (MTGRU)…

Computation and Language · Computer Science 2016-07-05 Minsoo Kim , Moirangthem Dennis Singh , Minho Lee

We consider the problem of automatically generating a narrative biomedical evidence summary from multiple trial reports. We evaluate modern neural models for abstractive summarization of relevant article abstracts from systematic reviews…

Computation and Language · Computer Science 2020-12-23 Byron C. Wallace , Sayantan Saha , Frank Soboczenski , Iain J. Marshall

This paper creates a paradigm shift with regard to the way we build neural extractive summarization systems. Instead of following the commonly used framework of extracting sentences individually and modeling the relationship between…

Computation and Language · Computer Science 2020-04-21 Ming Zhong , Pengfei Liu , Yiran Chen , Danqing Wang , Xipeng Qiu , Xuanjing Huang

Recent neural sequence to sequence models have provided feasible solutions for abstractive summarization. However, such models are still hard to tackle long text dependency in the summarization task. A high-quality summarization system…

Computation and Language · Computer Science 2019-12-25 Pengcheng Liao , Chuang Zhang , Xiaojun Chen , Xiaofei Zhou

Abstractive dialogue summarization is to generate a concise and fluent summary covering the salient information in a dialogue among two or more interlocutors. It has attracted great attention in recent years based on the massive emergence…

Computation and Language · Computer Science 2023-08-08 Qi Jia , Yizhu Liu , Siyu Ren , Kenny Q. Zhu

Distributed representation learned with neural networks has recently shown to be effective in modeling natural languages at fine granularities such as words, phrases, and even sentences. Whether and how such an approach can be extended to…

Computation and Language · Computer Science 2016-10-27 Qian Chen , Xiaodan Zhu , Zhenhua Ling , Si Wei , Hui Jiang

Abstractive summarization systems aim to produce more coherent and concise summaries than their extractive counterparts. Popular neural models have achieved impressive results for single-document summarization, yet their outputs are often…

Computation and Language · Computer Science 2019-09-06 Eva Sharma , Luyang Huang , Zhe Hu , Lu Wang

In recent years, deep learning has revolutionized natural language processing (NLP) by enabling the development of models that can learn complex representations of language data, leading to significant improvements in performance across a…

Computation and Language · Computer Science 2023-10-17 Guanghua Wang , Weili Wu

Sequential abstractive neural summarizers often do not use the underlying structure in the input article or dependencies between the input sentences. This structure is essential to integrate and consolidate information from different parts…

Computation and Language · Computer Science 2022-11-18 Yifu Qiu , Shay B. Cohen

We provide a literature review about Automatic Text Summarization (ATS) systems. We consider a citation-based approach. We start with some popular and well-known papers that we have in hand about each topic we want to cover and we have…

Computation and Language · Computer Science 2023-10-05 Daniel O. Cajueiro , Arthur G. Nery , Igor Tavares , Maísa K. De Melo , Silvia A. dos Reis , Li Weigang , Victor R. R. Celestino

Abstractive summarization at controllable lengths is a challenging task in natural language processing. It is even more challenging for domains where limited training data is available or scenarios in which the length of the summary is not…

Computation and Language · Computer Science 2020-12-01 Ritesh Sarkhel , Moniba Keymanesh , Arnab Nandi , Srinivasan Parthasarathy

The Pointer-Generator architecture has shown to be a big improvement for abstractive summarization seq2seq models. However, the summaries produced by this model are largely extractive as over 30% of the generated sentences are copied from…

Computation and Language · Computer Science 2019-05-07 Freek Boutkan , Jorn Ranzijn , David Rau , Eelco van der Wel

Previous abstractive methods apply sequence-to-sequence structures to generate summary without a module to assist the system to detect vital mentions and relationships within a document. To address this problem, we utilize semantic graph to…

Computation and Language · Computer Science 2021-09-14 Qiwei Bi , Haoyuan Li , Kun Lu , Hanfang Yang

Query-focused summarization (QFS) aims to produce summaries that answer particular questions of interest, enabling greater user control and personalization. While recently released datasets, such as QMSum or AQuaMuSe, facilitate research…

Computation and Language · Computer Science 2022-04-28 Jesse Vig , Alexander R. Fabbri , Wojciech Kryściński , Chien-Sheng Wu , Wenhao Liu

Graphs that capture relations between textual units have great benefits for detecting salient information from multiple documents and generating overall coherent summaries. In this paper, we develop a neural abstractive multi-document…

Computation and Language · Computer Science 2020-05-21 Wei Li , Xinyan Xiao , Jiachen Liu , Hua Wu , Haifeng Wang , Junping Du

Abstractive text summarization is a challenging task, and one need to design a mechanism to effectively extract salient information from the source text and then generate a summary. A parsing process of the source text contains critical…

Computation and Language · Computer Science 2020-03-19 Haiyang Xu , Yun Wang , Kun Han , Baochang Ma , Junwen Chen , Xiangang Li