English
Related papers

Related papers: Learning to Summarize Long Texts with Memory Compr…

200 papers

Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documents. Most recent…

Computation and Language · Computer Science 2022-03-16 Bo Pang , Erik Nijkamp , Wojciech Kryściński , Silvio Savarese , Yingbo Zhou , Caiming Xiong

Document summarization provides an instrument for faster understanding the collection of text documents and has several real-life applications. With the growth of online text data, numerous summarization models have been proposed recently.…

Computation and Language · Computer Science 2022-04-01 Mingyang Song , Liping Jing

Abstractive text summarization aims at compressing the information of a long source document into a rephrased, condensed summary. Despite advances in modeling techniques, abstractive summarization models still suffer from several key…

Computation and Language · Computer Science 2021-02-17 Vidhisha Balachandran , Artidoro Pagnoni , Jay Yoon Lee , Dheeraj Rajagopal , Jaime Carbonell , Yulia Tsvetkov

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach…

Computation and Language · Computer Science 2018-05-23 Arman Cohan , Franck Dernoncourt , Doo Soon Kim , Trung Bui , Seokhwan Kim , Walter Chang , Nazli Goharian

Text summarization aims to generate a headline or a short summary consisting of the major information of the source text. Recent studies employ the sequence-to-sequence framework to encode the input with a neural network and generate…

Computation and Language · Computer Science 2020-03-26 Haiyang Xu , Yahao He , Kun Han , Junwen Chen , Xiangang Li

Sequence to sequence (Seq2Seq) learning has recently been used for abstractive and extractive summarization. In current study, Seq2Seq models have been used for eBay product description summarization. We propose a novel Document-Context…

Computation and Language · Computer Science 2018-07-31 Chandra Khatri , Gyanit Singh , Nish Parikh

Automatically generating human-readable text describing the functionality of a program is the intent of source code summarization. Although neural language models achieve significant performance in this field, they are limited by their…

Artificial Intelligence · Computer Science 2024-04-02 Tong Ye , Lingfei Wu , Tengfei Ma , Xuhong Zhang , Yangkai Du , Peiyu Liu , Shouling Ji , Wenhai Wang

Neural models have become successful at producing abstractive summaries that are human-readable and fluent. However, these models have two critical shortcomings: they often don't respect the facts that are either included in the source…

Computation and Language · Computer Science 2020-06-30 Beliz Gunel , Chenguang Zhu , Michael Zeng , Xuedong Huang

Interleaved texts, where posts belonging to different threads occur in a sequence, commonly occur in online chat posts, so that it can be time-consuming to quickly obtain an overview of the discussions. Existing systems first disentangle…

Computation and Language · Computer Science 2021-03-10 Sanjeev Kumar Karn , Francine Chen , Yan-Ying Chen , Ulli Waltinger , Hinrich Schuetze

Recent Transformer-based summarization models have provided a promising approach to abstractive summarization. They go beyond sentence selection and extractive strategies to deal with more complicated tasks such as novel word generation and…

Computation and Language · Computer Science 2023-02-09 Sajad Sotudeh , Hanieh Deilamsalehy , Franck Dernoncourt , Nazli Goharian

We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization,…

Computation and Language · Computer Science 2020-01-22 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Atsushi Otsuka , Hisako Asano , Junji Tomita , Hiroyuki Shindo , Yuji Matsumoto

Abstractive summarization has been studied using neural sequence transduction methods with datasets of large, paired document-summary examples. However, such datasets are rare and the models trained from them do not generalize to other…

Computation and Language · Computer Science 2019-05-24 Eric Chu , Peter J. Liu

Most existing Neural Machine Translation models use groups of characters or whole words as their unit of input and output. We propose a model with a hierarchical char2word encoder, that takes individual characters both as input and output.…

Computation and Language · Computer Science 2016-10-21 Alexander Rosenberg Johansen , Jonas Meinertz Hansen , Elias Khazen Obeid , Casper Kaae Sønderby , Ole Winther

Text summarization and text simplification are two major ways to simplify the text for poor readers, including children, non-native speakers, and the functionally illiterate. Text summarization is to produce a brief summary of the main…

Computation and Language · Computer Science 2017-10-09 Shuming Ma , Xu Sun

End-to-end speech summarization (E2E SSum) directly summarizes input speech into easy-to-read short sentences with a single model. This approach is promising because it, in contrast to the conventional cascade approach, can utilize full…

Computation and Language · Computer Science 2023-06-08 Kohei Matsuura , Takanori Ashihara , Takafumi Moriya , Tomohiro Tanaka , Takatomo Kano , Atsunori Ogawa , Marc Delcroix

In retrieval applications, binary hashes are known to offer significant improvements in terms of both memory and speed. We investigate the compression of sentence embeddings using a neural encoder-decoder architecture, which is trained by…

Information Retrieval · Computer Science 2019-08-16 Felix Hamann , Nadja Kurz , Adrian Ulges

Long document summarization poses a significant challenge in natural language processing due to input lengths that exceed the capacity of most state-of-the-art pre-trained language models. This study proposes a hierarchical framework that…

Computation and Language · Computer Science 2024-10-10 Yuan-Jhe Yin , Bo-Yu Chen , Berlin Chen

In the age of information overload, content management for online news articles relies on efficient summarization to enhance accessibility and user engagement. This article addresses the challenge of extractive text summarization by…

Machine Learning · Computer Science 2025-09-22 Sajib Biswas , Milon Biswas , Arunima Mandal , Fatema Tabassum Liza , Joy Sarker

Neural abstractive summarization has been studied in many pieces of literature and achieves great success with the aid of large corpora. However, when encountering novel tasks, one may not always benefit from transfer learning due to the…

Computation and Language · Computer Science 2021-06-01 Yi-Syuan Chen , Hong-Han Shuai