English
Related papers

Related papers: SummAE: Zero-Shot Abstractive Text Summarization u…

200 papers

We propose an abstraction-based multi-document summarization framework that can construct new sentences by exploring more fine-grained syntactic units than sentences, namely, noun/verb phrases. Different from existing abstraction-based…

Computation and Language · Computer Science 2015-06-08 Lidong Bing , Piji Li , Yi Liao , Wai Lam , Weiwei Guo , Rebecca J. Passonneau

We consider the problem of automatically generating a narrative biomedical evidence summary from multiple trial reports. We evaluate modern neural models for abstractive summarization of relevant article abstracts from systematic reviews…

Computation and Language · Computer Science 2020-12-23 Byron C. Wallace , Sayantan Saha , Frank Soboczenski , Iain J. Marshall

Existing neural generation approaches create multi-sentence text as a single sequence. In this paper we propose a structured convolutional decoder that is guided by the content structure of target summaries. We compare our model with…

Computation and Language · Computer Science 2019-06-12 Laura Perez-Beltrachini , Yang Liu , Mirella Lapata

Recent work on abstractive summarization has made progress with neural encoder-decoder architectures. However, such models are often challenged due to their lack of explicit semantic modeling of the source document and its summary. In this…

Computation and Language · Computer Science 2018-08-29 Hardy , Andreas Vlachos

Based on the remarkable achievements of pre-trained language models in abstractive summarization, the copying mechanism has proved helpful by improving the factuality, stability, and overall performance. This work proposes PROM, a new…

Computation and Language · Computer Science 2024-02-29 Xinbei Ma , Yeyun Gong , Pengcheng He , Hai Zhao , Nan Duan

We propose a new approach to generate multiple variants of the target summary with diverse content and varying lengths, then score and select admissible ones according to users' needs. Abstractive summarizers trained on single reference…

Computation and Language · Computer Science 2021-04-06 Kaiqiang Song , Bingqing Wang , Zhe Feng , Fei Liu

Pre-trained sequence-to-sequence (seq-to-seq) models have significantly improved the accuracy of several language generation tasks, including abstractive summarization. Although the fluency of abstractive summarization has been greatly…

Computation and Language · Computer Science 2020-03-31 Itsumi Saito , Kyosuke Nishida , Kosuke Nishida , Junji Tomita

State-of-the-art abstractive summarization systems frequently hallucinate content that is not supported by the source document, mainly due to noise in the training dataset. Existing methods opt to drop the noisy samples or tokens from the…

Computation and Language · Computer Science 2023-02-20 Meng Cao , Yue Dong , Jingyi He , Jackie Chi Kit Cheung

In this paper we propose a new generative model of text, Step-unrolled Denoising Autoencoder (SUNDAE), that does not rely on autoregressive models. Similarly to denoising diffusion techniques, SUNDAE is repeatedly applied on a sequence of…

Computation and Language · Computer Science 2022-04-20 Nikolay Savinov , Junyoung Chung , Mikolaj Binkowski , Erich Elsen , Aaron van den Oord

Abstractive summarization for long-document or multi-document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long-distance relations in text. In this paper, we present BASS, a novel framework for…

Computation and Language · Computer Science 2021-05-26 Wenhao Wu , Wei Li , Xinyan Xiao , Jiachen Liu , Ziqiang Cao , Sujian Li , Hua Wu , Haifeng Wang

Currently, large language models are gaining popularity, their achievements are used in many areas, ranging from text translation to generating answers to queries. However, the main problem with these new machine learning algorithms is that…

Information Retrieval · Computer Science 2025-04-17 Ilia Derkach

The advancements in deep learning, particularly the introduction of transformers, have been pivotal in enhancing various natural language processing (NLP) tasks. These include text-to-text applications such as machine translation, text…

Artificial Intelligence · Computer Science 2024-12-24 Gospel Ozioma Nnadi , Flavio Bertini

Automatic chart to text summarization is an effective tool for the visually impaired people along with providing precise insights of tabular data in natural language to the user. A large and well-structured dataset is always a key part for…

Computation and Language · Computer Science 2023-06-13 Raian Rahman , Rizvi Hasan , Abdullah Al Farhad , Md Tahmid Rahman Laskar , Md. Hamjajul Ashmafee , Abu Raihan Mostofa Kamal

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and…

Computation and Language · Computer Science 2017-06-14 Ed Collins , Isabelle Augenstein , Sebastian Riedel

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually…

Computation and Language · Computer Science 2021-08-03 Anushka Gupta , Diksha Chugh , Anjum , Rahul Katarya

Sequence-to-sequence deep neural models fine-tuned for abstractive summarization can achieve great performance on datasets with enough human annotations. Yet, it has been shown that they have not reached their full potential, with a wide…

Computation and Language · Computer Science 2023-05-29 Mathieu Ravaut , Shafiq Joty , Nancy F. Chen

Current neural network-based methods to the problem of document summarisation struggle when applied to datasets containing large inputs. In this paper we propose a new approach to the challenge of content-selection when dealing with…

Computation and Language · Computer Science 2025-05-07 Maciej Zembrzuski , Saad Mahamood

Traditional language models, adept at next-token prediction in text sequences, often struggle with transduction tasks between distinct symbolic systems, particularly when parallel data is scarce. Addressing this issue, we introduce…

Machine Learning · Computer Science 2024-02-19 Mohammad Hossein Amani , Nicolas Mario Baldwin , Amin Mansouri , Martin Josifoski , Maxime Peyrard , Robert West

Research on automated text summarization relies heavily on human and automatic evaluation. While recent work on human evaluation mainly adopted intrinsic evaluation methods, judging the generic quality of text summaries, e.g.…

Computation and Language · Computer Science 2023-05-25 Xiao Pu , Mingqi Gao , Xiaojun Wan

Opinion summarization is the task of automatically generating summaries for a set of reviews about a specific target (e.g., a movie or a product). Since the number of reviews for each target can be prohibitively large, neural network-based…

Computation and Language · Computer Science 2021-01-25 Reinald Kim Amplayo , Mirella Lapata