English
Related papers

Related papers: Evaluating the Factual Consistency of Abstractive …

200 papers

Modern abstractive summarization models often generate summaries that contain hallucinated or contradictory information. In this paper, we propose a simple but effective contrastive learning framework that incorporates recent developments…

Computation and Language · Computer Science 2023-07-11 I-Chun Chern , Zhiruo Wang , Sanjan Das , Bhavuk Sharma , Pengfei Liu , Graham Neubig

Factual inconsistency with source documents in automatically generated summaries can lead to misinformation or pose risks. Existing factual consistency (FC) metrics are constrained by their performance, efficiency, and explainability.…

Computation and Language · Computer Science 2025-02-28 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Abstractive summarization models often generate inconsistent summaries containing factual errors or hallucinated content. Recent works focus on correcting factual errors in generated summaries via post-editing. Such correction models are…

Computation and Language · Computer Science 2022-11-01 Vidhisha Balachandran , Hannaneh Hajishirzi , William W. Cohen , Yulia Tsvetkov

Neural abstractive summarization models are prone to generate summaries which are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a downstream…

Computation and Language · Computer Science 2022-05-13 Prasetya Ajie Utama , Joshua Bambrick , Nafise Sadat Moosavi , Iryna Gurevych

The performance of text summarization has been greatly boosted by pre-trained language models. A main concern of existing methods is that most generated summaries are not factually inconsistent with their source documents. To alleviate the…

Computation and Language · Computer Science 2023-04-14 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

State-of-the-art summarization models still struggle to be factually consistent with the input text. A model-agnostic way to address this problem is post-editing the generated summaries. However, existing approaches typically fail to remove…

Computation and Language · Computer Science 2022-11-14 Alexander R. Fabbri , Prafulla Kumar Choubey , Jesse Vig , Chien-Sheng Wu , Caiming Xiong

Neural abstractive summarization models make summaries in an end-to-end manner, and little is known about how the source information is actually converted into summaries. In this paper, we define input sentences that contain essential…

Computation and Language · Computer Science 2024-02-08 Yoshi Suhara , Dimitris Alikaniotis

This paper proposes a text summarization approach for factual reports using a deep learning model. This approach consists of three phases: feature extraction, feature enhancement, and summary generation, which work together to assimilate…

Computation and Language · Computer Science 2019-01-10 Sukriti Verma , Vagisha Nidhi

Abstractive summarization typically relies on large collections of paired articles and summaries. However, in many cases, parallel data is scarce and costly to obtain. We develop an abstractive summarization system that relies only on large…

Computation and Language · Computer Science 2020-03-04 Nikola I. Nikolov , Richard H. R. Hahnloser

In the summarization domain, a key requirement for summaries is to be factually consistent with the input document. Previous work has found that natural language inference (NLI) models do not perform competitively when applied to…

Computation and Language · Computer Science 2021-11-19 Philippe Laban , Tobias Schnabel , Paul N. Bennett , Marti A. Hearst

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

Computation and Language · Computer Science 2026-02-10 Leandro Anghinoni , Jorge Sanchez

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually…

Computation and Language · Computer Science 2021-08-03 Anushka Gupta , Diksha Chugh , Anjum , Rahul Katarya

We present FactPEGASUS, an abstractive summarization model that addresses the problem of factuality during pre-training and fine-tuning: (1) We augment the sentence selection strategy of PEGASUS's (Zhang et al., 2020) pre-training objective…

Computation and Language · Computer Science 2022-05-17 David Wan , Mohit Bansal

Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent…

Computation and Language · Computer Science 2022-07-20 Leonardo F. R. Ribeiro , Mengwen Liu , Iryna Gurevych , Markus Dreyer , Mohit Bansal

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

Computation and Language · Computer Science 2025-03-03 Colleen Gilhuly , Haleh Shahzad

While recent work in abstractive summarization has resulted in higher scores in automatic metrics, there is little understanding on how these systems combine information taken from multiple document sentences. In this paper, we analyze the…

Computation and Language · Computer Science 2019-10-02 Logan Lebanoff , John Muchovej , Franck Dernoncourt , Doo Soon Kim , Seokhwan Kim , Walter Chang , Fei Liu

While large language models (LLMs) have proven to be effective on a large variety of tasks, they are also known to hallucinate information. To measure whether an LLM prefers factually consistent continuations of its input, we propose a new…

Computation and Language · Computer Science 2023-12-05 Derek Tam , Anisha Mascarenhas , Shiyue Zhang , Sarah Kwan , Mohit Bansal , Colin Raffel

Abstractive summarization using large language models (LLMs) has become an essential tool for condensing information. However, despite their ability to generate fluent summaries, these models sometimes produce unfaithful summaries,…

Computation and Language · Computer Science 2025-10-14 Sicong Huang , Qianqi Yan , Shengze Wang , Ian Lane

Most studies on abstractive summarization report ROUGE scores between system and reference summaries. However, we have a concern about the truthfulness of generated summaries: whether all facts of a generated summary are mentioned in the…

Computation and Language · Computer Science 2020-05-06 Kazuki Matsumaru , Sho Takase , Naoaki Okazaki

E-commerce stores collect customer feedback to let sellers learn about customer concerns and enhance customer order experience. Because customer feedback often contains redundant information, a concise summary of the feedback can be…

Computation and Language · Computer Science 2021-07-01 Yang Liu , Yifei Sun , Vincent Gao