English
Related papers

Related papers: Correcting Diverse Factual Errors in Abstractive S…

200 papers

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

Computation and Language · Computer Science 2026-02-10 Leandro Anghinoni , Jorge Sanchez

Neural abstractive summarization models are able to generate summaries which have high overlap with human references. However, existing models are not optimized for factual correctness, a critical metric in real-world applications. In this…

Computation and Language · Computer Science 2020-04-29 Yuhao Zhang , Derek Merck , Emily Bao Tsai , Christopher D. Manning , Curtis P. Langlotz

We study generating abstractive summaries that are faithful and factually consistent with the given articles. A novel contrastive learning formulation is presented, which leverages both reference summaries, as positive training data, and…

Computation and Language · Computer Science 2021-09-21 Shuyang Cao , Lu Wang

Neural models for abstractive summarization tend to generate output that is fluent and well-formed but lacks semantic faithfulness, or factuality, with respect to the input documents. In this paper, we analyze the tradeoff between…

Computation and Language · Computer Science 2023-04-26 Markus Dreyer , Mengwen Liu , Feng Nan , Sandeep Atluri , Sujith Ravi

Abstractive summarization has enjoyed renewed interest in recent years, thanks to pre-trained language models and the availability of large-scale datasets. Despite promising results, current models still suffer from generating factually…

Computation and Language · Computer Science 2024-01-08 Roee Aharoni , Shashi Narayan , Joshua Maynez , Jonathan Herzig , Elizabeth Clark , Mirella Lapata

Despite the recent advancements in abstractive summarization systems leveraged from large-scale datasets and pre-trained language models, the factual correctness of the summary is still insufficient. One line of trials to mitigate this…

Computation and Language · Computer Science 2022-04-19 Hwanhee Lee , Cheoneum Park , Seunghyun Yoon , Trung Bui , Franck Dernoncourt , Juae Kim , Kyomin Jung

Detecting factual errors in summaries has been an important and challenging subject in summarization research. Inspired by the emergent ability of large language models (LLMs), we explore evaluating factual consistency of summaries by…

Computation and Language · Computer Science 2023-10-13 Shiqi Chen , Siyang Gao , Junxian He

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Unlike extractive summarization, abstractive summarization has to fuse different parts of the source text, which inclines to create fake facts. Our preliminary study reveals nearly 30% of the outputs from a state-of-the-art neural…

Information Retrieval · Computer Science 2017-11-15 Ziqiang Cao , Furu Wei , Wenjie Li , Sujian Li

Dialogue summarization is abstractive in nature, making it suffer from factual errors. The factual correctness of summaries has the highest priority before practical applications. Many efforts have been made to improve faithfulness in text…

Computation and Language · Computer Science 2022-10-24 Bin Wang , Chen Zhang , Yan Zhang , Yiming Chen , Haizhou Li

The propensity of abstractive summarization models to make factual errors has been studied extensively, including design of metrics to detect factual errors and annotation of errors in current systems' outputs. However, the ever-evolving…

E-commerce stores collect customer feedback to let sellers learn about customer concerns and enhance customer order experience. Because customer feedback often contains redundant information, a concise summary of the feedback can be…

Computation and Language · Computer Science 2021-07-01 Yang Liu , Yifei Sun , Vincent Gao

Abstractive summarization using large language models (LLMs) has become an essential tool for condensing information. However, despite their ability to generate fluent summaries, these models sometimes produce unfaithful summaries,…

Computation and Language · Computer Science 2025-10-14 Sicong Huang , Qianqi Yan , Shengze Wang , Ian Lane

Modern abstractive summarization models often generate summaries that contain hallucinated or contradictory information. In this paper, we propose a simple but effective contrastive learning framework that incorporates recent developments…

Computation and Language · Computer Science 2023-07-11 I-Chun Chern , Zhiruo Wang , Sanjan Das , Bhavuk Sharma , Pengfei Liu , Graham Neubig

Generating factual-consistent summaries is a challenging task for abstractive summarization. Previous works mainly encode factual information or perform post-correct/rank after decoding. In this paper, we provide a factual-consistent…

Computation and Language · Computer Science 2022-01-11 Wei Liu , Huanqin Wu , Wenjing Mu , Zhen Li , Tao Chen , Dan Nie

Scoring the factuality of a generated summary involves measuring the degree to which a target text contains factual information using the input document as support. Given the similarities in the problem formulation, previous work has shown…

Computation and Language · Computer Science 2022-12-01 John Glover , Federico Fancellu , Vasudevan Jagannathan , Matthew R. Gormley , Thomas Schaaf

Detecting factual inconsistency for long document summarization remains challenging, given the complex structure of the source article and long summary length. In this work, we study factual inconsistency errors and connect them with a line…

Computation and Language · Computer Science 2025-02-11 Yang Zhong , Diane Litman

Despite substantial progress in abstractive text summarization to generate fluent and informative texts, the factual inconsistency in the generated summaries remains an important yet challenging problem to be solved. In this paper, we…

Computation and Language · Computer Science 2023-05-19 Chenhe Dong , Yuexiang Xie , Yaliang Li , Ying Shen

Most studies on abstractive summarization report ROUGE scores between system and reference summaries. However, we have a concern about the truthfulness of generated summaries: whether all facts of a generated summary are mentioned in the…

Computation and Language · Computer Science 2020-05-06 Kazuki Matsumaru , Sho Takase , Naoaki Okazaki

Despite significant progress in neural abstractive summarization, recent studies have shown that the current models are prone to generating summaries that are unfaithful to the original context. To address the issue, we study contrast…

Computation and Language · Computer Science 2021-04-20 Sihao Chen , Fan Zhang , Kazoo Sone , Dan Roth