English
Related papers

Related papers: Improving Factual Error Correction for Abstractive…

200 papers

Recent pre-trained abstractive summarization systems have started to achieve credible performance, but a major barrier to their use in practice is their propensity to output summaries that are not faithful to the input and that contain…

Computation and Language · Computer Science 2021-04-12 Tanya Goyal , Greg Durrett

Modern summarization models generate highly fluent but often factually unreliable outputs. This motivated a surge of metrics attempting to measure the factuality of automatically generated summaries. Due to the lack of common benchmarks,…

Computation and Language · Computer Science 2021-07-27 Artidoro Pagnoni , Vidhisha Balachandran , Yulia Tsvetkov

E-commerce stores collect customer feedback to let sellers learn about customer concerns and enhance customer order experience. Because customer feedback often contains redundant information, a concise summary of the feedback can be…

Computation and Language · Computer Science 2021-07-01 Yang Liu , Yifei Sun , Vincent Gao

Reinforcement learning with evaluation metrics as rewards is widely used to enhance specific capabilities of language models. However, for tasks such as factually consistent summarisation, existing metrics remain underdeveloped, limiting…

Computation and Language · Computer Science 2026-05-27 Yuxuan Ye , Raul Santos-Rodriguez , Edwin Simpson

Fighting misinformation is a challenging, yet crucial, task. Despite the growing number of experts being involved in manual fact-checking, this activity is time-consuming and cannot keep up with the ever-increasing amount of Fake News…

Computation and Language · Computer Science 2023-08-30 Daniel Russo , Serra Sinem Tekiroglu , Marco Guerini

Current metrics for evaluating factuality for abstractive document summarization have achieved high correlations with human judgment, but they do not account for the vision modality and thus are not adequate for vision-and-language…

Computation and Language · Computer Science 2022-11-07 David Wan , Mohit Bansal

Generating factual-consistent summaries is a challenging task for abstractive summarization. Previous works mainly encode factual information or perform post-correct/rank after decoding. In this paper, we provide a factual-consistent…

Computation and Language · Computer Science 2022-01-11 Wei Liu , Huanqin Wu , Wenjing Mu , Zhen Li , Tao Chen , Dan Nie

The propensity of abstractive summarization models to make factual errors has been studied extensively, including design of metrics to detect factual errors and annotation of errors in current systems' outputs. However, the ever-evolving…

Despite recent improvements in abstractive summarization, most current approaches generate summaries that are not factually consistent with the source document, severely restricting their trust and usage in real-world applications. Recent…

Computation and Language · Computer Science 2022-07-20 Leonardo F. R. Ribeiro , Mengwen Liu , Iryna Gurevych , Markus Dreyer , Mohit Bansal

Detecting factual inconsistency for long document summarization remains challenging, given the complex structure of the source article and long summary length. In this work, we study factual inconsistency errors and connect them with a line…

Computation and Language · Computer Science 2025-02-11 Yang Zhong , Diane Litman

Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in abstractive…

Computation and Language · Computer Science 2024-10-03 Joonho Yang , Seunghyun Yoon , Byeongjeong Kim , Hwanhee Lee

Abstractive summarization systems based on pretrained language models often generate coherent but factually inconsistent sentences. In this paper, we present a counterfactual data augmentation approach where we augment data with perturbed…

Computation and Language · Computer Science 2022-05-26 Dheeraj Rajagopal , Siamak Shakeri , Cicero Nogueira dos Santos , Eduard Hovy , Chung-Ching Chang

Despite the seeming success of contemporary grounded text generation systems, they often tend to generate factually inconsistent text with respect to their input. This phenomenon is emphasized in tasks like summarization, in which the…

Recent advancements in text summarization, particularly with the advent of Large Language Models (LLMs), have shown remarkable performance. However, a notable challenge persists as a substantial number of automatically-generated summaries…

Computation and Language · Computer Science 2024-09-04 Alessandro Scirè , Karim Ghonim , Roberto Navigli

Ensuring factual consistency is crucial for natural language generation tasks, particularly in abstractive summarization, where preserving the integrity of information is paramount. Prior works on evaluating factual consistency of…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Kung-Hsiang Huang , Jingnong Qu , Nanyun Peng

Modern abstractive summarization models often generate summaries that contain hallucinated or contradictory information. In this paper, we propose a simple but effective contrastive learning framework that incorporates recent developments…

Computation and Language · Computer Science 2023-07-11 I-Chun Chern , Zhiruo Wang , Sanjan Das , Bhavuk Sharma , Pengfei Liu , Graham Neubig

Factual inconsistencies in generated summaries severely limit the practical applications of abstractive dialogue summarization. Although significant progress has been achieved by using pre-trained models, substantial amounts of hallucinated…

Computation and Language · Computer Science 2023-05-10 Xiangru Tang , Arjun Nair , Borui Wang , Bingyao Wang , Jai Desai , Aaron Wade , Haoran Li , Asli Celikyilmaz , Yashar Mehdad , Dragomir Radev

A key challenge for abstractive summarization is ensuring factual consistency of the generated summary with respect to the original document. For example, state-of-the-art models trained on existing datasets exhibit entity hallucination,…

Computation and Language · Computer Science 2021-02-19 Feng Nan , Ramesh Nallapati , Zhiguo Wang , Cicero Nogueira dos Santos , Henghui Zhu , Dejiao Zhang , Kathleen McKeown , Bing Xiang

Abstractive summarization using large language models (LLMs) has become an essential tool for condensing information. However, despite their ability to generate fluent summaries, these models sometimes produce unfaithful summaries,…

Computation and Language · Computer Science 2025-10-14 Sicong Huang , Qianqi Yan , Shengze Wang , Ian Lane

A series of datasets and models have been proposed for summaries generated for well-formatted documents such as news articles. Dialogue summaries, however, have been under explored. In this paper, we present the first dataset with…

Computation and Language · Computer Science 2023-05-29 Rongxin Zhu , Jianzhong Qi , Jey Han Lau