English
Related papers

Related papers: Counterfactual Debiasing for Generating Factually …

200 papers

Abstractive summarization models often generate inconsistent summaries containing factual errors or hallucinated content. Recent works focus on correcting factual errors in generated summaries via post-editing. Such correction models are…

Computation and Language · Computer Science 2022-11-01 Vidhisha Balachandran , Hannaneh Hajishirzi , William W. Cohen , Yulia Tsvetkov

Despite significant progress, state-of-the-art abstractive summarization methods are still prone to hallucinate content inconsistent with the source document. In this paper, we propose Constrained Abstractive Summarization (CAS), a general…

Computation and Language · Computer Science 2021-12-17 Yuning Mao , Xiang Ren , Heng Ji , Jiawei Han

Practical applications of abstractive summarization models are limited by frequent factual inconsistencies with respect to their input. Existing automatic evaluation metrics for summarization are largely insensitive to such errors. We…

Computation and Language · Computer Science 2020-04-10 Alex Wang , Kyunghyun Cho , Mike Lewis

We introduce a general framework for abstractive summarization with factual consistency and distinct modeling of the narrative flow in an output summary. Our work addresses current limitations of models for abstractive summarization that…

Computation and Language · Computer Science 2021-04-12 Saadia Gabriel , Antoine Bosselut , Jeff Da , Ari Holtzman , Jan Buys , Kyle Lo , Asli Celikyilmaz , Yejin Choi

Existing factual consistency evaluation approaches for text summarization provide binary predictions and limited insights into the weakness of summarization systems. Therefore, we propose the task of fine-grained inconsistency detection,…

Computation and Language · Computer Science 2023-05-25 Hou Pong Chan , Qi Zeng , Heng Ji

Ensuring factual consistency is crucial for natural language generation tasks, particularly in abstractive summarization, where preserving the integrity of information is paramount. Prior works on evaluating factual consistency of…

Computation and Language · Computer Science 2024-10-07 Haoyi Qiu , Kung-Hsiang Huang , Jingnong Qu , Nanyun Peng

Abstractive summarization has enjoyed renewed interest in recent years, thanks to pre-trained language models and the availability of large-scale datasets. Despite promising results, current models still suffer from generating factually…

Computation and Language · Computer Science 2024-01-08 Roee Aharoni , Shashi Narayan , Joshua Maynez , Jonathan Herzig , Elizabeth Clark , Mirella Lapata

Counterfactual reasoning has emerged as a crucial technique for generalizing the reasoning capabilities of large language models (LLMs). By generating and analyzing counterfactual scenarios, researchers can assess the adaptability and…

Artificial Intelligence · Computer Science 2026-02-17 Shuai Yang , Qi Yang , Luoxi Tang , Yuqiao Meng , Nancy Guo , Jeremy Blackburn , Zhaohan Xi

Neural abstractive summarization models are prone to generate summaries which are factually inconsistent with their source documents. Previous work has introduced the task of recognizing such factual inconsistency as a downstream…

Computation and Language · Computer Science 2022-05-13 Prasetya Ajie Utama , Joshua Bambrick , Nafise Sadat Moosavi , Iryna Gurevych

Accurate estimation of counterfactual outcomes in high-dimensional data is crucial for decision-making and understanding causal relationships and intervention outcomes in various domains, including healthcare, economics, and social…

Machine Learning · Computer Science 2024-07-31 Jiageng Zhu , Hanchen Xie , Jiazhi Li , Wael Abd-Almageed

This research is focused on generating achievable counterfactual explanations. Given a negative outcome computed by a machine learning model or a decision system, the novel CoGS approach generates (i) a counterfactual solution that…

Artificial Intelligence · Computer Science 2025-02-14 Sopam Dasgupta

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

We introduce iFacetSum, a web application for exploring topical document sets. iFacetSum integrates interactive summarization together with faceted search, by providing a novel faceted navigation scheme that yields abstractive summaries for…

Computation and Language · Computer Science 2021-09-27 Eran Hirsch , Alon Eirew , Ori Shapira , Avi Caciularu , Arie Cattan , Ori Ernst , Ramakanth Pasunuru , Hadar Ronen , Mohit Bansal , Ido Dagan

Causal structure discovery methods are commonly applied to structured data where the causal variables are known and where statistical testing can be used to assess the causal relationships. By contrast, recovering a causal structure from…

Computation and Language · Computer Science 2024-10-10 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

Abstractive summarization systems based on pretrained language models often generate coherent but factually inconsistent sentences. In this paper, we present a counterfactual data augmentation approach where we augment data with perturbed…

Computation and Language · Computer Science 2022-05-26 Dheeraj Rajagopal , Siamak Shakeri , Cicero Nogueira dos Santos , Eduard Hovy , Chung-Ching Chang

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in…

Computation and Language · Computer Science 2023-11-10 Nan Zhang , Yusen Zhang , Wu Guo , Prasenjit Mitra , Rui Zhang

Improving factual consistency in abstractive summarization has been a focus of current research. One promising approach is the post-editing method. However, previous works have yet to make sufficient use of factual factors in summaries and…

Computation and Language · Computer Science 2024-02-14 Yiyang Li , Lei Li , Dingxin Hu , Xueyi Hao , Marina Litvak , Natalia Vanetik , Yanquan Zhou

Counterfactual data augmentation has recently emerged as a method to mitigate confounding biases in the training data. These biases, such as spurious correlations, arise due to various observed and unobserved confounding variables in the…

Machine Learning · Computer Science 2023-11-22 Abbavaram Gowtham Reddy , Saketh Bachu , Saloni Dash , Charchit Sharma , Amit Sharma , Vineeth N Balasubramanian

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

VQA models may tend to rely on language bias as a shortcut and thus fail to sufficiently learn the multi-modal knowledge from both vision and language. Recent debiasing methods proposed to exclude the language prior during inference.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yulei Niu , Kaihua Tang , Hanwang Zhang , Zhiwu Lu , Xian-Sheng Hua , Ji-Rong Wen