中文
相关论文

相关论文: A Comparative Analysis of Counterfactual Explanati…

200 篇论文

Causality is vital for understanding true cause-and-effect relationships between variables within predictive models, rather than relying on mere correlations, making it highly relevant in the field of Explainable AI. In an automated…

机器学习 · 计算机科学 2024-08-28 Arturo Fredes , Jordi Vitria

Counterfactual reasoning has emerged as a crucial technique for generalizing the reasoning capabilities of large language models (LLMs). By generating and analyzing counterfactual scenarios, researchers can assess the adaptability and…

人工智能 · 计算机科学 2026-02-17 Shuai Yang , Qi Yang , Luoxi Tang , Yuqiao Meng , Nancy Guo , Jeremy Blackburn , Zhaohan Xi

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

LLMs can be unpredictable, as even slight alterations to the prompt can cause the output to change in unexpected ways. Thus, the ability of models to accurately explain their behavior is critical, especially in high-stakes settings. One…

计算与语言 · 计算机科学 2025-11-26 Marvin Limpijankit , Yanda Chen , Melanie Subbiah , Nicholas Deas , Kathleen McKeown

Counterfactual explanations are viewed as an effective way to explain machine learning predictions. This interest is reflected by a relatively young literature with already dozens of algorithms aiming to generate such explanations. These…

机器学习 · 计算机科学 2022-12-05 Raphael Mazzine , David Martens

Counterfactual explanation methods provide information on how feature values of individual observations must be changed to obtain a desired prediction. Despite the increasing amount of proposed methods in research, only a few…

机器学习 · 统计学 2023-09-19 Susanne Dandl , Andreas Hofheinz , Martin Binder , Bernd Bischl , Giuseppe Casalicchio

Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a…

机器学习 · 计算机科学 2019-12-09 Ramaravind Kommiya Mothilal , Amit Sharma , Chenhao Tan

Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model…

软件工程 · 计算机科学 2021-11-11 Jürgen Cito , Isil Dillig , Vijayaraghavan Murali , Satish Chandra

A prominent weakness of modern language models (LMs) is their tendency to generate factually incorrect text, which hinders their usability. A natural question is whether such factual errors can be detected automatically. Inspired by…

计算与语言 · 计算机科学 2023-05-23 Roi Cohen , May Hamri , Mor Geva , Amir Globerson

While current Automated Essay Scoring (AES) methods demonstrate high scoring agreement with human raters, their decision-making mechanisms are not fully understood. Our proposed method, using counterfactual intervention assisted by Large…

计算与语言 · 计算机科学 2024-10-10 Yupei Wang , Renfen Hu , Zhe Zhao

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

机器学习 · 计算机科学 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

Large Language Models (LLMs) are increasingly used for accessing information on the web. Their truthfulness and factuality are thus of great interest. To help users make the right decisions about the information they get, LLMs should not…

计算与语言 · 计算机科学 2024-04-03 Chenglei Si , Navita Goyal , Sherry Tongshuang Wu , Chen Zhao , Shi Feng , Hal Daumé , Jordan Boyd-Graber

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

机器学习 · 计算机科学 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Interventions targeting the representation space of language models (LMs) have emerged as an effective means to influence model behavior. Such methods are employed, for example, to eliminate or alter the encoding of demographic information…

计算与语言 · 计算机科学 2025-02-12 Matan Avitan , Ryan Cotterell , Yoav Goldberg , Shauli Ravfogel

This paper addresses the challenge of generating Counterfactual Explanations (CEs), involving the identification and modification of the fewest necessary features to alter a classifier's prediction for a given image. Our proposed method,…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

Bias in large language models (LLMs) has many forms, from overt discrimination to implicit stereotypes. Counterfactual bias evaluation is a widely used approach to quantifying bias and often relies on template-based probes that explicitly…

计算与语言 · 计算机科学 2026-01-15 Farnaz Kohankhaki , D. B. Emerson , Jacob-Junqi Tian , Laleh Seyyed-Kalantari , Faiza Khan Khattak

Counterfactuals refer to minimally edited inputs that cause a model's prediction to change, serving as a promising approach to explaining the model's behavior. Large language models (LLMs) excel at generating English counterfactuals and…

Counterfactual text generation aims to minimally change a text, such that it is classified differently. Judging advancements in method development for counterfactual text generation is hindered by a non-uniform usage of data sets and…

计算与语言 · 计算机科学 2024-08-14 Van Bach Nguyen , Jörg Schlötterer , Christin Seifert

To collaborate effectively with humans, language models must be able to explain their decisions in natural language. We study a specific type of self-explanation: self-generated counterfactual explanations (SCEs), where a model explains its…

机器学习 · 计算机科学 2025-09-12 Harry Mayne , Ryan Othniel Kearns , Yushi Yang , Andrew M. Bean , Eoin Delaney , Chris Russell , Adam Mahdi

Natural language explanations of deep neural network decisions provide an intuitive way for a AI agent to articulate a reasoning process. Current textual explanations learn to discuss class discriminative features in an image. However, it…

计算机视觉与模式识别 · 计算机科学 2018-06-27 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata