中文
相关论文

相关论文: Does It Make Sense to Explain a Black Box With Ano…

200 篇论文

NLP researchers propose different word-substitute black-box attacks that can fool text classification models. In such attack, an adversary keeps sending crafted adversarial queries to the target model until it can successfully achieve the…

计算与语言 · 计算机科学 2022-06-13 Tianle Li , Yi Yang

Counterfactual reasoning has emerged as a crucial technique for generalizing the reasoning capabilities of large language models (LLMs). By generating and analyzing counterfactual scenarios, researchers can assess the adaptability and…

人工智能 · 计算机科学 2026-02-17 Shuai Yang , Qi Yang , Luoxi Tang , Yuqiao Meng , Nancy Guo , Jeremy Blackburn , Zhaohan Xi

Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-called counterfactual…

Model interpretability has become an important problem in machine learning (ML) due to the increased effect that algorithmic decisions have on humans. Counterfactual explanations can help users understand not only why ML models make certain…

机器学习 · 计算机科学 2021-12-20 Ana Lucic , Harrie Oosterhuis , Hinda Haned , Maarten de Rijke

Counterfactual explanations shed light on the decisions of black-box models by explaining how an input can be altered to obtain a favourable decision from the model (e.g., when a loan application has been rejected). However, as noted…

机器学习 · 计算机科学 2023-12-13 Francesco Leofante , Nico Potyka

While reinforcement learning (RL) algorithms have been successfully applied to numerous tasks, their reliance on neural networks makes their behavior difficult to understand and trust. Counterfactual explanations are human-friendly…

人工智能 · 计算机科学 2023-10-11 Jasmina Gajcin , Ivana Dusparic

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

机器学习 · 计算机科学 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent

Deep Reinforcement Learning (DRL) has demonstrated promising capability in solving complex control problems. However, DRL applications in safety-critical systems are hindered by the inherent lack of robust verification techniques to assure…

机器学习 · 计算机科学 2023-10-10 Amir Samadi , Konstantinos Koufos , Kurt Debattista , Mehrdad Dianati

Explanations of neural models aim to reveal a model's decision-making process for its predictions. However, recent work shows that current methods giving explanations such as saliency maps or counterfactuals can be misleading, as they are…

Explanations are an important tool for gaining insights into the behavior of ML models, calibrating user trust and ensuring regulatory compliance. Past few years have seen a flurry of post-hoc methods for generating model explanations, many…

计算与语言 · 计算机科学 2025-09-24 Zahra Dehghanighobadi , Asja Fischer , Muhammad Bilal Zafar

The complexity of state-of-the-art modeling techniques for image classification impedes the ability to explain model predictions in an interpretable way. Existing explanation methods generally create importance rankings in terms of pixels…

机器学习 · 计算机科学 2020-04-17 Tom Vermeire , David Martens

Feature attributions and counterfactual explanations are popular approaches to explain a ML model. The former assigns an importance score to each input feature, while the latter provides input examples with minimal changes to alter the…

机器学习 · 计算机科学 2021-06-01 Ramaravind Kommiya Mothilal , Divyat Mahajan , Chenhao Tan , Amit Sharma

Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification…

计算与语言 · 计算机科学 2021-09-15 Alon Jacovi , Swabha Swayamdipta , Shauli Ravfogel , Yanai Elazar , Yejin Choi , Yoav Goldberg

Deep Learning is a state-of-the-art technique to make inference on extensive or complex data. As a black box model due to their multilayer nonlinear structure, Deep Neural Networks are often criticized to be non-transparent and their…

人工智能 · 计算机科学 2019-11-28 Vanessa Buhrmester , David Münch , Michael Arens

We study the problem of generating counterfactual text for a classifier as a means for understanding and debugging classification. Given a textual input and a classification model, we aim to minimally alter the text to change the model's…

计算与语言 · 计算机科学 2021-10-25 Quintin Pope , Xiaoli Z. Fern

We can consider Counterfactuals as belonging in the domain of Discourse structure and semantics, A core area in Natural Language Understanding and in this paper, we introduce an approach to resolving counterfactual detection as well as the…

计算与语言 · 计算机科学 2020-05-28 Kelechi Nwaike , Licheng Jiao

While explainability is a desirable characteristic of increasingly complex black-box models, modern explanation methods have been shown to be inconsistent and contradictory. The semantics of explanations is not always fully understood - to…

人工智能 · 计算机科学 2024-08-09 Omer Reingold , Judy Hanwen Shen , Aditi Talati

Modern recommender systems face an increasing need to explain their recommendations. Despite considerable progress in this area, evaluating the quality of explanations remains a significant challenge for researchers and practitioners. Prior…

人工智能 · 计算机科学 2022-11-18 Yuanshun Yao , Chong Wang , Hang Li

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

计算与语言 · 计算机科学 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

Recently, counterfactuals using "if-only" explanations have become very popular in eXplainable AI (XAI), as they describe which changes to feature-inputs of a black-box AI system result in changes to a (usually negative) decision-outcome.…

人工智能 · 计算机科学 2024-06-28 Saugat Aryal , Mark T. Keane