English
Related papers

Related papers: Generative causal explanations of black-box classi…

200 papers

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

When users can benefit from certain predictive outcomes, they may be prone to act to achieve those outcome, e.g., by strategically modifying their features. The goal in strategic classification is therefore to train predictive models that…

Machine Learning · Computer Science 2023-06-12 Guy Horowitz , Nir Rosenfeld

Explaining decisions of black-box classifiers is paramount in sensitive domains such as medical imaging since clinicians confidence is necessary for adoption. Various explanation approaches have been proposed, among which perturbation based…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Martin Charachon , Céline Hudelot , Paul-Henry Cournède , Camille Ruppli , Roberto Ardon

Large proprietary language models exhibit strong causal reasoning abilities that smaller open-source models struggle to replicate. We introduce a novel framework for distilling causal explanations that transfers causal reasoning skills from…

Computation and Language · Computer Science 2025-05-27 Aggrey Muhebwa , Khalid K. Osman

We pose causal inference as the problem of learning to classify probability distributions. In particular, we assume access to a collection $\{(S_i,l_i)\}_{i=1}^n$, where each $S_i$ is a sample drawn from the probability distribution of $X_i…

Machine Learning · Statistics 2015-05-20 David Lopez-Paz , Krikamol Muandet , Bernhard Schölkopf , Ilya Tolstikhin

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

Machine Learning · Computer Science 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Faithful evaluation of language model capabilities is crucial for deriving actionable insights that can inform model development. However, rigorous causal evaluations in this domain face significant methodological challenges, including…

Machine Learning · Computer Science 2025-06-13 Jikai Jin , Vasilis Syrgkanis , Sham Kakade , Hanlin Zhang

To understand the black-box characteristics of deep networks, counterfactual explanation that deduces not only the important features of an input space but also how those features should be modified to classify input as a target class has…

Machine Learning · Computer Science 2022-08-15 Hong-Gyu Jung , Sin-Han Kang , Hee-Dong Kim , Dong-Ok Won , Seong-Whan Lee

While LLMs exhibit impressive fluency and factual recall, they struggle with robust causal reasoning, often relying on spurious correlations and brittle patterns. Similarly, traditional Reinforcement Learning agents also lack causal…

Machine Learning · Computer Science 2025-09-26 Abi Aryan , Zac Liu

Existing algorithms for explaining the outputs of image classifiers are based on a variety of approaches and produce explanations that frequently lack formal rigour. On the other hand, logic-based explanations are formally and rigorously…

Artificial Intelligence · Computer Science 2026-02-20 David A Kelly , Hana Chockler

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Learning how to model complex scenes in a modular way with recombinable components is a pre-requisite for higher-order reasoning and acting in the physical world. However, current generative models lack the ability to capture the inherently…

Machine Learning · Statistics 2020-04-28 Julius von Kügelgen , Ivan Ustyuzhaninov , Peter Gehler , Matthias Bethge , Bernhard Schölkopf

The use of a hypothetical generative model was been suggested for causal analysis of observational data. The very assumption of a particular model is a commitment to a certain set of variables and therefore to a certain set of possible…

Artificial Intelligence · Computer Science 2023-06-09 Nimrod Megiddo

Interpreting the inner function of neural networks is crucial for the trustworthy development and deployment of these black-box models. Prior interpretability methods focus on correlation-based measures to attribute model decisions to…

Machine Learning · Computer Science 2023-06-21 Ola Ahmad , Nicolas Bereux , Loïc Baret , Vahid Hashemi , Freddy Lecue

Learning models of user behaviour is an important problem that is broadly applicable across many application domains requiring human-robot interaction. In this work we show that it is possible to learn a generative model for distinct user…

Artificial Intelligence · Computer Science 2019-06-25 Daniel Angelov , Yordan Hristov , Subramanian Ramamoorthy

Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a…

Machine Learning · Computer Science 2019-12-09 Ramaravind Kommiya Mothilal , Amit Sharma , Chenhao Tan

Generative classifiers, which leverage conditional generative models for classification, have recently demonstrated desirable properties such as robustness to distribution shifts. However, recent progress in this area has been largely…

Machine Learning · Computer Science 2026-03-24 Yi-Chung Chen , David I. Inouye , Jing Gao

Understanding the behavior of learned classifiers is an important task, and various black-box explanations, logical reasoning approaches, and model-specific methods have been proposed. In this paper, we introduce probabilistic sufficient…

Machine Learning · Computer Science 2021-05-24 Eric Wang , Pasha Khosravi , Guy Van den Broeck

Synthesis of digital artifacts conditioned on user prompts has become an important paradigm facilitating an explosion of use cases with generative AI. However, such models often fail to connect the generated outputs and desired target…

Machine Learning · Computer Science 2026-04-15 Melvin Wong , Yew-Soon Ong , Abhishek Gupta , Kavitesh K. Bali , Caishun Chen

Deep neural networks and other intricate Artificial Intelligence (AI) models have reached high levels of accuracy on many biomedical natural language processing tasks. However, their applicability in real-world use cases may be limited due…

Artificial Intelligence · Computer Science 2020-10-22 Milad Moradi , Matthias Samwald