English
Related papers

Related papers: Generative causal explanations of black-box classi…

200 papers

The era of big data has witnessed an increasing availability of observational data from mobile and social networking, online advertising, web mining, healthcare, education, public policy, marketing campaigns, and so on, which facilitates…

Machine Learning · Computer Science 2023-03-06 Zhixuan Chu , Ruopeng Li , Stephen Rathbun , Sheng Li

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

Causal inference is often portrayed as fundamentally distinct from predictive modeling, with its own terminology, goals, and intellectual challenges. But at its core, causal inference is simply a structured instance of prediction under…

Machine Learning · Computer Science 2025-07-10 Carlos Fernández-Loría

We present an approach for generating clarification questions with the goal of eliciting new information that would make the given textual context more complete. We propose that modeling hypothetical answers (to clarification questions) as…

Computation and Language · Computer Science 2019-04-05 Sudha Rao , Hal Daumé

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ruth Fong , Andrea Vedaldi

Learning a parametric model from a given dataset indeed enables to capture intrinsic dependencies between random variables via a parametric conditional probability distribution and in turn predict the value of a label variable given…

Machine Learning · Statistics 2024-06-14 Elouan Argouarc'h , François Desbouvries , Eric Barat , Eiji Kawasaki

We propose a generative, end-to-end solver for black-box combinatorial optimization that emphasizes both sample efficiency and solution quality on NP problems. Drawing inspiration from annealing-based algorithms, we treat the black-box…

Machine Learning · Computer Science 2025-08-07 Yuan-Hang Zhang , Massimiliano Di Ventra

Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing…

Machine Learning · Computer Science 2021-09-29 Philip Naumann , Eirini Ntoutsi

Deep learning has revolutionized the field of artificial intelligence. Based on the statistical correlations uncovered by deep learning-based methods, computer vision has contributed to tremendous growth in areas like autonomous driving and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Kexuan Zhang , Qiyu Sun , Chaoqiang Zhao , Yang Tang

Interpretable machine learning seeks to understand the reasoning process of complex black-box systems that are long notorious for lack of explainability. One flourishing approach is through counterfactual explanations, which provide…

Artificial Intelligence · Computer Science 2023-06-02 Vy Vo , Trung Le , Van Nguyen , He Zhao , Edwin Bonilla , Gholamreza Haffari , Dinh Phung

Causal abstraction provides a theoretical foundation for mechanistic interpretability, the field concerned with providing intelligible algorithms that are faithful simplifications of the known, but opaque low-level details of black box AI…

With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts to account for the major variation in prediction. Yet,…

Machine Learning · Computer Science 2023-09-12 Wenbo Zhang , Tong Wu , Yunlong Wang , Yong Cai , Hengrui Cai

Drawing causal conclusions from observational data requires making assumptions about the true data-generating process. Causal inference research typically considers low-dimensional data, such as categorical or numerical fields in structured…

Computation and Language · Computer Science 2021-02-11 Zach Wood-Doughty , Ilya Shpitser , Mark Dredze

Classification is a well-studied machine learning task which concerns the assignment of instances to a set of outcomes. Classification models support the optimization of managerial decision-making across a variety of operational business…

Machine Learning · Computer Science 2025-05-19 Wouter Verbeke , Diego Olaya , Jeroen Berrevoets , Sam Verboven , Sebastián Maldonado

We present a novel task that measures how people generalize objects' causal powers based on observing a single (Experiment 1) or a few (Experiment 2) causal interactions between object pairs. We propose a computational modeling framework…

Artificial Intelligence · Computer Science 2021-11-25 Bonan Zhao , Christopher G. Lucas , Neil R. Bramley

This work presents a conceptual framework for causal concept-based post-hoc Explainable Artificial Intelligence (XAI), based on the requirements that explanations for non-interpretable models should be understandable as well as faithful to…

Artificial Intelligence · Computer Science 2025-12-03 Anna Rodum Bjøru , Jacob Lysnæs-Larsen , Oskar Jørgensen , Inga Strümke , Helge Langseth

The study of causal abstractions bridges two integral components of human intelligence: the ability to determine cause and effect, and the ability to interpret complex patterns into abstract concepts. Formally, causal abstraction frameworks…

Machine Learning · Computer Science 2025-09-29 Kevin Xia , Elias Bareinboim

The imminent need to interpret the output of a Machine Learning model with counterfactual (CF) explanations - via small perturbations to the input - has been notable in the research community. Although the variety of CF examples is…

Machine Learning · Computer Science 2024-04-23 Kleopatra Markou , Dimitrios Tomaras , Vana Kalogeraki , Dimitrios Gunopulos

When an image classifier makes a prediction, which parts of the image are relevant and why? We can rephrase this question to ask: which parts of the image, if they were not seen by the classifier, would most change its decision? Producing…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Chun-Hao Chang , Elliot Creager , Anna Goldenberg , David Duvenaud

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

Machine Learning · Computer Science 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva