English
Related papers

Related papers: Estimating and evaluating counterfactual predictio…

200 papers

When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by…

Probability · Mathematics 2016-07-01 Hermann G. Matthies , Elmar Zander , Bojana Rosic , Alexander Litvinenko

The counterfactual distribution models the effect of the treatment in the untreated group. While most of the work focuses on the expected values of the treatment effect, one may be interested in the whole counterfactual distribution or…

Machine Learning · Statistics 2022-11-04 Diego Martinez-Taboada , Dino Sejdinovic

Counterfactual explanations provide ways of achieving a favorable model outcome with minimum input perturbation. However, counterfactual explanations can also be leveraged to reconstruct the model by strategically training a surrogate model…

Machine Learning · Computer Science 2024-11-13 Pasan Dissanayake , Sanghamitra Dutta

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

Treatment effects can be estimated from observational data as the difference in potential outcomes. In this paper, we address the challenge of estimating the potential outcome when treatment-dose levels can vary continuously over time.…

Machine Learning · Statistics 2017-11-07 Hossein Soleimani , Adarsh Subbaswamy , Suchi Saria

In this paper we study the problem of making predictions using multiple structural casual models defined by different agents, under the constraint that the prediction satisfies the criterion of counterfactual fairness. Relying on the…

Artificial Intelligence · Computer Science 2021-05-25 Fabio Massimo Zennaro , Magdalena Ivanovska

In this paper, we address the challenge of performing counterfactual inference with observational data via Bayesian nonparametric regression adjustment, with a focus on high-dimensional settings featuring multiple actions and multiple…

Machine Learning · Computer Science 2022-11-22 Alberto Caron , Gianluca Baio , Ioanna Manolopoulou

Counterfactual examples are one of the most commonly-cited methods for explaining the predictions of machine learning models in key areas such as finance and medical diagnosis. Counterfactuals are often discussed under the assumption that…

Machine Learning · Computer Science 2021-10-08 Emily Black , Zifan Wang , Matt Fredrikson , Anupam Datta

Recommender systems exemplify sequential decision-making under uncertainty, strategically deciding what content to serve to users, to optimise a range of potential objectives. To balance the explore-exploit trade-off successfully, Thompson…

Information Retrieval · Computer Science 2025-07-09 Olivier Jeunen

We provide an optimization-based framework to perform counterfactual analysis in a dynamic model with hidden states. Our framework is grounded in the ``abduction, action, and prediction'' approach to answer counterfactual queries and…

Machine Learning · Computer Science 2023-05-09 Martin Haugh , Raghav Singal

Counterfactual explanations are viewed as an effective way to explain machine learning predictions. This interest is reflected by a relatively young literature with already dozens of algorithms aiming to generate such explanations. These…

Machine Learning · Computer Science 2022-12-05 Raphael Mazzine , David Martens

Explainability is widely regarded as essential for trustworthy artificial intelligence systems. However, the metrics commonly used to evaluate counterfactual explanations are algorithmic evaluation metrics that are rarely validated against…

Artificial Intelligence · Computer Science 2026-03-17 Felix Liedeker , Basil Ell , Philipp Cimiano , Christoph Düsing

We consider estimation under model misspecification where there is a model mismatch between the underlying system, which generates the data, and the model used during estimation. We propose a model misspecification framework which enables a…

Signal Processing · Electrical Eng. & Systems 2023-02-22 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

We address counterfactual analysis in empirical models of games with partially identified parameters, and multiple equilibria and/or randomized strategies, by constructing and analyzing the counterfactual predictive distribution set (CPDS).…

Econometrics · Economics 2024-10-17 Brendan Kline , Elie Tamer

Process mining is widely used to diagnose processes and uncover performance and compliance problems. It is also possible to see relations between different behavioral aspects, e.g., cases that deviate more at the beginning of the process…

Artificial Intelligence · Computer Science 2021-12-23 Mahnaz Sadat Qafari , Wil van der Aalst

We consider methods for transporting a prediction model and assessing its performance for use in a new target population, when outcome and covariate information for model development is available from a simple random sample from the source…

Applications · Statistics 2021-04-15 Jon A. Steingrimsson , Constantine Gatsonis , Issa J. Dahabreh

Modern recommender systems face an increasing need to explain their recommendations. Despite considerable progress in this area, evaluating the quality of explanations remains a significant challenge for researchers and practitioners. Prior…

Artificial Intelligence · Computer Science 2022-11-18 Yuanshun Yao , Chong Wang , Hang Li

Counterfactual analysis is intuitively performed by humans on a daily basis eg. "What should I have done differently to get the loan approved?". Such counterfactual questions also steer the formulation of scientific hypotheses. More…

Machine Learning · Computer Science 2023-09-18 Juliane Weilbach , Sebastian Gerwinn , Melih Kandemir , Martin Fraenzle

We consider the problem of model building for rare events prediction in longitudinal follow-up studies. In this paper, we compare several resampling methods to improve standard regression models on a real life example. We evaluate the…

Methodology · Statistics 2023-06-21 Pierre Druilhet , Mathieu Berthe , Stéphanie Léger