English
Related papers

Related papers: Estimating and evaluating counterfactual predictio…

200 papers

We develop a spectral approach for identifying and estimating average counterfactual outcomes under a low-rank factor model with short panel data and general outcome missingness patterns. Applications include event studies and studies of…

Econometrics · Economics 2025-12-30 Lihua Lei , Brad Ross

While machine learning models are usually assumed to always output a prediction, there also exist extensions in the form of reject options which allow the model to reject inputs where only a prediction with an unacceptably low certainty…

Machine Learning · Computer Science 2022-02-16 André Artelt , Johannes Brinkrolf , Roel Visser , Barbara Hammer

Estimating counterfactual outcomes over time from observational data is relevant for many applications (e.g., personalized medicine). Yet, state-of-the-art methods build upon simple long short-term memory (LSTM) networks, thus rendering…

Machine Learning · Computer Science 2022-06-06 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Counterfactual reasoning, a cornerstone of human cognition and decision-making, is often seen as the 'holy grail' of causal learning, with applications ranging from interpreting machine learning models to promoting algorithmic fairness.…

Machine Learning · Computer Science 2025-04-11 Yahya Aalaila , Gerrit Großmann , Sumantrak Mukherjee , Jonas Wahl , Sebastian Vollmer

We predict credit applications with off-the-shelf, interchangeable black-box classifiers and we explain single predictions with counterfactual explanations. Counterfactual explanations expose the minimal changes required on the input data…

Artificial Intelligence · Computer Science 2018-11-19 Rory Mc Grath , Luca Costabello , Chan Le Van , Paul Sweeney , Farbod Kamiab , Zhao Shen , Freddy Lecue

In high-stake domains such as healthcare and hiring, the role of machine learning (ML) in decision-making raises significant fairness concerns. This work focuses on Counterfactual Fairness (CF), which posits that an ML model's outcome on…

Machine Learning · Computer Science 2025-01-23 Zeyu Zhou , Tianci Liu , Ruqi Bai , Jing Gao , Murat Kocaoglu , David I. Inouye

Counterfactual explanations are usually obtained by identifying the smallest change made to an input to change a prediction made by a fixed model (hereafter called sparse methods). Recent work, however, has revitalized an old insight: there…

Machine Learning · Computer Science 2020-06-24 Martin Pawelczyk , Klaus Broelemann , Gjergji Kasneci

Machine learning models $-$ now commonly developed to screen, diagnose, or predict health conditions $-$ are evaluated with a variety of performance metrics. An important first step in assessing the practical utility of a model is to…

Machine Learning · Statistics 2021-04-27 Andrew C. Miller , Leon A. Gatys , Joseph Futoma , Emily B. Fox

We give a finite-sample analysis of predictive inference procedures after model selection in regression with random design. The analysis is focused on a statistically challenging scenario where the number of potentially important…

Statistics Theory · Mathematics 2009-08-26 Hannes Leeb

LLMs can be unpredictable, as even slight alterations to the prompt can cause the output to change in unexpected ways. Thus, the ability of models to accurately explain their behavior is critical, especially in high-stakes settings. One…

Computation and Language · Computer Science 2025-11-26 Marvin Limpijankit , Yanda Chen , Melanie Subbiah , Nicholas Deas , Kathleen McKeown

When a model attribution technique highlights a particular part of the input, a user might understand this highlight as making a statement about counterfactuals (Miller, 2019): if that part of the input were to change, the model's…

Computation and Language · Computer Science 2021-09-15 Xi Ye , Rohan Nair , Greg Durrett

Efficient methods to evaluate new algorithms are critical for improving interactive bandit and reinforcement learning systems such as recommendation systems. A/B tests are reliable, but are time- and money-consuming, and entail a risk of…

Machine Learning · Computer Science 2021-08-04 Yusuke Narita , Shota Yasui , Kohei Yata

Counterfactual thinking is a crucial yet challenging topic for artificial intelligence to learn knowledge from data and ultimately improve performance for new scenarios. Many research works, including the Potential Outcome Model (POM) and…

Artificial Intelligence · Computer Science 2026-02-24 Mingyu Kang , Duxin Chen , Ziyuan Pu , Jianxi Gao , Wenwu Yu

Learning-based approaches, such as reinforcement and imitation learning are gaining popularity in decision-making for autonomous driving. However, learned policies often fail to generalize and cannot handle novel situations well. Asking and…

Machine Learning · Computer Science 2020-11-13 Patrick Hart , Alois Knoll

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

The impact of machine learning models on healthcare will depend on the degree of trust that healthcare professionals place in the predictions made by these models. In this paper, we present a method to provide people with clinical expertise…

Machine Learning · Computer Science 2021-03-05 Aniruddh Raghu , John Guttag , Katherine Young , Eugene Pomerantsev , Adrian V. Dalca , Collin M. Stultz

Prediction credibility measures, in the form of confidence intervals or probability distributions, are fundamental in statistics and machine learning to characterize model robustness, detect out-of-distribution samples (outliers), and…

Machine Learning · Computer Science 2020-11-26 Luiz F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

Estimating counterfactual distributions under interventions is central to treatment risk assessment and counterfactual generation tasks. Existing approaches model the counterfactual distribution as a standalone generative target, without…

Machine Learning · Statistics 2026-05-11 Hugh Dance , Johnny Xi , Peter Orbanz , Benjamin Bloem-Reddy

Due to lack of scientific understanding, some mechanisms may be missing in mathematical modeling of complex phenomena in science and engineering. These mathematical models thus contain some uncertainties such as uncertain parameters. One…

Probability · Mathematics 2012-04-05 Jinqiao Duan , Ting Gao , Guowei He

With the increasing impact of algorithmic decision-making on human lives, the interpretability of models has become a critical issue in machine learning. Counterfactual explanation is an important method in the field of interpretable…

Machine Learning · Computer Science 2024-07-17 Ao Xu , Tieru Wu