English
Related papers

Related papers: Estimating and evaluating counterfactual predictio…

200 papers

Counterfactual explanations are one of the most popular methods to make predictions of black box machine learning models interpretable by providing explanations in the form of `what-if scenarios'. Most current approaches optimize a…

Machine Learning · Statistics 2020-10-16 Susanne Dandl , Christoph Molnar , Martin Binder , Bernd Bischl

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

Present language understanding methods have demonstrated extraordinary ability of recognizing patterns in texts via machine learning. However, existing methods indiscriminately use the recognized patterns in the testing phase that is…

Computation and Language · Computer Science 2021-06-08 Fuli Feng , Jizhi Zhang , Xiangnan He , Hanwang Zhang , Tat-Seng Chua

Consider sensitivity analysis to assess the worst-case possible values of counterfactual outcome means and average treatment effects under sequential unmeasured confounding in a longitudinal study with time-varying treatments and…

Statistics Theory · Mathematics 2023-08-31 Zhiqiang Tan

Prediction models developed before the introduction of a new treatment may be used to estimate treatment effects of newly introduced treatments. One approach, known as model-based clinical evaluation in radiotherapy, does this by comparing…

Counterfactual prediction is a fundamental task in decision-making. G-computation is a method for estimating expected counterfactual outcomes under dynamic time-varying treatment strategies. Existing G-computation implementations have…

Machine Learning · Computer Science 2020-03-25 Rui Li , Zach Shahn , Jun Li , Mingyu Lu , Prithwish Chakraborty , Daby Sow , Mohamed Ghalwash , Li-wei H. Lehman

Counterfactual inference is a useful tool for comparing outcomes of interventions on complex systems. It requires us to represent the system in form of a structural causal model, complete with a causal diagram, probabilistic assumptions on…

When considering many survival models, decisions become more challenging in health economic evaluation. In this paper, we present a set of methods to assist with selecting the most appropriate parametric survival models. The methods…

Methodology · Statistics 2025-10-22 Ben Lee

The predominant method for evaluating the quality of causal models is to measure the graphical accuracy of the learned model structure. We present an alternative method for evaluating causal models that directly measures the accuracy of…

Artificial Intelligence · Computer Science 2016-08-17 Dan Garant , David Jensen

Suppose data are fitted to some parametric model but that the true model happens to be one with an additional parameter. When a parameter is to be estimated one can use likelihood estimation in the wider model or in the narrow model.…

Methodology · Statistics 2026-03-27 Nils Lid Hjort

We develop a general framework for the identification of counterfactual parameters in a class of nonlinear semiparametric panel models with fixed effects and time effects. Our method applies to models for discrete outcomes (e.g., two-way…

Econometrics · Economics 2023-11-07 Irene Botosaru , Chris Muris

As the frontiers of applied statistics progress through increasingly complex experiments we must exploit increasingly sophisticated inferential models to analyze the observations we make. In order to avoid misleading or outright erroneous…

Methodology · Statistics 2018-03-23 Michael Betancourt

Statistical methods are based on model assumptions, and it is statistical folklore that a method's model assumptions should be checked before applying it. This can be formally done by running one or more misspecification tests of model…

Methodology · Statistics 2023-04-18 M. Iqbal Shamsudheen , Christian Hennig

Prediction models are used amongst others to inform medical decisions on interventions. Typically, individuals with high risks of adverse outcomes are advised to undergo an intervention while those at low risk are advised to refrain from…

Recent work on language model self-improvement shows that models can refine their own reasoning through reflection, verification, debate, or self-generated rewards. However, most existing approaches rely on external critics, learned reward…

Artificial Intelligence · Computer Science 2026-01-06 Mandar Parab

Deep learning models in medical imaging often fail when deployed in new clinical environments due to distribution shifts in demographics, scanner hardware, or acquisition protocols. A central challenge is underspecification, where models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Moritz Stammel , Fabio De Sousa Ribeiro , Raghav Mehta , Mélanie Roschewitz , Ben Glocker

Counterfactual fairness alleviates the discrimination between the model prediction toward an individual in the actual world (observational data) and that in counterfactual world (i.e., what if the individual belongs to other sensitive…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu

Counterfactual statements, which describe events that did not or cannot take place, are beneficial to numerous NLP applications. Hence, we consider the problem of counterfactual detection (CFD) and seek to enhance the CFD models. Previous…

Computation and Language · Computer Science 2024-10-01 Thong Nguyen , Truc-My Nguyen

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

In model extraction attacks, the goal is to reveal the parameters of a black-box machine learning model by querying the model for a selected set of data points. Due to an increasing demand for explanations, this may involve counterfactual…

Optimization and Control · Mathematics 2026-03-04 Daan Otto , Jannis Kurtz , Dick den Hertog , Ilker Birbil