English
Related papers

Related papers: Assessing model error in counterfactual worlds

200 papers

Time series forecasting has become increasingly critical in real-world scenarios, where future sequences are influenced not only by historical patterns but also by forthcoming events. In this context, forecasting must dynamically adapt to…

Machine Learning · Computer Science 2026-05-15 Shuqi Gu , Yongxiang Zhao , Baoyu Jing , Kan Ren

Inverse problems use physical measurements along with a computational model to estimate the parameters or state of a system of interest. Errors in measurements and uncertainties in the computational model lead to inaccurate estimates. This…

Numerical Analysis · Mathematics 2015-02-02 Vishwas Rao , Adrian Sandu

Conformal prediction and scenario optimization constitute two important classes of statistical learning frameworks to certify decisions made using data. They have found numerous applications in control theory, machine learning and robotics.…

Machine Learning · Computer Science 2025-04-03 Niall O'Sullivan , Licio Romao , Kostas Margellos

Algorithmic risk assessments are increasingly used to help humans make decisions in high-stakes settings, such as medicine, criminal justice and education. In each of these cases, the purpose of the risk assessment tool is to inform…

Machine Learning · Statistics 2020-01-13 Amanda Coston , Alan Mishler , Edward H. Kennedy , Alexandra Chouldechova

Counterfactual reasoning from logged data has become increasingly important for many applications such as web advertising or healthcare. In this paper, we address the problem of learning stochastic policies with continuous actions from the…

Machine Learning · Statistics 2025-02-24 Houssam Zenati , Alberto Bietti , Matthieu Martin , Eustache Diemert , Pierre Gaillard , Julien Mairal

The goal of causal inference is to understand the outcome of alternative courses of action. However, all causal inference requires assumptions. Such assumptions can be more influential than in typical tasks for probabilistic modeling, and…

Methodology · Statistics 2016-10-31 Dustin Tran , Francisco J. R. Ruiz , Susan Athey , David M. Blei

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

An agent with an inaccurate model of its environment faces a difficult choice: it can ignore the errors in its model and act in the real world in whatever way it determines is optimal with respect to its model. Alternatively, it can take a…

Variational inequalities are modelling tools used to capture a variety of decision-making problems arising in mathematical optimization, operations research, game theory. The scenario approach is a set of techniques developed to tackle…

Optimization and Control · Mathematics 2020-03-17 Dario Paccagnan , Marco C. Campi

The deviation test belong to core tools in point process statistics, where hypotheses are typically tested considering differences between an empirical summary function and its expectation under the null hypothesis, which depend on a…

Methodology · Statistics 2015-03-13 Mari Myllymäki , Pavel Grabarnik , Henri Seijo , Dietrich Stoyan

Counterfactual inference is a powerful tool, capable of solving challenging problems in high-profile sectors. To perform counterfactual inference, one requires knowledge of the underlying causal mechanisms. However, causal mechanisms cannot…

Machine Learning · Computer Science 2023-01-23 Athanasios Vlontzos , Bernhard Kainz , Ciaran M. Gilligan-Lee

Machine learning models always make a prediction, even when it is likely to be inaccurate. This behavior should be avoided in many decision support applications, where mistakes can have severe consequences. Albeit already studied in 1970,…

Machine Learning · Computer Science 2024-02-22 Kilian Hendrickx , Lorenzo Perini , Dries Van der Plas , Wannes Meert , Jesse Davis

We propose an approach to estimate how individuals' expectations influence their responses to a counterfactual change. The approach relies on average partial effects, which recover counterfactual impacts under conditions that we specify. We…

Econometrics · Economics 2026-05-21 Stephane Bonhomme , Angela Denis

Counterfactual explanations are viewed as an effective way to explain machine learning predictions. This interest is reflected by a relatively young literature with already dozens of algorithms aiming to generate such explanations. These…

Machine Learning · Computer Science 2022-12-05 Raphael Mazzine , David Martens

The estimation of an f-divergence between two probability distributions based on samples is a fundamental problem in statistics and machine learning. Most works study this problem under very weak assumptions, in which case it is provably…

Machine Learning · Statistics 2019-10-25 Paul K. Rubenstein , Olivier Bousquet , Josip Djolonga , Carlos Riquelme , Ilya Tolstikhin

Model interpretations are often used in practice to extract real world insights from machine learning models. These interpretations have a wide range of applications; they can be presented as business recommendations or used to evaluate…

Machine Learning · Computer Science 2020-11-20 Brian Liu , Madeleine Udell

The large majority of inferences drawn in empirical political research follow from model-based associations (e.g. regression). Here, we articulate the benefits of predictive modeling as a complement to this approach. Predictive models aim…

Methodology · Statistics 2016-12-20 Skyler J. Cranmer , Bruce A. Desmarais

As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions to achieve a…

Machine Learning · Computer Science 2020-10-09 Amir-Hossein Karimi , Bernhard Schölkopf , Isabel Valera

Counterfactual explanations can be obtained by identifying the smallest change made to a feature vector to qualitatively influence a prediction; for example, from 'loan rejected' to 'awarded' or from 'high risk of cardiovascular disease' to…

Machine Learning · Computer Science 2020-05-05 Martin Pawelczyk , Johannes Haug , Klaus Broelemann , Gjergji Kasneci