English
Related papers

Related papers: Counterfactual Inference under Thompson Sampling

200 papers

Counterfactual explanations utilize feature perturbations to analyze the outcome of an original decision and recommend an actionable recourse. We argue that it is beneficial to provide several alternative explanations rather than a single…

Machine Learning · Computer Science 2023-01-24 Natraj Raman , Daniele Magazzeni , Sameena Shah

We bound features of counterfactual choices in the nonparametric random utility model of demand, i.e. if observable choices are repeated cross-sections and one allows for unrestricted, unobserved heterogeneity. In this setting, tight bounds…

Econometrics · Economics 2019-05-21 Yuichi Kitamura , Jörg Stoye

Counterfactual reasoning allows us to explore hypothetical scenarios in order to explain the impacts of our decisions. However, addressing such inquires is impossible without establishing the appropriate mathematical framework. In this…

Machine Learning · Computer Science 2025-06-25 Kurt Butler , Marija Iloska , Petar M. Djuric

Machine-learning models are increasingly driving decisions in high-stakes settings, such as finance, law, and hiring, thus, highlighting the need for transparency. However, the key challenge is to balance transparency -- clarifying `why' a…

Artificial Intelligence · Computer Science 2025-08-29 Sopam Dasgupta , Sadaf MD Halim , Joaquín Arias , Elmer Salazar , Gopal Gupta

This paper proposes a method for estimating consumer preferences among discrete choices, where the consumer chooses at most one product in a category, but selects from multiple categories in parallel. The consumer's utility is additive in…

Machine Learning · Computer Science 2023-08-08 Rob Donnelly , Francisco R. Ruiz , David Blei , Susan Athey

Efficient methods to evaluate new algorithms are critical for improving interactive bandit and reinforcement learning systems such as recommendation systems. A/B tests are reliable, but are time- and money-consuming, and entail a risk of…

Machine Learning · Computer Science 2021-08-04 Yusuke Narita , Shota Yasui , Kohei Yata

A critical need for industrial recommender systems is the ability to evaluate recommendation policies offline, before deploying them to production. Unfortunately, widely used off-policy evaluation methods either make strong assumptions…

Machine Learning · Computer Science 2022-10-19 Alexander Buchholz , Ben London , Giuseppe di Benedetto , Thorsten Joachims

This paper introduces a simple framework of counterfactual estimation for causal inference with time-series cross-sectional data, in which we estimate the average treatment effect on the treated by directly imputing counterfactual outcomes…

Methodology · Statistics 2022-08-16 Licheng Liu , Ye Wang , Yiqing Xu

Despite their enormous predictive power, machine learning models are often unsuitable for applications in regulated industries such as finance, due to their limited capacity to provide explanations. While model-agnostic frameworks such as…

Machine Learning · Statistics 2025-11-03 Joshua S. Harvey , Guanchao Feng , Sai Anusha Meesala , Tina Zhao , Dhagash Mehta

While methods for measuring and correcting differential performance in risk prediction models have proliferated in recent years, most existing techniques can only be used to assess fairness across relatively large subgroups. The purpose of…

Methodology · Statistics 2024-01-30 Solvejg Wastvedt , Jared D Huling , Julian Wolfson

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

Online platforms regularly conduct randomized experiments to understand how changes to the platform causally affect various outcomes of interest. However, experimentation on online platforms has been criticized for having, among other…

Machine Learning · Computer Science 2022-05-12 Smitha Milli , Luca Belli , Moritz Hardt

Counterfactual frameworks have grown popular in machine learning for both explaining algorithmic decisions but also defining individual notions of fairness, more intuitive than typical group fairness conditions. However, state-of-the-art…

Artificial Intelligence · Computer Science 2023-01-09 Lucas de Lara , Alberto González-Sanz , Nicholas Asher , Laurent Risser , Jean-Michel Loubes

Causal confusion is a phenomenon where an agent learns a policy that reflects imperfect spurious correlations in the data. Such a policy may falsely appear to be optimal during training if most of the training data contain such spurious…

Machine Learning · Computer Science 2023-12-29 Gunshi Gupta , Tim G. J. Rudner , Rowan Thomas McAllister , Adrien Gaidon , Yarin Gal

This work explores the idea of a causal contextual multi-armed bandit approach to automated marketing, where we estimate and optimize the causal (incremental) effects. Focusing on causal effect leads to better return on investment (ROI) by…

Machine Learning · Computer Science 2018-10-05 Neela Sawant , Chitti Babu Namballa , Narayanan Sadagopan , Houssam Nassif

Thompson Sampling provides an efficient technique to introduce prior knowledge in the multi-armed bandit problem, along with providing remarkable empirical performance. In this paper, we revisit the Thompson Sampling algorithm under rewards…

Machine Learning · Computer Science 2019-12-09 Abhimanyu Dubey , Alex Pentland

Due to the increasing use of machine learning in practice it becomes more and more important to be able to explain the prediction and behavior of machine learning models. An instance of explanations are counterfactual explanations which…

Machine Learning · Computer Science 2019-11-19 André Artelt , Barbara Hammer

We introduce an approach to counterfactual inference based on merging information from multiple datasets. We consider a causal reformulation of the statistical marginal problem: given a collection of marginal structural causal models (SCMs)…

Artificial Intelligence · Computer Science 2022-07-18 Luigi Gresele , Julius von Kügelgen , Jonas M. Kübler , Elke Kirschbaum , Bernhard Schölkopf , Dominik Janzing

The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual…

Machine Learning · Statistics 2025-04-22 Qiyu Han , Will Wei Sun , Yichen Zhang

To act safely and ethically in the real world, agents must be able to reason about harm and avoid harmful actions. However, to date there is no statistical method for measuring harm and factoring it into algorithmic decisions. In this paper…

Artificial Intelligence · Computer Science 2022-11-03 Jonathan G. Richens , Rory Beard , Daniel H. Thompson