English
Related papers

Related papers: Additive Causal Bandits with Unknown Graph

200 papers

We study the problem of determining the best intervention in a Causal Bayesian Network (CBN) specified only by its causal graph. We model this as a stochastic multi-armed bandit (MAB) problem with side-information, where the interventions…

Machine Learning · Computer Science 2022-05-20 Aurghya Maiti , Vineet Nair , Gaurav Sinha

In this work, we investigate the problem of adapting to the presence or absence of causal structure in multi-armed bandit problems. In addition to the usual reward signal, we assume the learner has access to additional variables, observed…

Machine Learning · Computer Science 2024-07-02 Ziyi Liu , Idan Attias , Daniel M. Roy

This paper studies the problem of designing an optimal sequence of interventions in a causal graphical model to minimize cumulative regret with respect to the best intervention in hindsight. This is, naturally, posed as a causal bandit…

Machine Learning · Statistics 2023-04-04 Burak Varici , Karthikeyan Shanmugam , Prasanna Sattigeri , Ali Tajer

We study a graph bandit setting where the objective of the learner is to detect the most influential node of a graph by requesting as little information from the graph as possible. One of the relevant applications for this setting is…

Machine Learning · Computer Science 2026-05-04 Alexandra Carpentier , Michal Valko

We study the causal bandit problem that entails identifying a near-optimal intervention from a specified set $A$ of (possibly non-atomic) interventions over a given causal graph. Here, an optimal intervention in ${A}$ is one that maximizes…

Machine Learning · Computer Science 2023-05-09 Ayush Sawarni , Rahul Madhavan , Gaurav Sinha , Siddharth Barman

We study the problem of learning the causal relationships between a set of observed variables in the presence of latents, while minimizing the cost of interventions on the observed variables. We assume access to an undirected graph $G$ on…

Data Structures and Algorithms · Computer Science 2020-12-29 Raghavendra Addanki , Andrew McGregor , Cameron Musco

We study causal representation learning, the task of inferring latent causal variables and their causal relations from high-dimensional mixtures of the variables. Prior work relies on weak supervision, in the form of counterfactual pre- and…

We establish conditions under which latent causal graphs are nonparametrically identifiable and can be reconstructed from unknown interventions in the latent space. Our primary focus is the identification of the latent structure in…

Machine Learning · Statistics 2023-11-06 Yibo Jiang , Bryon Aragam

Recently, there has been extensive research on the capabilities of biologically plausible algorithms. In this work, we show how one of such algorithms, called predictive coding, is able to perform causal inference tasks. First, we show how…

Machine Learning · Computer Science 2024-06-04 Tommaso Salvatori , Luca Pinchetti , Amine M'Charrak , Beren Millidge , Thomas Lukasiewicz

We study the problem of globally optimising a target variable of an unknown causal graph on which a sequence of soft or hard interventions can be performed. The problem of optimising the target variable associated with a causal graph is…

Machine Learning · Computer Science 2024-11-06 Sumantrak Mukherjee , Mengyan Zhang , Seth Flaxman , Sebastian Josef Vollmer

Promising results have driven a recent surge of interest in continuous optimization methods for Bayesian network structure learning from observational data. However, there are theoretical limitations on the identifiability of underlying…

We consider linear structural equation models with explicitly modelled latent variables. In such models, observed and latent variables solve linear equations including stochastic noise terms. The goal of our work is to identify the direct…

Methodology · Statistics 2026-05-28 Tom Hochsprung , Nils Sturma , Jakob Runge , Mathias Drton , Andreas Gerhardus

Causal identification is at the core of the causal inference literature, where complete algorithms have been proposed to identify causal queries of interest. The validity of these algorithms hinges on the restrictive assumption of having…

Machine Learning · Computer Science 2023-10-30 Sina Akbari , Fateme Jamshidi , Ehsan Mokhtarian , Matthew J. Vowels , Jalal Etesami , Negar Kiyavash

Intelligent agents equipped with causal knowledge can optimize their action spaces to avoid unnecessary exploration. The structural causal bandit framework provides a graphical characterization for identifying actions that are unable to…

Machine Learning · Computer Science 2025-11-25 Min Woo Park , Sanghack Lee

We consider the problem of learning causal networks with interventions, when each intervention is limited in size under Pearl's Structural Equation Model with independent errors (SEM-IE). The objective is to minimize the number of…

Artificial Intelligence · Computer Science 2015-11-03 Karthikeyan Shanmugam , Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath

Discovering the causal effect of a decision is critical to nearly all forms of decision-making. In particular, it is a key quantity in drug development, in crafting government policy, and when implementing a real-world machine learning…

Machine Learning · Computer Science 2020-03-04 Limor Gultchin , Matt J. Kusner , Varun Kanade , Ricardo Silva

Causal discovery is a major task with the utmost importance for machine learning since causal structures can enable models to go beyond pure correlation-based inference and significantly boost their performance. However, finding causal…

Machine Learning · Computer Science 2023-02-22 Andreas Sauter , Erman Acar , Vincent François-Lavet

Causal graph discovery is a significant problem with applications across various disciplines. However, with observational data alone, the underlying causal graph can only be recovered up to its Markov equivalence class, and further…

Machine Learning · Computer Science 2024-02-14 Davin Choo , Kirankumar Shiragur , Caroline Uhler

Uncovering the underlying causal mechanisms of complex real-world systems remains a significant challenge, as these systems often entail high data collection costs and involve unknown interventions. We introduce MetaCaDI, the first…

Machine Learning · Statistics 2025-10-28 Hans Jarett Ong , Yoichi Chikahara , Tomoharu Iwata

In this paper, we address the stochastic contextual linear bandit problem, where a decision maker is provided a context (a random set of actions drawn from a distribution). The expected reward of each action is specified by the inner…

Machine Learning · Statistics 2023-05-30 Osama A. Hanna , Lin F. Yang , Christina Fragouli