English
Related papers

Related papers: Entropic Causal Inference

200 papers

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Maximization of an expensive, unimodal function under random observations has been an important problem in hyperparameter tuning. It features expensive function evaluations (which means small budgets) and a high level of noise. We develop…

Optimization and Control · Mathematics 2023-02-23 Xiaohe Luo , Warren B. Powell

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

We consider the minimum cost intervention design problem: Given the essential graph of a causal graph and a cost to intervene on a variable, identify the set of interventions with minimum total cost that can learn any causal graph with the…

Machine Learning · Computer Science 2018-10-30 Erik M. Lindgren , Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath

Causal inference is known to be very challenging when only observational data are available. Randomized experiments are often costly and impractical and in instrumental variable regression the number of instruments has to exceed the number…

Methodology · Statistics 2018-06-19 Dominik Rothenhäusler , Peter Bühlmann , Nicolai Meinshausen

Given a set of discrete probability distributions, the minimum entropy coupling is the minimum entropy joint distribution that has the input distributions as its marginals. This has immediate relevance to tasks such as entropic causal…

Information Theory · Computer Science 2023-02-24 Spencer Compton , Dmitriy Katz , Benjamin Qi , Kristjan Greenewald , Murat Kocaoglu

Root causal analysis seeks to identify the set of initial perturbations that induce an unwanted outcome. In prior work, we defined sample-specific root causes of disease using exogenous error terms that predict a diagnosis in a structural…

Machine Learning · Statistics 2022-10-28 Eric V. Strobl , Thomas A. Lasko

Given data over the joint distribution of two random variables $X$ and $Y$, we consider the problem of inferring the most likely causal direction between $X$ and $Y$. In particular, we consider the general case where both $X$ and $Y$ may be…

Machine Learning · Statistics 2017-10-17 Alexander Marx , Jilles Vreeken

We study causal inference in a multi-environment setting, in which the functional relations for producing the variables from their direct causes remain the same across environments, while the distribution of exogenous noises may vary. We…

Machine Learning · Computer Science 2017-05-29 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Kun Zhang

We propose a method to infer causal structures containing both discrete and continuous variables. The idea is to select causal hypotheses for which the conditional density of every variable, given its causes, becomes smooth. We define a…

Machine Learning · Statistics 2009-10-30 Dominik Janzing , Xiaohai Sun , Bernhard Schoelkopf

The paper addresses the problem of finding the causal direction between two associated variables. The proposed solution is to build an autoencoder of their joint distribution and to maximize its estimation capacity relative to both the…

Machine Learning · Statistics 2022-12-09 Matthias Feiler

We study the problem of learning the causal relationships between a set of observed variables in the presence of latents, while minimizing the cost of interventions on the observed variables. We assume access to an undirected graph $G$ on…

Data Structures and Algorithms · Computer Science 2020-12-29 Raghavendra Addanki , Andrew McGregor , Cameron Musco

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch

Constraint-based causal discovery from limited data is a notoriously difficult challenge due to the many borderline independence test decisions. Several approaches to improve the reliability of the predictions by exploiting redundancy in…

Machine Learning · Computer Science 2017-01-27 Sara Magliacane , Tom Claassen , Joris M. Mooij

Causal discovery methods are intrinsically constrained by the set of assumptions needed to ensure structure identifiability. Moreover additional restrictions are often imposed in order to simplify the inference task: this is the case for…

Machine Learning · Computer Science 2023-04-07 Francesco Montagna , Nicoletta Noceti , Lorenzo Rosasco , Kun Zhang , Francesco Locatello

Artificial intelligence models and methods commonly lack causal interpretability. Despite the advancements in interpretable machine learning (IML) methods, they frequently assign importance to features which lack causal influence on the…

Machine Learning · Computer Science 2024-01-29 Francisco Nunes Ferreira Quialheiro Simoes , Mehdi Dastani , Thijs van Ommen

Causal effect estimation has been studied by many researchers when only observational data is available. Sound and complete algorithms have been developed for pointwise estimation of identifiable causal queries. For non-identifiable causal…

Machine Learning · Statistics 2023-06-26 Ziwei Jiang , Lai Wei , Murat Kocaoglu

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu

We consider the estimation of average treatment effects in observational studies and propose a new framework of robust causal inference with unobserved confounders. Our approach is based on distributionally robust optimization and proceeds…

Methodology · Statistics 2023-02-06 Dimitris Bertsimas , Kosuke Imai , Michael Lingzhi Li

This paper discusses the problem of causal query in observational data with hidden variables, with the aim of seeking the change of an outcome when "manipulating" a variable while given a set of plausible confounding variables which affect…

Artificial Intelligence · Computer Science 2020-11-25 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu , Kui Yu , Thuc Duy Le