English
Related papers

Related papers: Entropic Causal Inference

200 papers

Pursuing invariant prediction from heterogeneous environments opens the door to learning causality in a purely data-driven way and has several applications in causal discovery and robust transfer learning. However, existing methods such as…

Statistics Theory · Mathematics 2025-01-30 Yihong Gu , Cong Fang , Yang Xu , Zijian Guo , Jianqing Fan

We describe a method that infers whether statistical dependences between two observed variables X and Y are due to a "direct" causal link or only due to a connecting causal path that contains an unobserved variable of low complexity, e.g.,…

Machine Learning · Computer Science 2012-02-20 Dominik Janzing , Eleni Sgouritsa , Oliver Stegle , Jonas Peters , Bernhard Schoelkopf

Causal discovery from observational data is an important but challenging task in many scientific fields. Recently, a method with non-combinatorial directed acyclic constraint, called NOTEARS, formulates the causal structure learning problem…

Machine Learning · Computer Science 2023-10-31 Weilin Chen , Jie Qiao , Ruichu Cai , Zhifeng Hao

In this study, we address causal inference when only observational data and a valid causal ordering from the causal graph are available. We introduce a set of flow models that can recover component-wise, invertible transformation of…

Machine Learning · Computer Science 2024-12-16 Minh Khoa Le , Kien Do , Truyen Tran

Many statistical methods have been proposed to estimate causal models in classical situations with fewer variables than observations (p<n, p: the number of variables and n: the number of observations). However, modern datasets including…

Machine Learning · Statistics 2011-04-08 Shohei Shimizu , Takashi Washio , Aapo Hyvarinen , Seiya Imoto

We propose a constraint-based algorithm, which automatically determines causal relevance thresholds, to infer causal networks from data. We call these topological thresholds. We present two methods for determining the threshold: the first…

Machine Learning · Statistics 2024-04-24 Filipe Barroso , Diogo Gomes , Gareth J. Baxter

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

Information Theory · Computer Science 2021-09-22 Gilad Gour , Marco Tomamichel

We consider causal models with two observed variables and one latent variables, each variable being discrete, with the goal of characterizing the possible distributions on outcomes that can result from controlling one of the observed…

Information Theory · Computer Science 2021-03-05 Kevin Shu

In this paper we show how to exploit interventional data to acquire the joint conditional distribution of all the variables using the Maximum Entropy principle. To this end, we extend the Causal Maximum Entropy method to make use of…

Complex diseases are caused by a multitude of factors that may differ between patients. As a result, hypothesis tests comparing all patients to all healthy controls can detect many significant variables with inconsequential effect sizes. A…

Machine Learning · Statistics 2022-05-25 Eric V. Strobl , Thomas A. Lasko

Causal systems often exhibit variations of the underlying causal mechanisms between the variables of the system. Often, these changes are driven by different environments or internal states in which the system operates, and we refer to…

Machine Learning · Computer Science 2025-03-28 Wiebke Günther , Oana-Iuliana Popescu , Martin Rabel , Urmi Ninad , Andreas Gerhardus , Jakob Runge

Causal discovery from observational data is an important tool in many branches of science. Under certain assumptions it allows scientists to explain phenomena, predict, and make decisions. In the large sample limit, sound and complete…

Machine Learning · Statistics 2021-07-13 Shami Nisimov , Yaniv Gurwicz , Raanan Y. Rohekar , Gal Novik

Inferring the causal structure of a set of random variables from a finite sample of the joint distribution is an important problem in science. Recently, methods using additive noise models have been suggested to approach the case of…

Machine Learning · Statistics 2012-07-24 Jonas Peters , Dominik Janzing , Bernhard Schölkopf

Inferring causal directions on discrete and categorical data is an important yet challenging problem. Even though the additive noise models (ANMs) approach can be adapted to the discrete data, the functional structure assumptions make it…

Machine Learning · Statistics 2021-09-02 Austin Goddard , Yu Xiang

We examine the minimum entropy coupling problem, where one must find the minimum entropy variable that has a given set of distributions $S = \{p_1, \dots, p_m \}$ as its marginals. Although this problem is NP-Hard, previous works have…

Information Theory · Computer Science 2022-03-11 Spencer Compton

Finding an effective medical treatment often requires a search by trial and error. Making this search more efficient by minimizing the number of unnecessary trials could lower both costs and patient suffering. We formalize this problem as…

Machine Learning · Computer Science 2021-02-18 Samuel Håkansson , Viktor Lindblom , Omer Gottesman , Fredrik D. Johansson

In this paper, we deal with the problem of inferring causal directions when the data is on discrete domain. By considering the distribution of the cause $P(X)$ and the conditional distribution mapping cause to effect $P(Y|X)$ as independent…

Machine Learning · Statistics 2018-08-08 Furui Liu , Laiwan Chan

We introduce and test a general machine-learning-based technique for the inference of short term causal dependence between state variables of an unknown dynamical system from time series measurements of its state variables. Our technique…

Adaptation and Self-Organizing Systems · Physics 2020-12-18 Amitava Banerjee , Jaideep Pathak , Rajarshi Roy , Juan G. Restrepo , Edward Ott

We consider the problem of predicting a response variable from a set of covariates on a data set that differs in distribution from the training data. Causal parameters are optimal in terms of predictive accuracy if in the new distribution…

Methodology · Statistics 2020-05-12 Dominik Rothenhäusler , Nicolai Meinshausen , Peter Bühlmann , Jonas Peters

Unobserved confounding is one of the main challenges when estimating causal effects. We propose a causal reduction method that, given a causal model, replaces an arbitrary number of possibly high-dimensional latent confounders with a single…

Machine Learning · Statistics 2023-02-24 Maximilian Ilse , Patrick Forré , Max Welling , Joris M. Mooij