English
Related papers

Related papers: Analysing causal structures with entropy

200 papers

Much of our experiments are designed to uncover the cause(s) and effect(s) behind a data generating mechanism (i.e., phenomenon) we happen to be interested in. Uncovering such relationships allows us to identify the true working of a…

Machine Learning · Computer Science 2023-07-11 M. Z. Naser

Entropic causal inference is a framework for inferring the causal direction between two categorical variables from observational data. The central assumption is that the amount of unobserved randomness in the system is not too large. This…

Machine Learning · Statistics 2021-01-12 Spencer Compton , Murat Kocaoglu , Kristjan Greenewald , Dmitriy Katz

Complex processes often arise from sequences of simpler interactions involving a few particles at a time. These interactions, however, may not be directly accessible to experiments. Here we develop the first efficient method for unravelling…

Quantum Physics · Physics 2022-06-24 Ge Bai , Ya-Dong Wu , Yan Zhu , Masahito Hayashi , Giulio Chiribella

We study the problem of discovering the simplest latent variable that can make two observed discrete variables conditionally independent. The minimum entropy required for such a latent is known as common entropy in information theory. We…

Inferring the effect of interventions within complex systems is a fundamental problem of statistics. A widely studied approach employs structural causal models that postulate noisy functional relations among a set of interacting variables.…

Methodology · Statistics 2024-02-14 David Strieder , Mathias Drton

Recent developments enable the quantification of causal control given a structural causal model (SCM). This has been accomplished by introducing quantities which encode changes in the entropy of one variable when intervening on another.…

Machine Learning · Computer Science 2024-02-20 Francisco N. F. Q. Simoes , Mehdi Dastani , Thijs van Ommen

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Causal modelling provides a powerful set of tools for identifying causal structure from observed correlations. It is well known that such techniques fail for quantum systems, unless one introduces `spooky' hidden mechanisms. Whether one can…

Quantum Physics · Physics 2016-06-28 Fabio Costa , Sally Shrapnel

Causal discovery aims to recover information about an unobserved causal graph from the observable data it generates. Layerings are orderings of the variables which place causes before effects. In this paper, we provide ways to recover…

When domain knowledge is limited and experimentation is restricted by ethical, financial, or time constraints, practitioners turn to observational causal discovery methods to recover the causal structure, exploiting the statistical…

Inferring the causal structure that links n observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when only…

Statistics Theory · Mathematics 2008-04-24 Dominik Janzing , Bernhard Schoelkopf

The finiteness of black hole entropy suggest that spacetime is fundamentally discrete, and hints at an underlying relationship between geometry and "information". The foundation of this relationship is yet to be uncovered, but should…

General Relativity and Quantum Cosmology · Physics 2008-10-14 D. Rideout , S. Zohren

Learning about cause and effect is arguably the main goal in applied econometrics. In practice, the validity of these causal inferences is contingent on a number of critical assumptions regarding the type of data that has been collected and…

Econometrics · Economics 2023-03-03 Paul Hünermund , Elias Bareinboim

Identifying the causal structures between two statistically correlated events has been widely investigated in many fields of science. While some of the well-studied classical methods are carefully generalized to quantum version of causal…

Quantum Physics · Physics 2022-03-08 Feixiang Xu , Jia-Yi Lin , Ben Wang , Tao Jiang , Shengjun Wu , Wei Wang , Lijian Zhang

Testing whether a probability distribution is compatible with a given Bayesian network is a fundamental task in the field of causal inference, where Bayesian networks model causal relations. Here we consider the class of causal structures…

Machine Learning · Statistics 2020-09-04 Aditya Kela , Kai von Prillwitz , Johan Aberg , Rafael Chaves , David Gross

The problem of causal inference is to determine if a given probability distribution on observed variables is compatible with some causal structure. The difficult case is when the causal structure includes latent variables. We here introduce…

Quantum Physics · Physics 2019-07-24 Elie Wolfe , Robert W. Spekkens , Tobias Fritz

Artificial intelligence models and methods commonly lack causal interpretability. Despite the advancements in interpretable machine learning (IML) methods, they frequently assign importance to features which lack causal influence on the…

Machine Learning · Computer Science 2024-01-29 Francisco Nunes Ferreira Quialheiro Simoes , Mehdi Dastani , Thijs van Ommen

Causal discovery and causal effect estimation are two fundamental tasks in causal inference. While many methods have been developed for each task individually, statistical challenges arise when applying these methods jointly: estimating…

Methodology · Statistics 2024-08-21 Paula Gradu , Tijana Zrnic , Yixin Wang , Michael I. Jordan

In the course of the last decades entropic uncertainty relations have attracted much attention not only due to their fundamental role as manifestation of non-classicality of quantum mechanics, but also as major tools for applications of…

Quantum Physics · Physics 2020-05-13 Andreas Ketterer , Otfried Gühne

Identification of causal structures and quantification of direct information flows in complex systems is a challenging yet important task, with practical applications in many fields. Data generated by dynamical processes or large-scale…

Data Analysis, Statistics and Probability · Physics 2015-08-06 Carlo Cafaro , Warren M. Lord , Jie Sun , Erik M. Bollt