English
Related papers

Related papers: Causal learning with sufficient statistics: an inf…

200 papers

Causal disentanglement aims to learn about latent causal factors behind data, holding the promise to augment existing representation learning methods in terms of interpretability and extrapolation. Recent advances establish identifiability…

Machine Learning · Computer Science 2024-12-25 Ryan Welch , Jiaqi Zhang , Caroline Uhler

Numerous deep learning algorithms have been inspired by and understood via the notion of information bottleneck, where unnecessary information is (often implicitly) minimized while task-relevant information is maximized. However, a rigorous…

Machine Learning · Computer Science 2023-05-31 Kenji Kawaguchi , Zhun Deng , Xu Ji , Jiaoyang Huang

When presented with a data stream of two statistically dependent variables, predicting the future of one of the variables (the target stream) can benefit from information about both its history and the history of the other variable (the…

Machine Learning · Computer Science 2023-03-10 Damjan Kalajdzievski , Ximeng Mao , Pascal Fortier-Poisson , Guillaume Lajoie , Blake Richards

Probabilities of causation are fundamental to individual-level explanation and decision making, yet they are inherently counterfactual and not point-identifiable from data in general. Existing bounds either disregard available covariates,…

Artificial Intelligence · Computer Science 2026-02-17 Yuxuan Xie , Ang Li

When evaluating causal influence from one time series to another in a multivariate dataset it is necessary to take into account the conditioning effect of the other variables. In the presence of many variables, and possibly of a reduced…

Data Analysis, Statistics and Probability · Physics 2012-03-26 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal…

Machine Learning · Computer Science 2021-08-04 Nataliya Sokolovska , Pierre-Henri Wuillemin

We introduce an approach which allows detecting causal relationships between variables for which the time evolution is available. Causality is assessed by a variational scheme based on the Information Imbalance of distance ranks, a…

Methodology · Statistics 2024-05-07 Vittorio Del Tatto , Gianfranco Fortunato , Domenica Bueti , Alessandro Laio

Discovering causal relationships from observational data, particularly in the presence of latent variables, poses a challenging problem. While current local structure learning methods have proven effective and efficient when the focus lies…

Machine Learning · Computer Science 2024-06-07 Feng Xie , Zheng Li , Peng Wu , Yan Zeng , Chunchen Liu , Zhi Geng

Classical causal and statistical inference methods typically assume the observed data consists of independent realizations. However, in many applications this assumption is inappropriate due to a network of dependences between units in the…

Machine Learning · Computer Science 2019-07-02 Rohit Bhattacharya , Daniel Malinsky , Ilya Shpitser

Causal discovery from observational data is an important tool in many branches of science. Under certain assumptions it allows scientists to explain phenomena, predict, and make decisions. In the large sample limit, sound and complete…

Machine Learning · Statistics 2021-07-13 Shami Nisimov , Yaniv Gurwicz , Raanan Y. Rohekar , Gal Novik

Causal inference is to estimate the causal effect in a causal relationship when intervention is applied. Precisely, in a causal model with binary interventions, i.e., control and treatment, the causal effect is simply the difference between…

Machine Learning · Computer Science 2022-07-19 Zhenyu Lu , Yurong Cheng , Mingjun Zhong , George Stoian , Ye Yuan , Guoren Wang

Causal inference is known to be very challenging when only observational data are available. Randomized experiments are often costly and impractical and in instrumental variable regression the number of instruments has to exceed the number…

Methodology · Statistics 2018-06-19 Dominik Rothenhäusler , Peter Bühlmann , Nicolai Meinshausen

Causal inference studies whether the presence of a variable influences an observed outcome. As measured by quantities such as the "average treatment effect," this paradigm is employed across numerous biological fields, from vaccine and drug…

We define the relevant information in a signal $x\in X$ as being the information that this signal provides about another signal $y\in \Y$. Examples include the information that face images provide about the names of the people portrayed, or…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Naftali Tishby , Fernando C. Pereira , William Bialek

Inferring causal relationships from observational data is rarely straightforward, but the problem is especially difficult in high dimensions. For these applications, causal discovery algorithms typically require parametric restrictions or…

Methodology · Statistics 2022-06-29 David S. Watson , Ricardo Silva

Learning causal relationships among a set of variables, as encoded by a directed acyclic graph, from observational data is complicated by the presence of unobserved confounders. Instrumental variables (IVs) are a popular remedy for this…

Methodology · Statistics 2025-04-17 Jing Zou , Wei Li , Wei Lin

Statistical learning in high-dimensional spaces is challenging without a strong underlying data structure. Recent advances with foundational models suggest that text and image data contain such hidden structures, which help mitigate the…

Machine Learning · Statistics 2025-02-04 Charles Arnal , Clement Berenfeld , Simon Rosenberg , Vivien Cabannes

Methods of causal discovery aim to identify causal structures in a data driven way. Existing algorithms are known to be unstable and sensitive to statistical errors, and are therefore rarely used with biomedical or epidemiological data. We…

Methodology · Statistics 2024-07-01 Christine W Bang , Janine Witte , Ronja Foraita , Vanessa Didelez

At the heart of causal structure learning from observational data lies a deceivingly simple question: given two statistically dependent random variables, which one has a causal effect on the other? This is impossible to answer using…

Machine Learning · Computer Science 2020-10-13 Nikolaos Nikolaou , Konstantinos Sechidis

Causal discovery in the presence of missing data introduces a chicken-and-egg dilemma. While the goal is to recover the true causal structure, robust imputation requires considering the dependencies or, preferably, causal relations among…

Machine Learning · Computer Science 2024-06-04 Vy Vo , He Zhao , Trung Le , Edwin V. Bonilla , Dinh Phung