English
Related papers

Related papers: Conditional Dependence via Shannon Capacity: Axiom…

200 papers

Conditional independence (CI) testing arises naturally in many scientific problems and applications domains. The goal of this problem is to investigate the conditional independence between a response variable $Y$ and another variable $X$,…

Methodology · Statistics 2025-10-07 Adel Javanmard , Mohammad Mehrabi

We propose a sequential, anytime-valid method to test the conditional independence of a response $Y$ and a predictor $X$ given a random vector $Z$. The proposed test is based on e-statistics and test martingales, which generalize likelihood…

Methodology · Statistics 2023-02-22 Peter Grünwald , Alexander Henzi , Tyron Lardy

We present a method for conditional sampling for pre-trained normalizing flows when only part of an observation is available. We derive a lower bound to the conditioning variable log-probability using Schur complement properties in the…

Machine Learning · Statistics 2021-10-18 Vincent Moens , Aivar Sootla , Haitham Bou Ammar , Jun Wang

We propose a novel approach for learning causal response representations. Our method aims to extract directions in which a multidimensional outcome is most directly caused by a treatment variable. By bridging conditional independence…

Machine Learning · Statistics 2025-03-07 Homer Durand , Gherardo Varando , Gustau Camps-Valls

Causal effect estimation is a critical task in statistical learning that aims to find the causal effect on subjects by identifying causal links between a number of predictor (or, explanatory) variables and the outcome of a treatment. In a…

Methodology · Statistics 2024-11-26 Tathagata Basu , Matthias C. M. Troffaes

Handling highly dependent data is crucial in clinical trials, particularly in fields related to ophthalmology. Incorrectly specifying the dependency structure can lead to biased inferences. Traditionally, models rely on three fixed…

Methodology · Statistics 2025-09-30 Shuyi Liang , Takeshi Emura , Chang-Xing Ma , Yijing Xin , Xin-Wei Huang

Causal effect estimation from observational data is an important and much studied research topic. The instrumental variable (IV) and local causal discovery (LCD) patterns are canonical examples of settings where a closed-form expression…

Machine Learning · Statistics 2018-09-19 Ioan Gabriel Bucur , Tom Claassen , Tom Heskes

Using the fact that the Shannon capacity C of a Raleigh model of wireless channels is a linear statistic of the channel matrix, we calculate its variance var[C]. We find that the expected value <C> of the Shannon capacity is typical in the…

Disordered Systems and Neural Networks · Physics 2009-11-10 J. Staering , A. Eriksson , B. Mehlig

Complementarity relations between various characterizations of a probability distribution are at the core of information theory. In particular, lower and upper bounds for the entropic function are of great importance. In applied topics, we…

Quantum Physics · Physics 2022-09-07 Alexey E. Rastegin

We propose new concepts in order to analyze and model the dependence structure between two time series. Our methods rely exclusively on the order structure of the data points. Hence, the methods are stable under monotone transformations of…

Statistics Theory · Mathematics 2015-02-02 Alexander Schnurr , Herold Dehling

We consider the problem of estimating the support size of a distribution $D$. Our investigations are pursued through the lens of distribution testing and seek to understand the power of conditional sampling (denoted as COND), wherein one is…

Data Structures and Algorithms · Computer Science 2022-11-23 Diptarka Chakraborty , Gunjan Kumar , Kuldeep S. Meel

We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and effectively uses a predictive model of its…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

Explaining artificial intelligence or machine learning models is increasingly important. To use such data-driven systems wisely we must understand how they interact with the world, including how they depend causally on data inputs. In this…

Machine Learning · Computer Science 2023-07-06 Joshua R. Loftus , Lucius E. J. Bynum , Sakina Hansen

To answer questions of "causes of effects", the probability of necessity is introduced for assessing whether or not an observed outcome was caused by an earlier treatment. However, the statistical inference for probability of necessity is…

Methodology · Statistics 2025-04-14 Ping Zhang , Ruoyu Wang , Wang Miao

Testing for causation, defined as the preceding impact of the past values of one variable on the current value of another one when all other pertinent information is accounted for, is increasingly utilized in empirical research of the…

Econometrics · Economics 2021-06-22 Abdulnasser Hatemi-J

Testing conditional independence between two random vectors given a third is a fundamental and challenging problem in statistics, particularly in multivariate nonparametric settings due to the complexity of conditional structures. We…

Machine Learning · Statistics 2025-07-28 Chenxuan He , Yuan Gao , Liping Zhu , Jian Huang

We present a framework for selecting and developing measures of dependence when the goal is the quantification of a relationship between two variables, not simply the establishment of its existence. Much of the literature on dependence…

Methodology · Statistics 2013-02-22 Matthew Reimherr , Dan L. Nicolae

Adjusting for covariates is a well established method to estimate the total causal effect of an exposure variable on an outcome of interest. Depending on the causal structure of the mechanism under study there may be different adjustment…

Statistics Theory · Mathematics 2021-04-27 Jack Kuipers , Giusi Moffa

A fundamental task in statistical learning is quantifying the joint dependence or association between two continuous random variables. We introduce a novel, fully non-parametric measure that assesses the degree of association between…

The original development of Shapley values for prediction explanation relied on the assumption that the features being described were independent. If the features in reality are dependent this may lead to incorrect explanations. Hence,…

Methodology · Statistics 2021-02-15 Kjersti Aas , Thomas Nagler , Martin Jullum , Anders Løland