English
Related papers

Related papers: A New Measure of Conditional Dependence

200 papers

We describe a method that infers whether statistical dependences between two observed variables X and Y are due to a "direct" causal link or only due to a connecting causal path that contains an unobserved variable of low complexity, e.g.,…

Machine Learning · Computer Science 2012-02-20 Dominik Janzing , Eleni Sgouritsa , Oliver Stegle , Jonas Peters , Bernhard Schoelkopf

The partial copula provides a method for describing the dependence between two random variables $X$ and $Y$ conditional on a third random vector $Z$ in terms of nonparametric residuals $U_1$ and $U_2$. This paper develops a nonparametric…

Statistics Theory · Mathematics 2021-04-30 Lasse Petersen , Niels Richard Hansen

The paper presents a new copula based method for measuring dependence between random variables. Our approach extends the Maximum Mean Discrepancy to the copula of the joint distribution. We prove that this approach has several advantageous…

Machine Learning · Computer Science 2019-08-15 Barnabas Poczos , Zoubin Ghahramani , Jeff Schneider

Dependency networks (Heckerman et al., 2000) are potential probabilistic graphical models for systems comprising a large number of variables. Like Bayesian networks, the structure of a dependency network is represented by a directed graph,…

Machine Learning · Computer Science 2021-07-05 Kazuya Takabatake , Shotaro Akaho

Information theoretic measures (entropies, entropy rates, mutual information) are nowadays commonly used in statistical signal processing for real-world data analysis. The present work proposes the use of Auto Mutual Information (Mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 C Granero-Belinchón , S. Roux , P. Abry , N. Garnier

Network data are increasingly collected along with other variables of interest. Our motivation is drawn from neurophysiology studies measuring brain connectivity networks for a sample of individuals along with their membership to a low or…

Methodology · Statistics 2018-09-11 Daniele Durante , David B. Dunson

No man is an island, as individuals interact and influence one another daily in our society. When social influence takes place in experiments on a population of interconnected individuals, the treatment on a unit may affect the outcomes of…

Methodology · Statistics 2017-08-30 Edward K. Kao

Methods for inferring average causal effects have traditionally relied on two key assumptions: (i) the intervention received by one unit cannot causally influence the outcome of another; and (ii) units can be organized into non-overlapping…

Methodology · Statistics 2019-08-23 Eric J. Tchetgen Tchetgen , Isabel Fulcher , Ilya Shpitser

This paper focuses on a data-rich environment where the data set has a very large cross-sectional dimension, is likely to exhibit local dependence, and yet is hard to determine the dependence ordering. Such a situation arises, for example,…

Methodology · Statistics 2018-07-03 Kyungchul Song

So far, one-factor copulas induce conditional independence with respect to a latent factor. In this paper, we extend one-factor copulas to conditionally dependent models. This is achieved through new representations which allow to build new…

Methodology · Statistics 2016-12-12 Nathan Uyttendaele , Gildas Mazo

The robust detection of statistical dependencies between the components of a complex system is a key step in gaining a network-based understanding of the system. Because of their simplicity and low computation cost, pairwise statistics are…

Statistics Theory · Mathematics 2019-08-01 Antoine Messager , Nicos Georgiou , Luc Berthouze

The conditional mutual information I(X;Y|Z) measures the average information that X and Y contain about each other given Z. This is an important primitive in many learning problems including conditional independence testing, graphical model…

Information Theory · Computer Science 2017-10-16 Arman Rahimzamani , Sreeram Kannan

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu

One important obstacle in applying Dempster-Shafer Theory (DST) is its relationship to frequencies. In particular, there exist serious difficulties in finding factorizations of belief functions from data. In probability theory…

Artificial Intelligence · Computer Science 2018-12-17 Andrzej Matuszewski , Mieczysław A. Kłopotek

In this article we provide a substantial discussion on the statistical concept of conditional independence, which is not routinely mentioned in most elementary statistics and mathematical statistics textbooks. Under the assumption of…

Other Statistics · Statistics 2020-03-10 Jun Hu , Xianggui Qu

We consider situations where data have been collected such that the sampling depends on the outcome of interest and possibly further covariates, as for instance in case-control studies. Graphical models represent assumptions about the…

Methodology · Statistics 2011-01-06 Vanessa Didelez , Svend Kreiner , Niels Keiding

We explore fairness from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sensitive attributes. We…

Machine Learning · Computer Science 2025-12-22 Ruifan Huang , Haixia Liu

Given a set of several inputs into a system (e.g., independent variables characterizing stimuli) and a set of several stochastically non-independent outputs (e.g., random variables describing different aspects of responses), how can one…

Artificial Intelligence · Computer Science 2011-08-30 Ehtibar N. Dzhafarov , Janne V. Kujala

Mutual information is a well-known tool to measure the mutual dependence between variables. In this paper, a Bayesian nonparametric estimation of mutual information is established by means of the Dirichlet process and the $k$-nearest…

Methodology · Statistics 2021-08-10 Luai Al-Labadi , Forough Fazeli Asl , Zahra Saberi

Conditional probabilities are a core concept in machine learning. For example, optimal prediction of a label $Y$ given an input $X$ corresponds to maximizing the conditional probability of $Y$ given $X$. A common approach to inference tasks…

Machine Learning · Computer Science 2017-08-09 Yoav Wald , Amir Globerson