English
Related papers

Related papers: Inferring the finest pattern of mutual independenc…

200 papers

Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…

Data Analysis, Statistics and Probability · Physics 2016-01-05 Elliot A. Martin , Jaroslav Hlinka , Alexander Meinke , Filip Děchtěrenko , Jörn Davidsen

We treat the problem of testing independence between m continuous variables when m can be larger than the available sample size n. We consider three types of test statistics that are constructed as sums or sums of squares of pairwise rank…

Statistics Theory · Mathematics 2016-12-05 Dennis Leung , Mathias Drton

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2014-08-08 Marco Zaffalon , Marcus Hutter

In this paper, we propose a novel Euclidean-distance-based coefficient, named differential distance correlation, to measure the strength of dependence between a random variable $ Y \in \mathbb{R} $ and a random vector $ \boldsymbol{X} \in…

Methodology · Statistics 2025-12-16 Yixiao Liu , Pengjian Shang

In this paper, we introduce a ${\mathcal L}_2$ type test for testing mutual independence and banded dependence structure for high dimensional data. The test is constructed based on the pairwise distance covariance and it accounts for the…

Methodology · Statistics 2017-09-20 Shun Yao , Xianyang Zhang , Xiaofeng Shao

This article proposes a generalized notion of extreme multivariate dependence between two random vectors which relies on the extremality of the cross-covariance matrix between these two vectors. Using a partial ordering on the…

Econometrics · Economics 2021-02-10 Damien Bosc , Alfred Galichon

We study the task of high-dimensional entangled mean estimation in the subset-of-signals model. Specifically, given $N$ independent random points $x_1,\ldots,x_N$ in $\mathbb{R}^D$ and a parameter $\alpha \in (0, 1)$ such that each $x_i$ is…

Data Structures and Algorithms · Computer Science 2025-01-10 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

The paper presents a new copula based method for measuring dependence between random variables. Our approach extends the Maximum Mean Discrepancy to the copula of the joint distribution. We prove that this approach has several advantageous…

Machine Learning · Computer Science 2019-08-15 Barnabas Poczos , Zoubin Ghahramani , Jeff Schneider

We define the concept of dependence among multiple variables using maximum entropy techniques and introduce a graphical notation to denote the dependencies. Direct inference of information theoretic quantities from data uncovers…

Quantitative Methods · Quantitative Biology 2007-07-13 Ilya Nemenman

In this paper, we consider the problem of testing independence in high-dimensional settings with missing data. Building upon a recently proposed Kendall-based statistic, we introduce two new modifications specifically designed to…

Methodology · Statistics 2026-04-28 Marija Cuparić , Bojana Milošević , Jelena Radojević

This paper develops a novel unified framework for testing mutual independence among random objects residing in possibly different metric spaces. The framework generalizes existing methodologies and introduces new measures of mutual…

Methodology · Statistics 2025-10-22 Yaqing Chen , Paromita Dubey

Multi-agent Markov Decision Processes (MMDPs) arise in a variety of applications including target tracking, control of multi-robot swarms, and multiplayer games. A key challenge in MMDPs occurs when the state and action spaces grow…

Multiagent Systems · Computer Science 2021-03-31 Dinuka Sahabandu , Luyao Niu , Andrew Clark , Radha Poovendran

Mutual information (MI) is a useful information-theoretic measure to quantify the statistical dependence between two random variables: $X$ and $Y$. Often, we are interested in understanding how the dependence between $X$ and $Y$ in one set…

Information Theory · Computer Science 2025-07-22 Chetan Gohil , Oliver M Cliff , James M. Shine , Ben D. Fulcher , Joseph T. Lizier

In the past few decades, researchers have proposed many discriminant analysis (DA) algorithms for the study of high-dimensional data in a variety of problems. Most DA algorithms for feature extraction are based on transformations that…

Computer Vision and Pattern Recognition · Computer Science 2012-06-12 Ali Shadvar

Testing mutual independence for high-dimensional observations is a fundamental statistical challenge. Popular tests based on linear and simple rank correlations are known to be incapable of detecting non-linear, non-monotone relationships,…

Statistics Theory · Mathematics 2020-02-06 Mathias Drton , Fang Han , Hongjian Shi

Tests of independence are an important tool in applications, specifically in connection with the detection of a relationship between variables; they also have initiated many developments in statistical theory. In the present paper we build…

Statistics Theory · Mathematics 2026-05-13 L. Baringhaus , R. Grübel

Representation learning is an approach that allows to discover and extract the factors of variation from the data. Intuitively, a representation is said to be disentangled if it separates the different factors of variation in a way that is…

Machine Learning · Computer Science 2026-02-25 Antonio Almudévar , Alfonso Ortega

Mutual Information (MI) is an useful tool for the recognition of mutual dependence berween data sets. Differen methods for the estimation of MI have been developed when both data sets are discrete or when both data sets are continuous. The…

Applications · Statistics 2017-08-30 Miguel A. Ré , Guillermo G. Aguirre Varela

We prove the following theorem. Let $X$ be a discrete field, $\xi$ and $\eta$ be independent identically distributed random variables with values in $X$ and distribution $\mu$. The random variables $S=\xi+\eta$ and $D=(\xi-\eta)^2$ are…

Probability · Mathematics 2015-11-26 G. M. Feldman , M. V. Myronyuk