English
Related papers

Related papers: copent: Estimating Copula Entropy and Transfer Ent…

200 papers

We introduce an independence criterion based on entropy regularized optimal transport. Our criterion can be used to test for independence between two samples. We establish non-asymptotic bounds for our test statistic and study its…

Machine Learning · Statistics 2022-04-21 Lang Liu , Soumik Pal , Zaid Harchaoui

We propose a new method to test conditional independence of two real random variables $Y$ and $Z$ conditionally on an arbitrary third random variable $X$. %with $F_{.|.}$ representing conditional distribution functions, The partial copula…

Statistics Theory · Mathematics 2011-01-25 Wicher Bergsma

Robust learning in the presence of non-Gaussian and statistically dependent noise remains a fundamental challenge in signal processing and adaptive systems. Although information-theoretic learning criteria such as correntropy offer strong…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Farshad Rostami Ghadi , F. Javier Lopez-Martinez , David Morales-Jimenez , Kai-Kit Wong , Marios Kountouris

We study the problem of discovering the simplest latent variable that can make two observed discrete variables conditionally independent. The minimum entropy required for such a latent is known as common entropy in information theory. We…

Background. The bootComb R package allows researchers to derive confidence intervals with correct target coverage for arbitrary combinations of arbitrary numbers of independently estimated parameters. Previous versions (< 1.1.0) of bootComb…

Methodology · Statistics 2022-10-03 Marc Yves Romain Henrion

We propose a framework for determining whether the causal dependence of an outcome $Y$ on a covariate $X$ changes at a given time point, given confounders $\boldsymbol{Z}$. For instance, in financial markets, the effect of a market…

Methodology · Statistics 2026-05-08 Shakeel Gavioli-Akilagun , Kieran Wood , Francesco Quinzan

In this paper, we revisit the notion of partial copula, originally introduced to test conditional independence, highlighting its capability to represent the dependence between two random variables after removing their dependence with a…

Methodology · Statistics 2026-05-26 Vinícius Litvinoff Justus , Felipe Fontana Vieira

Undirected graphical models are used extensively in the biological and social sciences to encode a pattern of conditional independences between variables, where the absence of an edge between two nodes $a$ and $b$ indicates that the…

Statistics Theory · Mathematics 2017-09-05 Rina Foygel Barber , Mladen Kolar

A dependence measure for arbitrary type pairs of random variables is proposed and analyzed, which in the particular case where both random variables are continuous turns out to be a concordance measure. Also, a sample version of the…

Statistics Theory · Mathematics 2017-02-07 Arturo Erdely

An important step of modeling spatially-referenced data is appropriately specifying the second order properties of the random field. A scientist developing a model for spatial data has a number of options regarding the nature of the…

Computation · Statistics 2015-11-17 Zachary D. Weller

We propose a new multivariate dependency measure. It is obtained by considering a Gaussian kernel based distance between the copula transform of the given d-dimensional distribution and the uniform copula and then appropriately normalizing…

Statistics Theory · Mathematics 2019-11-12 Angshuman Roy , Alok Goswami , C. A. Murthy

A framework for quantifying dependence between random vectors is introduced. With the notion of a collapsing function, random vectors are summarized by single random variables, called collapsed random variables in the framework. Using this…

Methodology · Statistics 2018-01-12 Marius Hofert , Wayne Oldford , Avinash Prasad , Mu Zhu

We present RKappa, a framework for the development and analysis of rule-based models within a mature, statistically empowered R environment. The infrastructure allows model editing, modification, parameter sampling, simulation, statistical…

Molecular Networks · Quantitative Biology 2014-12-16 Anatoly Sorokin , Oksana Sorokina , J. Douglas Armstrong

In this article, we study tests of independence for data with arbitrary distributions in the non-serial case, i.e., for independent and identically distributed random vectors, as well as in the serial case, i.e., for time series. These…

Methodology · Statistics 2023-06-13 Bouchra R. Nasri , Bruno N. Remillard

Time lag between variables is a key characteristics of dynamical systems in different fields and identifying such time lag is an important problem in complex systems with many applications. Transfer Entropy (TE) was proposed as a tool for…

Machine Learning · Computer Science 2023-02-07 Jian Ma

Testing for pairwise independence for the case where the number of variables may be of the same size or even larger than the sample size has received increasing attention in the recent years. We contribute to this branch of the literature…

Statistics Theory · Mathematics 2024-09-18 Axel Bücher , Cambyse Pakzad

A method for estimating the Shannon differential entropy of multidimensional random variables using independent samples is described. The method is based on decomposing the distribution into a product of the marginal distributions and the…

Statistical Mechanics · Physics 2020-04-22 Gil Ariel , Yoram Louzoun

This paper is concerned with modeling the dependence structure of two (or more) time-series in the presence of a (possible multivariate) covariate which may include past values of the time series. We assume that the covariate influences…

Statistics Theory · Mathematics 2018-12-11 Natalie Neumeyer , Marek Omelka , Sarka Hudecova

Testing copula hypothesis is of fundamental importance in the applications of copula theory. In this paper we proposed a copula hypothesis testing with copula entropy. Since copula entropy is a unified theory in probability and therefore…

Methodology · Statistics 2025-10-28 Jian Ma

The empirical copula process, a fundamental tool for copula inference, is studied in the high dimensional regime where the dimension is allowed to grow to infinity exponentially in the sample size. Under natural, weak smoothness assumptions…

Statistics Theory · Mathematics 2025-09-25 Axel Bücher , Cambyse Pakzad