English
Related papers

Related papers: Dependency-dependent Bounds for Sums of Dependent …

200 papers

We study the sample complexity of learning neural networks, by providing new bounds on their Rademacher complexity assuming norm constraints on the parameter matrix of each layer. Compared to previous work, these complexity bounds have…

Machine Learning · Computer Science 2019-11-19 Noah Golowich , Alexander Rakhlin , Ohad Shamir

We utilize quantum superposition principle to establish the improvable upper and lower bounds on the stronger uncertainty relation, i.e., the "weighted-like" sum of the variances of observables. Our bounds include some free parameters which…

Quantum Physics · Physics 2017-04-17 Jun Zhang , Yang Zhang , Chang-shui Yu

Measuring the statistical dependence between observed signals is a primary tool for scientific discovery. However, biological systems often exhibit complex non-linear interactions that currently cannot be captured without a priori knowledge…

Following our previous work on copula-based nonsymmetric dependence measures, we introduce similar measures for discrete random variables. The measures cover the range between two extremes: independence and complete dependence, which take…

Methodology · Statistics 2015-12-29 Hui Li

A framework for quantifying dependence between random vectors is introduced. With the notion of a collapsing function, random vectors are summarized by single random variables, called collapsed random variables in the framework. Using this…

Methodology · Statistics 2018-01-12 Marius Hofert , Wayne Oldford , Avinash Prasad , Mu Zhu

We investigate the problem of detecting dependencies between the components of a high-dimensional vector. Our approach advances the existing literature in two important respects. First, we consider the problem under privacy constraints.…

Statistics Theory · Mathematics 2026-03-24 Patrick Bastian , Holger Dette , Martin Dunsche

We study the large deviations of sums of correlated random variables described by a matrix product ansatz, which generalizes the product structure of independent random variables to matrices whose non-commutativity is the source of…

Statistical Mechanics · Physics 2014-02-18 Florian Angeletti , Hugo Touchette , Eric Bertin , Patrice Abry

A Bell test can rule out local realistic models, and has potential applications in communications and information tasks. For example, a Bell inequality violation can certify the presence of intrinsic randomness in measurement outcomes,…

The paper presents a new copula based method for measuring dependence between random variables. Our approach extends the Maximum Mean Discrepancy to the copula of the joint distribution. We prove that this approach has several advantageous…

Machine Learning · Computer Science 2019-08-15 Barnabas Poczos , Zoubin Ghahramani , Jeff Schneider

Identifying how dependence relationships vary across different conditions plays a significant role in many scientific investigations. For example, it is important for the comparison of biological systems to see if relationships between…

Methodology · Statistics 2023-07-31 Hoseung Song , Michael C. Wu

Explaining artificial intelligence or machine learning models is increasingly important. To use such data-driven systems wisely we must understand how they interact with the world, including how they depend causally on data inputs. In this…

Machine Learning · Computer Science 2023-07-06 Joshua R. Loftus , Lucius E. J. Bynum , Sakina Hansen

We consider a class of stationary processes exhibiting both long-range dependence and heavy tails. Separate limit theorems for sums and for extremes have been established recently in literature with novel objects appearing in the limits. In…

Probability · Mathematics 2023-09-12 Shuyang Bai , He Tang

In this paper we characterize the limiting behavior of sums of extreme values of long range dependent sequences defined as functionals of linear processes with finite variance. The extremal sums behave completely different by compared to…

Probability · Mathematics 2007-06-13 Rafal Kulik

We establish bounds for the covariance of a large class of functions of infinite variance stable random variables, including unbounded functions such as the power function and the logarithm. These bounds involve measures of dependence…

Statistics Theory · Mathematics 2011-11-10 Vladas Pipiras , Murad S. Taqqu , Patrice Abry

Measuring dependence between two events, or equivalently between two binary random variables, amounts to expressing the dependence structure inherent in a $2\times 2$ contingency table in a real number between $-1$ and $1$. Countless such…

Methodology · Statistics 2025-11-13 Marc-Oliver Pohle , Timo Dimitriadis , Jan-Lukas Wermuth

In this paper, we establish Berry--Esseen bounds for both self-normalized and non-self-normalized sums of locally dependent random variables. The proofs are based on Stein's method together with a concentration inequality approach. We…

Probability · Mathematics 2026-02-03 Zhi-Jun Cai , Qi-Man Shao , Zhuo-Song Zhang

We leverage proof techniques Fourier analysis and an existing result in coding theory to derive new bounds for the problem of non-interactive simulation of binary random variables. Previous bounds in the literature were derived by applying…

Information Theory · Computer Science 2021-01-26 Lei Yu , Vincent Y. F. Tan

This paper derives new bounds on the difference of the entropies of two discrete random variables in terms of the local and total variation distances between their probability mass functions. The derivation of the bounds relies on maximal…

Information Theory · Computer Science 2016-11-17 Igal Sason

When studying convergence of measures, an important issue is the choice of probability metric. In this review, we provide a summary and some new results concerning bounds among ten important probability metrics/distances that are used by…

Probability · Mathematics 2007-05-23 Alison L. Gibbs , Francis Edward Su

Over the last couple of decades, several copula based methods have been proposed in the literature to test for the independence among several random variables. But these existing tests are not invariant under monotone transformations of the…

Statistics Theory · Mathematics 2019-11-15 Angshuman Roy , Anil Ghosh , Alok Goswami , C. A. Murthy