English
Related papers

Related papers: Remarks on the R\'{e}nyi Entropy of a sum of IID r…

200 papers

This paper studies the asymptotic properties of weighted sums of the form $Z_n=\sum_{i=1}^n a_i X_i$, in which $X_1, X_2, \ldots, X_n$ are i.i.d.~random variables and $a_1, a_2, \ldots, a_n$ correspond to either eigenvalues or singular…

Probability · Mathematics 2022-09-26 Angel Chavez , Jacob Waldor

We study a generalized version of Wyner's common information problem (also coined the distributed source simulation problem). The original common information problem consists in understanding the minimum rate of the common input to…

Information Theory · Computer Science 2019-12-04 Lei Yu , Vincent Y. F. Tan

Let X_1,...., X_n be a collection of iid discrete random variables, and Y_1,..., Y_m a set of noisy observations of such variables. Assume each observation Y_a to be a random function of some a random subset of the X_i's, and consider the…

Information Theory · Computer Science 2007-09-04 Andrea Montanari

The aim of this paper is to establish Hoeffding and Bernstein type concentration inequalities for weighted sums of exchangeable random variables. A special case is the i.i.d. setting, where random variables are sampled independently from…

Statistics Theory · Mathematics 2025-08-11 Rina Foygel Barber

We study the asymptotic behaviour of the probability that a weighted sum of centered i.i.d. random variables X_k does not exceed a constant barrier. For regular random walks, the results follow easily from classical fluctuation theory,…

Probability · Mathematics 2011-05-24 Frank Aurzada , Christoph Baumgarten

For a random variable we can define a variational relationship with practical physical meaning as dI=dbar(x)-bar(dx), where I is called as uncertainty measurement. With the help of a generalized definition of expectation,…

Statistical Mechanics · Physics 2008-10-27 Congjie Ou , Aziz El Kaabouchi , Alain Le Mehaute , Qiuping A. Wang , Jincan Chen

We define the empirical spectral distribution (ESD) of a random matrix polynomial with invertible leading coefficient, and we study it for complex $n \times n$ Gaussian monic matrix polynomials of degree $k$. We obtain exact formulae for…

Probability · Mathematics 2022-07-20 Giovanni Barbarino , Vanni Noferini

We calculate the average differential entropy of a $q$-component Gaussian mixture in $\mathbb R^n$. For simplicity, all components have covariance matrix $\sigma^2 {\mathbf 1}$, while the means $\{\mathbf{W}_i\}_{i=1}^{q}$ are i.i.d.…

Information Theory · Computer Science 2025-02-12 Basheer Joudeh , Boris Škorić

We show that, under mild assumptions, the spectrum of a sum of independent random matrices is close to that of the Gaussian random matrix whose entries have the same mean and covariance. This nonasymptotic universality principle yields…

Probability · Mathematics 2024-06-26 Tatiana Brailovskaya , Ramon van Handel

The central limit theorem provides the theoretical foundation for the universality of the normal distribution: under broad conditions, the asymptotic distribution of a sum of independent random variables approaches a Gaussian. Yet, physical…

Data Analysis, Statistics and Probability · Physics 2026-03-26 Mario Castro , José A. Cuesta

We construct a non - improved exponential bounds for distribution of normed sums of i.,i.d. random variables with random numbers of summand.

Probability · Mathematics 2007-05-23 B. M. Migdashiev , E. I. Ostrovsky

We prove entropic and total variation versions of the Erd\H{o}s-Kac limit theorem for the maximum of the partial sums of i.i.d. random variables with densities.

Probability · Mathematics 2013-08-15 S. G. Bobkov , G. P. Chistyakov , H. Kösters

This paper explores certain kinds of empirical process with respect to the components of multivariate Gaussian. We put forward some finite sample bounds which hold for multivariate Gaussian under general dependence. We give necessary and…

Probability · Mathematics 2020-07-03 Jikai Hou

For normalized sums $Z_n$ of i.i.d. random variables, we explore necessary and sufficient conditions which guarantee the normal approximation with respect to the R\'enyi divergence of infinite order. In terms of densities $p_n$ of $Z_n$,…

Probability · Mathematics 2024-06-21 Sergey G. Bobkov , Friedrich Götze

We consider vectors of random variables, obtained by restricting the length of the nodal set of Berry's random wave model to a finite collection of (possibly overlapping) smooth compact subsets of $\mathbb{R}^2$. Our main result shows that,…

Probability · Mathematics 2020-01-29 Giovanni Peccati , Anna Vidotto

Traditional meta-analysis assumes that the effect sizes estimated in individual studies follow a Gaussian distribution. However, this distributional assumption is not always satisfied in practice, leading to potentially biased results. In…

Methodology · Statistics 2024-04-23 Wei Liang , Haicheng Huang , Hongsheng Dai , Yinghui Wei

The joint eigenvalue distributions of random-matrix ensembles are derived by applying the principle maximum entropy to the Renyi, Abe and Kaniadakis entropies. While the Renyi entropy produces essentially the same matrix-element…

Statistical Mechanics · Physics 2007-05-23 A. Y. Abul-Magd

These notes provide an introduction to the theory of random matrices. The central quantity studied is $\tau(a)= det(1-K)$ where $K$ is the integral operator with kernel $1/\pi} {\sin\pi(x-y)\over x-y} \chi_I(y)$. Here…

High Energy Physics - Theory · Physics 2015-06-26 Craig A. Tracy , Harold Widom

We prove several new results on the Hamming weight of bounded uniform and small-bias distributions. We exhibit bounded-uniform distributions whose weight is anti-concentrated, matching existing concentration inequalities. This construction…

Computational Complexity · Computer Science 2024-07-18 Harm Derksen , Peter Ivanov , Chin Ho Lee , Emanuele Viola

Linear combinations of independent random variables have been extensively studied in the literature. However, most of the work is based on some specific distribution assumptions. In this paper, a companion of (J. Appl. Probab. 48 (2011)…

Statistics Theory · Mathematics 2013-12-11 Xiaoqing Pan , Maochao Xu , Taizhong Hu