English
Related papers

Related papers: An entropy inequality for symmetric random variabl…

200 papers

The entropy power inequality (EPI) provides lower bounds on the differential entropy of the sum of two independent real-valued random variables in terms of the individual entropies. Versions of the EPI for discrete random variables have…

Information Theory · Computer Science 2013-01-18 Saeid Haghighatshoar , Emmanuel Abbe , Emre Telatar

For a random variable $X$ define $Q(X) = \sup_{x \in \mathbb{R}} \mathbb{P}(X=x)$. Let $X_1, \dots, X_n$ be independent integer random variables. Suppose $Q(X_i) \le \alpha_i \in (0,1]$ for each $i \in \{1, \dots, n\}$. Ju\v{s}kevi\v{c}ius…

Probability · Mathematics 2026-03-12 Valentas Kurauskas

The sum of $N$ sufficiently strongly correlated random variables will not in general be Gaussian distributed in the limit N\to\infty. We revisit examples of sums x that have recently been put forward as instances of variables obeying a…

Statistical Mechanics · Physics 2009-11-13 H. J. Hilhorst , G. Schehr

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to…

Statistics Theory · Mathematics 2025-02-24 Huiming Zhang , Song Xi Chen

We derive an asymptotic lower bound on the Shannon entropy $H$ of sums of $N$ arbitrary iid discrete random variables. The derived bound $H \geq \frac{r(X)}{2}\log(N) + {\it cst}$ is given in terms of the incommensurability rank $r(X)$ of…

Information Theory · Computer Science 2025-08-08 Riccardo Castellano , Pavel Sekatski

Let $A_n$ be an $n\times n$ random symmetric matrix with $(A_{ij})_{i< j}$ i.i.d. mean $0$, variance 1, following a subGaussian distribution and diagonal elements i.i.d. following a subGaussian distribution with a fixed variance. We…

Probability · Mathematics 2024-05-15 Yi Han

Lower bounds for the R\'enyi entropies of sums of independent random variables taking values in cyclic groups of prime order under permutations are established. The main ingredients of our approach are extended rearrangement inequalities in…

Combinatorics · Mathematics 2021-10-20 Mokshay Madiman , Liyao Wang , Jae Oh Woo

The Gaussian product inequality is a long-standing conjecture. In this paper, we investigate the three-dimensional inequality $E[X_1^{2}X_2^{2m_2}X_3^{2m_3}]\ge E[X_1^{2}]E[X_2^{2m_2}]E[X_3^{2m_3}]$ for any centered Gaussian random vector…

Probability · Mathematics 2022-05-11 Oliver Russell , Wei Sun

Let $C$ and $K$ be centrally symmetric convex bodies of volume $1$ in ${\mathbb R}^n$. We provide upper bounds for the multi-integral expression \begin{equation*}\|{\bf…

Metric Geometry · Mathematics 2019-06-11 Giorgos Chasapis , Apostolos Giannopoulos , Nikos Skarmogiannis

We establish the first known upper bound on the exact and Wyner's common information of $n$ continuous random variables in terms of the dual total correlation between them (which is a generalization of mutual information). In particular, we…

Information Theory · Computer Science 2018-12-11 Cheuk Ting Li , Abbas El Gamal

In this note we prove bounds on the upper and lower probability tails of sums of independent geometric or exponentially distributed random variables. We also prove negative results showing that our established tail bounds are asymptotically…

Statistics Theory · Mathematics 2019-02-11 Yaonan Jin , Yingkai Li , Yining Wang , Yuan Zhou

Suppose that the edges of a complete graph are assigned weights independently at random and we ask for the weight of the minimal-weight spanning tree, or perfect matching, or Hamiltonian cycle. For these and several other common…

Combinatorics · Mathematics 2025-01-28 Yun Cheng , Yixue Liu , Tomasz Tkocz , Albert Xu

In this paper, we develop the lower and upper bounds of worst-case distortion riskmetrics and weighted entropy for unimodal, and symmetric unimodal distributions when mean and variance information are available. We also consider the sharp…

Risk Management · Quantitative Finance 2025-11-24 Baishuai Zuo , Chuancun Yin

We compute exact asymptotic results for the probability of the occurrence of large deviations of the largest (smallest) eigenvalue of random matrices belonging to the Gaussian orthogonal, unitary and symplectic ensembles. In particular, we…

Statistical Mechanics · Physics 2009-11-13 David S. Dean , Satya N. Majumdar

We establish several Schur-convexity type results under fixed variance for weighted sums of independent gamma random variables and obtain nonasymptotic bounds on their R\'enyi entropies. In particular, this pertains to the recent results by…

Probability · Mathematics 2025-01-28 Giorgos Chasapis , Salil Singh , Tomasz Tkocz

Lower and upper bounds are explored for the uniform (Kolmogorov) and $L^2$-distances between the distributions of weighted sums of dependent summands and the normal law. The results are illustrated for several classes of random variables…

Probability · Mathematics 2023-08-08 S. G. Bobkov , G. P. Chistyakov , F. Götze

``Behind every limit theorem, there is an inequality'' said Kolmogorov. We say ``for every inequality, there is an approximate inequality under approximate regularity conditions.'' Suppose $X, X'$ are independent and identically distributed…

Statistics Theory · Mathematics 2026-04-17 Manit Paul , Arun Kumar Kuchibhotla

Consider the problem of drawing random variates $(X_1,\ldots,X_n)$ from a distribution where the marginal of each $X_i$ is specified, as well as the correlation between every pair $X_i$ and $X_j$. For given marginals, the…

Probability · Mathematics 2016-12-30 Mark Huber , Nevena Maric

We provide a sharp lower bound on the $p$-norm of a sum of independent uniform random variables in terms of its variance when $0 < p < 1$. We address an analogous question for $p$-R\'enyi entropy for $p$ in the same range.

Probability · Mathematics 2025-01-28 Giorgos Chasapis , Keerthana Gurushankar , Tomasz Tkocz

We consider a Bayesian problem of estimating of probability of success in a series of conditionally independent trials with binary outcomes. We study the asymptotic behaviour of differential entropy for posterior probability density…

Information Theory · Computer Science 2015-07-30 Mark Kelbert , Pavel Mozgunov