English
Related papers

Related papers: An entropy inequality for symmetric random variabl…

200 papers

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

We consider the self-normalized sums $T_{n}=\sum_{i=1}^{n}X_{i}Y_{i}/\sum_{i=1}^{n}Y_{i}$, where ${Y_{i} : i\geq 1}$ are non-negative i.i.d. random variables, and ${X_{i} : i\geq 1} $ are i.i.d. random variables, independent of ${Y_{i} : i…

Probability · Mathematics 2012-06-20 Peter Kevei , David M. Mason

Exact upper and lower bounds on the ratio $\mathsf{E}w(\mathbf{X}-\mathbf{v})/\mathsf{E}w(\mathbf{X})$ for a centered Gaussian random vector $\mathbf{X}$ in $\mathbb{R}^n$, as well as bounds on the rate of change of…

Probability · Mathematics 2022-05-20 Iosif Pinelis

We analyze the quality of the gaussian approximation to linear combinations of n independent, identically-distributed random variables with finite fourth moments. It turns out that there exist universal, simple linear combinations that…

Probability · Mathematics 2012-10-23 Bo'az Klartag , Sasha Sodin

We obtain some new results concerning the small deviation problem for $S=\sum_n q^n X_n$ and $M=\sup_n q^n X_n$, where $0<q<1$ and $(X_n)$ are i.i.d. non-negative random variables. In particular, the asymptotics is shown to be the same for…

Probability · Mathematics 2008-11-14 Frank Aurzada

Tight bounds for several symmetric divergence measures are introduced, given in terms of the total variation distance. Each of these bounds is attained by a pair of 2 or 3-element probability distributions. An application of these bounds…

Information Theory · Computer Science 2016-11-15 Igal Sason

We show, on purely statistical grounds and without appeal to any physical model, that a power-law $q-$entropy $S_q$, with $0<q<1$, can be {\it extensive}. More specifically, if the components $X_i$ of a vector $X \in \mathbb{R}^N$ are…

Statistical Mechanics · Physics 2009-11-11 C. Vignat , A. Plastino , A. R. Plastino

This paper derives a new strong Gaussian approximation bound for the sum of independent random vectors. The approach relies on the optimal transport theory and yields \textit{explicit} dependence on the dimension size $p$ and the sample…

Statistics Theory · Mathematics 2021-09-06 Nazar Buzun , Nikolay Shvetsov , Dmitry V. Dylov

We extend Bobkov and Chistyakov's (2015) upper bounds on concentration functions of sums of independent random variables to a multivariate entropic setting. The approach is based on pointwise estimates on densities of sums of independent…

Probability · Mathematics 2026-03-05 James Melbourne , Tomasz Tkocz , Katarzyna Wyczesany

We present new explicit upper bounds for the smoothness of the distribution of the random diagonal sum $S_n=\sum_{j=1}^nX_{j,\pi(j)}$ of a random $n\times n$ matrix $X=(X_{j,r})$, where the $X_{j,r}$ are independent integer valued random…

Probability · Mathematics 2023-07-03 Bero Roos

We bound an exponential sum that appears in the study of irregularities of distribution (the low-frequency Fourier energy of the sum of several Dirac measures) by geometric quantities: a special case is that for all $\left\{ x_1, \dots,…

Number Theory · Mathematics 2017-09-05 Stefan Steinerberger

Bounds of the accuracy of the normal approximation to the distribution of a sum of independent random variables are improved under relaxed moment conditions, in particular, under the absence of moments of orders higher than the second.…

Probability · Mathematics 2015-07-06 V. Yu. Korolev , A. V. Dorofeeva

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated…

Machine Learning · Statistics 2025-01-23 Takashi Furuya , Hiroyuki Kusumoto , Koichi Taniguchi , Naoya Kanno , Kazuma Suetake

We study a tight Bennett-type concentration inequality for sums of heterogeneous and independent variables, defined as a one-dimensional minimization. We show that this refinement, which outperforms the standard known bounds, remains…

Optimization and Control · Mathematics 2022-11-23 Quentin Jacquet , Riadh Zorgati

In this expository note, we give a modern proof of Hanson-Wright inequality for quadratic forms in sub-gaussian random variables. We deduce a useful concentration inequality for sub-gaussian random vectors. Two examples are given to…

Probability · Mathematics 2013-10-02 Mark Rudelson , Roman Vershynin

A variant of the well-known Chebyshev inequality for scalar random variables can be formulated in the case where the mean and variance are estimated from samples. In this paper we present a generalization of this result to multiple…

Methodology · Statistics 2017-09-29 Bartolomeo Stellato , Bart Van Parys , Paul J. Goulart

Which permutations of a probability distribution on integers minimize variance? Let $X$ be a random variable on a set of integers $\{x_1, \dots, x_N\}$ such that $\mathbb{P}(X_i = x_i) = p_i$, $i \in \{1,\dots,N\}$. Let $(p^{(1)}, \dots,…

Combinatorics · Mathematics 2026-01-21 Aistis Atminas , Valentas Kurauskas

We give a comparison inequality that allows one to estimate the tail probabilities of sums of independent Banach space valued random variables in terms of those of independent identically distributed random variables. More precisely, let…

Probability · Mathematics 2007-05-23 Stephen Montgomery-Smith , Alexander R. Pruss

Let $(\xi_i)_{i=1,...,n}$ be a sequence of independent and symmetric random variables. We consider the upper bounds on tail probabilities of self-normalized deviations $$ \mathbf{P} \Big( \max_{1\leq k \leq n} \sum_{i=1}^{k} |\xi_i|\big/…

Probability · Mathematics 2017-05-05 Xiequan Fan

Complex Hermitian random matrices with a unitary symmetry can be distinguished by a weight function. When this is even, it is a known result that the distribution of the singular values can be decomposed as the superposition of two…

Probability · Mathematics 2015-03-26 Folkmar Bornemann , Peter J. Forrester