English
Related papers

Related papers: Sharp variance-entropy comparison for nonnegative …

200 papers

We prove non-universality results for first-passage percolation on the configuration model with i.i.d. degrees having infinite variance. We focus on the weight of the optimal path between two uniform vertices. Depending on the properties of…

Probability · Mathematics 2015-06-04 Enrico Baroni , Remco van der Hofstad , Julia Komjathy

Let $ X_1, \ldots, X_n $ be independent random variables taking values in the alphabet $ \{0, 1, \ldots, r\} $, and $ S_n = \sum_{i = 1}^n X_i $. The Shepp--Olkin theorem states that, in the binary case ($ r = 1 $), the Shannon entropy of $…

Information Theory · Computer Science 2022-05-10 Mladen Kovačević

We consider robust covariance estimation with group symmetry constraints. Non-Gaussian covariance estimation, e.g., Tyler scatter estimator and Multivariate Generalized Gaussian distribution methods, usually involve non-convex minimization…

Machine Learning · Statistics 2013-06-19 Ilya Soloveychik , Ami Wiesel

The equivariant nonnegativity versus sums of squares question has been solved for any infinite series of essential reflection groups but type A. As a first step to a classification, we analyse $A_n$-invariant quartics. We prove that the…

Algebraic Geometry · Mathematics 2024-02-07 Sebastian Debus , Charu Goel , Salma Kuhlmann , Cordian Riener

We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional…

Statistics Theory · Mathematics 2015-05-06 Ronen Eldan

We show that the uniform distribution minimizes entropy among all one-dimensional symmetric log-concave distributions with fixed variance, as well as various generalizations of this fact to R\'enyi entropies of orders less than 1 and with…

Information Theory · Computer Science 2021-10-20 Mokshay Madiman , Piotr Nayar , Tomasz Tkocz

We present sum-set inequalities specialized to the generalized degrees of freedom (GDoF) framework. These are information theoretic lower bounds on the entropy of bounded density linear combinations of discrete, power-limited dependent…

Information Theory · Computer Science 2017-08-25 Arash Gholami Davoodi , Syed A. Jafar

Statistical dependence measures like mutual information is ideal for analyzing autoencoders, but it can be ill-posed for deterministic, static, noise-free networks. We adopt the variational (Gaussian) formulation that makes dependence among…

Machine Learning · Computer Science 2026-03-24 Bo Hu , Jose C Principe

Generative Adversarial Networks (GANs) can produce high-quality samples, but do not provide an estimate of the probability density around the samples. However, it has been noted that maximizing the log-likelihood within an energy-based…

Machine Learning · Computer Science 2023-10-03 Omri Ben-Dov , Pravir Singh Gupta , Victoria Abrevaya , Michael J. Black , Partha Ghosh

In this letter we study the weak-convergence properties of random variables generated by unsharp quantum measurements. More precisely, for a sequence of random variables generated by repeated unsharp quantum measurements, we study the limit…

Quantum Physics · Physics 2020-08-12 Aleksandra Dimić , Borivoje Dakić

We introduce the concept of finite $\gamma$-scaled quadratic variation along a sequence of partitions for paths on a given interval. This concept, with historical roots in the study of Gaussian processes by Gladyshev (1961) and Klein \&…

Probability · Mathematics 2025-09-25 James-Michael Leahy , Torstein Nilssen

An extension of the entropy power inequality to the form $N_r^\alpha(X+Y) \geq N_r^\alpha(X) + N_r^\alpha(Y)$ with arbitrary independent summands $X$ and $Y$ in $\mathbb{R}^n$ is obtained for the R\'enyi entropy and powers $\alpha \geq…

Information Theory · Computer Science 2017-10-25 Sergey Bobkov , Arnaud Marsiglietti

We investigate the distribution of eigenvalues of weighted adjacency matrices from a specific ensemble of random graphs. We distribute $N$ vertices across a fixed number $\kappa$ of components, with asymptotically $\alpha_j \dot N$ vertices…

Mathematical Physics · Physics 2024-09-30 Valentin Vengerovsky

We study the Gaussian sequence model, i.e. $X \sim N(\mathbf{\theta}, I_\infty)$, where $\mathbf{\theta} \in \Gamma \subset \ell_2$ is assumed to be convex and compact. We show that goodness-of-fit testing sample complexity is lower bounded…

Statistics Theory · Mathematics 2025-11-03 Zeyu Jia , Yury Polyanskiy

We prove a new extremal inequality, motivated by the vector Gaussian broadcast channel and the distributed source coding with a single quadratic distortion constraint problems. As a corollary, this inequality yields a generalization of the…

Information Theory · Computer Science 2007-07-13 Tie Liu , Pramod Viswanath

Let $A=(a_{ij})\in M_n(\R)$ be an $n$ by $n$ symmetric stochastic matrix. For $p\in [1,\infty)$ and a metric space $(X,d_X)$, let $\gamma(A,d_X^p)$ be the infimum over those $\gamma\in (0,\infty]$ for which every $x_1,...,x_n\in X$ satisfy…

Metric Geometry · Mathematics 2013-10-22 Assaf Naor

We investigate the norm of sums of independent vector-valued random variables in noncommutative Lp spaces. This allows us to obtain a uniform family of complete embeddings of the Schatten class Sq^n in Sp(lq^m) with optimal order m = n^2.…

Functional Analysis · Mathematics 2007-05-23 Marius Junge , Javier Parcet

Consider a log-correlated Gaussian field $\Gamma$ and its associated imaginary multiplicative chaos $:e^{i \beta \Gamma}:$ where $\beta$ is a real parameter. In [AJJ22], we showed that for any nonzero test function $f$, the law of $\int f…

Probability · Mathematics 2025-12-01 Juhan Aru , Antoine Jego , Janne Junnila

The complex Gaussian distribution has been widely used as a fundamental spectral and noise model in signal processing and communication. However, its Gaussian structure often limits its ability to represent the diverse amplitude…

Machine Learning · Statistics 2026-03-30 Toru Nakashika

We show that, under mild assumptions, the spectrum of a sum of independent random matrices is close to that of the Gaussian random matrix whose entries have the same mean and covariance. This nonasymptotic universality principle yields…

Probability · Mathematics 2024-06-26 Tatiana Brailovskaya , Ramon van Handel