English
Related papers

Related papers: Distortion mismatch in the quantization of probabi…

200 papers

A number of engineering and scientific problems require representing and manipulating probability distributions over large alphabets, which we may think of as long vectors of reals summing to $1$. In some cases it is required to represent…

Information Theory · Computer Science 2023-10-27 Aviv Adler , Jennifer Tang , Yury Polyanskiy

Quantization for a Borel probability measure refers to the idea of estimating a given probability by a discrete probability with support containing a finite number of elements. In this paper, we have considered a Borel probability measure…

Information Theory · Computer Science 2025-05-28 Megha Pandey , Mrinal Kanti Roychowdhury

Let $\mu$ be an Ahlfors-David probability measure on $\mathbb{R}^q$, namely, there exist some constants $s_0>0$ and $\epsilon_0,C_1,C_2>0$ such that \[ C_1\epsilon^{s_0}\leq\mu(B(x,\epsilon))\leq…

Metric Geometry · Mathematics 2018-02-27 Sanguo Zhu

Properties of scalar quantization with $r$th power distortion and constrained R\'enyi entropy of order $\alpha\in (0,1)$ are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the R\'enyi…

Information Theory · Computer Science 2012-03-27 Wolfgang Kreitmeier , Tamas Linder

Unfolding problems often arise in the context of statistical data analysis. Such problematics occur when the probability distribution of a physical quantity is to be measured, but it is randomized (smeared) by some well understood process,…

Applications · Statistics 2016-12-09 Andras Laszlo

We extend our results in \cite{hislop_marx_1} on the quantitative continuity properties, with respect to the single-site probability measure, of the density of states measure and the integrated density of states for random Schr\"odinger…

Mathematical Physics · Physics 2020-02-19 P. D. Hislop , C. A. Marx

Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this…

Information Theory · Computer Science 2017-04-26 Emrah Akyol , Kenneth Rose

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

Motivated by the prevalence of environments in which data is abundant while resources for storage and/or transmission might be scarce, we study linear regression when predictors, their squares, and responses are subject to single-bit…

Statistics Theory · Mathematics 2026-04-01 Daniel Hill , Martin Slawski

The problem of mismatched guesswork considers the additional cost incurred by using a guessing function which is optimal for a distribution $q$ when the random variable to be guessed is actually distributed according to a different…

Information Theory · Computer Science 2023-05-09 Alexander Mariona , Homa Esfahanizadeh , Rafael G. L. D'Oliveira , Muriel Médard

This paper concerns the approximation of probability measures on $\mathbf{R}^d$ with respect to the Kullback-Leibler divergence. Given an admissible target measure, we show the existence of the best approximation, with respect to this…

Probability · Mathematics 2017-06-26 Yulong Lu , Andrew M. Stuart , Hendrik Weber

This paper studies fixed-rate randomized vector quantization under the constraint that the quantizer's output has a given fixed probability distribution. A general representation of randomized quantizers that includes the common models in…

Information Theory · Computer Science 2016-11-15 Naci Saldi , Tamás Linder , Serdar Yüksel

We provide a complete picture of the upper quantization dimension in terms of the R\'enyi dimension by proving that the upper quantization dimension $\bar{D}_{r}(\nu)$ of order $r>0$ for an arbitrary compactly supported Borel probability…

Probability · Mathematics 2024-01-05 Marc Kesseböhmer , Aljoscha Niemann , Sanguo Zhu

This paper provides new error bounds on "consistent" reconstruction methods for signals observed from quantized random projections. Those signal estimation techniques guarantee a perfect matching between the available quantized data and a…

Information Theory · Computer Science 2016-04-21 Laurent Jacques

Optimization of distortion riskmetrics with distributional uncertainty has wide applications in finance and operations research. Distortion riskmetrics include many commonly applied risk measures and deviation measures, which are not…

Optimization and Control · Mathematics 2022-02-25 Silvana Pesenti , Qiuqi Wang , Ruodu Wang

We consider the problem of estimating the covariance matrix of a random vector by observing i.i.d samples and each entry of the sampled vector is missed with probability $p$. Under the standard $L_4-L_2$ moment equivalence assumption, we…

Statistics Theory · Mathematics 2024-06-17 Pedro Abdalla

This paper establishes the strict optimality in precision for frequency and distribution estimation under local differential privacy (LDP). We prove that a linear estimator with a symmetric and extremal configuration, and a constant support…

Information Theory · Computer Science 2026-03-24 Mingen Pan

We study the problem of quantization of discrete probability distributions, arising in universal coding, as well as other applications. We show, that in many situations this problem can be reduced to the covering problem for the unit…

Information Theory · Computer Science 2010-08-24 Yuriy A. Reznik

We derive optimal estimates in stochastic homogenization of linear elliptic equations in divergence form in dimensions $d\ge 2$. In previous works we studied the model problem of a discrete elliptic equation on $\mathbb{Z}^d$. Under the…

Analysis of PDEs · Mathematics 2014-09-03 Antoine Gloria , Felix Otto

We study the problem of estimating the score function of an unknown probability distribution $\rho^*$ from $n$ independent and identically distributed observations in $d$ dimensions. Assuming that $\rho^*$ is subgaussian and has a…

Statistics Theory · Mathematics 2024-06-13 Andre Wibisono , Yihong Wu , Kaylee Yingxi Yang