English
Related papers

Related papers: Distortion mismatch in the quantization of probabi…

200 papers

We consider the problem of solving a distributed optimization problem using a distributed computing platform, where the communication in the network is limited: each node can only communicate with its neighbours and the channel has a…

Systems and Control · Computer Science 2015-04-10 Ye Pu , Melanie N. Zeilinger , Colin N. Jones

The quantization problem looks for best approximations of a probability measure on a given metric space by finitely many points, where the approximation error is measured with respect to the Wasserstein distance. On particular smooth…

Metric Geometry · Mathematics 2025-05-22 Ata Deniz Aydin , Mikaela Iacobelli

We discuss situations where perturbing a probability measure on $\mathbb{R}^n$ does not deteriorate its Poincar\'e constant by much. A particular example is the symmetric exponential measure in $\mathbb{R}^n$, even log-concave perturbations…

Functional Analysis · Mathematics 2019-07-11 Franck Barthe , Bo'az Klartag

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

We explore the problem of distributed Hypothesis Testing (DHT) against independence, focusing specifically on Binary Symmetric Sources (BSS). Our investigation aims to characterize the optimal quantizer among binary linear codes, with the…

Information Theory · Computer Science 2024-10-23 Fatemeh Khaledian , Reza Asvadi , Elsa Dupraz , Tad Matsumoto

In this paper we develop rate--optimal estimation procedures in the problem of estimating the $L_p$--norm, $p\in (0, \infty)$ of a probability density from independent observations. The density is assumed to be defined on $R^d$, $d\geq 1$…

Statistics Theory · Mathematics 2020-08-26 Alexander Goldenshluger , Oleg Lepski

We consider the problem of estimating the factors of a low-rank $n \times d$ matrix, when this is corrupted by additive Gaussian noise. A special example of our setting corresponds to clustering mixtures of Gaussians with equal (known)…

Statistics Theory · Mathematics 2022-11-02 Andrea Montanari , Yuchen Wu

Let $P:=\frac 1 3 P\circ S_1^{-1}+\frac 13 P\circ S_2^{-1}+\frac 13\nu$, where $S_1(x)=\frac 15 x$, $S_2(x)=\frac 1 5 x+\frac 45$ for all $x\in \mathbb R$, and $\nu$ be a Borel probability measure on $\mathbb R$ with compact support. Such a…

Dynamical Systems · Mathematics 2018-04-05 Mrinal Kanti Roychowdhury

Given $\epsilon \in (0,1)$, a probability measure $\mu$ on $\Omega\subset\mathbb{R}^p$ and a semi-algebraic set $K\subset X\times\Omega$, we consider the feasible set $X^*_\epsilon=\{x\in X:{\rm Prob}[(x,\omega)\in K]\geq 1-\epsilon\}$…

Optimization and Control · Mathematics 2017-05-17 Jean-Bernard Lasserre

Quantization for a probability distribution refers to the idea of estimating a given probability by a discrete probability supported by a finite set. In this article, we consider a probability distribution generated by an infinite system of…

Dynamical Systems · Mathematics 2022-04-26 Dogan Comez , Mrinal Kanti Roychowdhury

Optimal state estimation for linear discrete-time systems is considered. Motivated by the literature on differential privacy, the measurements are assumed to be corrupted by Laplace noise. The optimal least mean square error estimate of the…

Optimization and Control · Mathematics 2016-09-02 Farhad Farokhi , Jezdimir Milosevic , Henrik Sandberg

We approximate the uniform measure on an equilateral triangle by a measure supported on $n$ points. We find the optimal sets of points ($n$-means) and corresponding approximation (quantization) error for $n\leq4$, give numerical…

Information Theory · Computer Science 2017-02-16 Carl P. Dettmann , Mrinal Kanti Roychowdhury

We study the problem of estimating a distribution over a finite alphabet from an i.i.d. sample, with accuracy measured in relative entropy (Kullback-Leibler divergence). While optimal bounds on the expected risk are known, high-probability…

Statistics Theory · Mathematics 2026-02-27 Jaouad Mourtada

In the present contribution we establish quantitative results on the periodic approximation of the corrector equation for the stochastic homogenization of linear elliptic equations in divergence form, when the diffusion coefficients satisfy…

Numerical Analysis · Mathematics 2014-09-04 Antoine Gloria , Felix Otto

Error estimates on parton density distributions are presently based on the traditional method of least squares minimisation and linear error propagation in global QCD fits. We review the underlying assumptions and the various mathematical…

High Energy Physics - Phenomenology · Physics 2008-11-26 M. Botje

We study parametric inference for diffusion processes when observations occur nonsynchronously and are contaminated by market microstructure noise. We construct a quasi-likelihood function and study asymptotic mixed normality of…

Statistics Theory · Mathematics 2015-12-29 Teppei Ogihara

We give oracle inequalities on procedures which combines quantization and variable selection via a weighted Lasso $k$-means type algorithm. The results are derived for a general family of weights, which can be tuned to size the influence of…

Statistics Theory · Mathematics 2016-07-07 Clément Levrard

We study the problem of discrete distribution estimation in KL divergence and provide concentration bounds for the Laplace estimator. We show that the deviation from mean scales as $\sqrt{k}/n$ when $n \ge k$, improving upon the best prior…

Machine Learning · Statistics 2023-06-14 Clément L. Canonne , Ziteng Sun , Ananda Theertha Suresh

It is known that for a $\rho$-weighted $L_q$-approximation of single variable functions $f$ with the $r$th derivatives in a $\psi$-weighted $L_p$ space, the minimal error of approximations that use $n$ samples of $f$ is proportional to…

Numerical Analysis · Mathematics 2019-07-10 P. Kritzer , F. Pillichshammer , L. Plaskota , G. W. Wasilkowski