English
Related papers

Related papers: Fast rates for empirical vector quantization

200 papers

We establish global rates of convergence of the Maximum Likelihood Estimator (MLE) of a multivariate distribution function in the case of (one type of) "interval censored" data. The main finding is that the rate of convergence of the MLE in…

Statistics Theory · Mathematics 2013-01-01 Jon A. Wellner , Fuchang Gao

Let $X,X_1,X_2,\ldots$ be i.i.d. ${\mathbb{R}}^d$-valued real random vectors. Assume that ${\mathbf{E}X=0}$, $\operatorname {cov}X=\mathbb{C}$, $\mathbf{E}\Vert X\Vert^2=\sigma ^2$ and that $X$ is not concentrated in a proper subspace of…

Probability · Mathematics 2014-01-15 Friedrich Götze , Andrei Yu. Zaitsev

We obtain robust and computationally efficient estimators for learning several linear models that achieve statistically optimal convergence rate under minimal distributional assumptions. Concretely, we assume our data is drawn from a…

Machine Learning · Statistics 2020-12-07 Ainesh Bakshi , Adarsh Prasad

The basic goal of quantization for probability distribution is to reduce the number of values, which is typically uncountable, describing a probability distribution to some finite set and thus approximation of a continuous probability…

Probability · Mathematics 2021-01-27 Mrinal Kanti Roychowdhury

Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has…

Numerical Analysis · Mathematics 2015-06-11 Martin Burger , Jens Flemming , Bernd Hofmann

We construct exact confidence intervals for the average treatment effect in randomized experiments with binary outcomes using sequences of randomization tests. Our approach does not rely on large-sample approximations and is valid for all…

Methodology · Statistics 2026-02-25 Peng Zhang

The goal of this work is to obtain optimal rates for the convergence problem in mean field control. Our analysis covers cases where the solutions to the limiting problem may not be unique nor stable. Equivalently the value function of the…

Optimization and Control · Mathematics 2023-05-16 Samuel Daudin , François Delarue , Joe Jackson

In this paper, we prove optimal convergence rates results for regularisation methods for solving linear ill-posed operator equations in Hilbert spaces. The result generalises existing convergence rates results on optimality to general…

Functional Analysis · Mathematics 2015-11-11 Vinicius Albani , Peter Elbau , Maarten V. de Hoop , Otmar Scherzer

In this paper, the optimal convergence rate $O\left(N^{-1/2}\right)$ (where $N$ is the total number of iterations performed by the algorithm), without the presence of a logarithmic factor, is proved for mirror descent algorithms with…

Optimization and Control · Mathematics 2025-06-04 Mohammad Alkousa , Fedor Stonyakin , Asmaa Abdo , Mohammad Alcheikh

We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent…

Optimization and Control · Mathematics 2024-04-23 Yaqun Yang , Jinlong Lei

We derive a high-resolution formula for the quantization problem under Orlicz norm distortion. In this setting, the optimal point density solves a variational problem which comprises a function $g:\mathbb{R}_+\to[0,\infty)$ characterizing…

Probability · Mathematics 2010-10-21 Steffen Dereich , Christian Vormoor

We consider the variable-to-fixed length lossy source coding (VFSC) problem. The optimal compression rate of the average length of variable-to-fixed source coding, allowing a non-vanishing probability of excess-distortion $\varepsilon$, is…

Information Theory · Computer Science 2018-03-20 Lan V. Truong , Vincent Y. F. Tan

Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this…

Information Theory · Computer Science 2017-04-26 Emrah Akyol , Kenneth Rose

We derive optimal-order homogenization rates for random nonlinear elliptic PDEs with monotone nonlinearity in the uniformly elliptic case. More precisely, for a random monotone operator on $\mathbb{R}^d$ with stationary law (i.e. spatially…

Analysis of PDEs · Mathematics 2021-01-01 Julian Fischer , Stefan Neukamm

We show that repulsive random variables can yield Monte Carlo methods with faster convergence rates than the typical $N^{-1/2}$, where $N$ is the number of integrand evaluations. More precisely, we propose stochastic numerical quadratures…

Probability · Mathematics 2019-06-18 Rémi Bardenet , Adrien Hardy

He and Yuan's prediction-correction framework [SIAM J. Numer. Anal. 50: 700-709, 2012] is able to provide convergent algorithms for solving separable convex optimization problems at a rate of $O(1/t)$ ($t$ represents iteration times) in…

Optimization and Control · Mathematics 2024-02-06 Tao Zhang , Yong Xia , Shiru Li

Let $\{X, X_n, n\geq 1\}$ be a sequence of independent identically distributed non-degenerate random variables. Put $S_0=0, S_n = \sum^n_{i=1} X_i$ and $V_n^2=\sum^n_{i=1} X_i^2, n\ge 1.$ A weak convergence theorem is established for the…

Probability · Mathematics 2013-06-21 Miklós Csörgő , Zhishui Hu

Let $\Theta^{(n)}$ be a random vector uniformly distributed on the unit sphere $\mathbb S^{n-1}$ in $\mathbb R^n$. Consider the projection of the uniform distribution on the cube $[-1,1]^n$ to the line spanned by $\Theta^{(n)}$. The…

Probability · Mathematics 2021-09-21 Samuel G. G. Johnston , Zakhar Kabluchko , Joscha Prochno

In this paper, we have considered a uniform distribution on a regular polygon with $k$-sides for some $k\geq 3$ and the set of all its $k$ vertices as a conditional set. For the uniform distribution under the conditional set first, for all…

Probability · Mathematics 2025-05-21 Christina Hamilton , Evans Nyanney , Megha Pandey , Mrinal K. Roychowdhury

The AdaBoost algorithm was designed to combine many "weak" hypotheses that perform slightly better than random guessing into a "strong" hypothesis that has very low error. We study the rate at which AdaBoost iteratively converges to the…

Optimization and Control · Mathematics 2011-06-30 Indraneel Mukherjee , Cynthia Rudin , Robert E. Schapire