English
Related papers

Related papers: Fast rates for empirical vector quantization

200 papers

Optimal transport has emerged as a fundamental methodology with applications spanning multiple research areas in recent years. However, the convergence rate of the empirical estimator to its population counterpart suffers from the curse of…

Statistics Theory · Mathematics 2025-10-06 Jiaping Yang , Yunxin Zhang

We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points…

Machine Learning · Computer Science 2022-07-12 Ananda Theertha Suresh , Ziteng Sun , Jae Hun Ro , Felix Yu

This paper deals with the speed of convergence of the learning curve in a Gaussian process regression framework. The learning curve describes the average generalization error of the Gaussian process used for the regression. More…

Statistics Theory · Mathematics 2013-01-14 Loic Le Gratiet , Josselin Garnier

We consider the optimization of a quadratic objective function whose gradients are only accessible through a stochastic oracle that returns the gradient at any given point plus a zero-mean finite variance random error. We present the first…

Optimization and Control · Mathematics 2016-02-25 Aymeric Dieuleveut , Nicolas Flammarion , Francis Bach

In this article, we revisit the question of fluctuations of linear statistics of beta ensembles in the single cut and non-critical regime for general potentials $V$ under mild regularity and growth assumptions. Our main objective is to…

Probability · Mathematics 2024-03-27 Jürgen Angst , Ronan Herry , Dominique Malicet , Guillaume Poly

The problem of convergence of moments of a sequence of random variables to the moments of its asymptotic distribution is important in many applications. These include the determination of the optimal training sample size in the cross…

Probability · Mathematics 2018-06-14 Georgios Afendras , Marianthi Markatou

We derive limiting distributions of symmetrized estimators of scatter, where instead of all $n(n-1)/2$ pairs of the $n$ observations we only consider $nd$ suitably chosen pairs, $1 \le d < \lfloor n/2\rfloor$. It turns out that the…

Statistics Theory · Mathematics 2023-08-21 Lutz Duembgen , Klaus Nordhausen

We consider the time evolution of quantum states by many-body Schr\"odinger dynamics and study the rate of convergence of their reduced density matrices in the mean field limit. If the prepared state at initial time is of coherent or…

Mathematical Physics · Physics 2016-06-01 Zied Ammari , Marco Falconi , Boris Pawilowski

This paper gives a theoretical analysis of high dimensional linear discrimination of Gaussian data. We study the excess risk of linear discriminant rules. We emphasis on the poor performances of standard procedures in the case when…

Statistics Theory · Mathematics 2010-02-19 Robin Girard

We consider the problem of estimating a dose-response curve. Continuous treatments arise often in practice, e.g. in the form of time spent on an operation, distance traveled to a location or dosage of a drug. Letting $A$ denote a continuous…

Methodology · Statistics 2026-04-14 Matteo Bonvini , Edward H. Kennedy

We consider on-line density estimation with a parameterized density from the exponential family. The on-line algorithm receives one example at a time and maintains a parameter that is essentially an average of the past examples. After…

Machine Learning · Computer Science 2013-01-30 Katy S. Azoury , Manfred K. Warmuth

Given a smooth R^d-valued diffusion, we study how fast the Euler scheme with time step 1/n converges in law. To be precise, we look for which class of test functions f the approximate expectation E[f(X^{n,x}_1)] converges with speed 1/n to…

Probability · Mathematics 2007-07-10 Julien Guyon

Let $(X_i)_{i=1,...,n}$ be a possibly nonstationary sequence such that $\mathscr{L}(X_i)=P_n$ if $i\leq n\theta$ and $\mathscr{L}(X_i)=Q_n$ if $i>n\theta$, where $0<\theta <1$ is the location of the change-point to be estimated. We…

Statistics Theory · Mathematics 2009-09-29 Samir Ben Hariz , Jonathan J. Wylie , Qiang Zhang

We study the fundamental problem of estimating the mean of a $d$-dimensional distribution with covariance $\Sigma \preccurlyeq \sigma^2 I_d$ given $n$ samples. When $d = 1$, \cite{catoni} showed an estimator with error $(1+o(1)) \cdot…

Statistics Theory · Mathematics 2024-02-20 Shivam Gupta , Samuel B. Hopkins , Eric Price

The law of large numbers for the empirical density for the pairs of uniformly distributed integers with a given greatest common divisor is a classic result in number theory. In this paper, we study the large deviations of the empirical…

Probability · Mathematics 2016-10-07 Behzad Mehrdad , Lingjiong Zhu

We propose a novel framework for exploring weak and $L_2$ generalization errors of algorithms through the lens of differential calculus on the space of probability measures. Specifically, we consider the KL-regularized empirical risk…

Machine Learning · Statistics 2023-06-21 Gholamali Aminian , Samuel N. Cohen , Łukasz Szpruch

Score-based diffusion models, while achieving minimax optimality for sampling, are often hampered by slow sampling speeds due to the high computational burden of score function evaluations. Despite the recent remarkable empirical advances…

Machine Learning · Computer Science 2025-02-27 Gen Li , Changxiao Cai

We study the Wasserstein distance $W_2$ for Gaussian samples. We establish the exact rate of convergence $\sqrt{\log\log n/n}$ of the expected value of the $W_2$ distance between the empirical and true $c.d.f.$'s for the normal…

Probability · Mathematics 2020-01-28 Philippe Berthet , Jean-Claude Fort

We propose a strategy to achieve the fastest convergence in the Wang-Landau algorithm with varying modification factors. With this strategy, the convergence of a simulation is at least as good as the conventional Monte Carlo algorithm, i.e.…

Statistical Mechanics · Physics 2008-10-24 Chenggang Zhou , Jia Su

Analysis of the convergence rates of modern convex optimization algorithms can be achived through binary means: analysis of emperical convergence, or analysis of theoretical convergence. These two pathways of capturing information diverge…

Machine Learning · Computer Science 2013-05-20 Patrick Hop , Xinghao Pan
‹ Prev 1 3 4 5 6 7 10 Next ›