English
Related papers

Related papers: Fast rates for noisy clustering

200 papers

For $V : \mathbb{R}^d \to \mathbb{R}$ coercive, we study the convergence rate for the $L^1$-distance of the empiric minimizer, which is the true minimum of the function $V$ sampled with noise with a finite number $n$ of samples, to the…

Statistics Theory · Mathematics 2023-03-09 Pierre Bras

We study the statistical limits of both detecting and estimating a rank-one deformation of a symmetric random Gaussian tensor. We establish upper and lower bounds on the critical signal-to-noise ratio, under a variety of priors for the…

Probability · Mathematics 2017-01-25 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira

We propose a new analysis framework for clustering $M$ items into an unknown number of $K$ distinct groups using noisy and actively collected responses. At each time step, an agent is allowed to query pairs of items and observe bandit…

Machine Learning · Computer Science 2026-02-06 Rachel S. Y. Teo , P. N. Karthik , Ramya Korlakai Vinayak , Vincent Y. F. Tan

Next-generation ground-based gravitational-wave observatories such as the Einstein Telescope and Cosmic Explorer will detect $O(10^{5}-10^{6})$ signals from compact binary coalescences every year, the exact number depending on uncertainties…

General Relativity and Quantum Cosmology · Physics 2023-07-06 Luca Reali , Andrea Maselli , Emanuele Berti

Recent results in quantization theory show that the mean-squared expected distortion can reach a rate of convergence of $\mathcal{O}(1/n)$, where $n$ is the sample size [see, e.g., IEEE Trans. Inform. Theory 60 (2014) 7279-7292 or Electron.…

Statistics Theory · Mathematics 2015-04-02 Clément Levrard

This Note presents original rates of convergence for the deconvolution problem. We assume that both the estimated density and noise density are supersmooth and we compute the risk for two kinds of estimators.

Statistics Theory · Mathematics 2009-09-29 Claire Lacour

We obtain estimation error rates for estimators obtained by aggregation of regularized median-of-means tests, following a construction of Le Cam. The results hold with exponentially large probability -- as in the gaussian framework with…

Statistics Theory · Mathematics 2017-07-19 Lecué Guillaume , Lerasle Matthieu

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

We estimate the Hurst parameter $H \in (0,1)$ of a fractional Brownian motion from discrete noisy data, observed along a high frequency sampling scheme. When the intensity $\tau_n$ of the noise is smaller in order than $n^{-H}$ we establish…

Statistics Theory · Mathematics 2022-05-27 Grégoire Szymanski

We consider the problem of detecting a small subset of defective items from a large set via non-adaptive "random pooling" group tests. We consider both the case when the measurements are noiseless, and the case when the measurements are…

Information Theory · Computer Science 2011-07-25 Chun Lam Chan , Pak Hou Che , Sidharth Jaggi , Venkatesh Saligrama

System identification is a fundamental problem in control and learning, particularly in high-stakes applications where data efficiency is critical. Classical approaches, such as the ordinary least squares estimator (OLS), achieve an…

Systems and Control · Electrical Eng. & Systems 2025-06-12 Xiong Zeng , Jing Yu , Necmiye Ozay

In statistical learning theory, generalization error is used to quantify the degree to which a supervised machine learning algorithm may overfit to training data. Recent work [Xu and Raginsky (2017)] has established a bound on the…

Machine Learning · Computer Science 2018-01-16 Ankit Pensia , Varun Jog , Po-Ling Loh

We prove a lower bound on the excess risk of sparse interpolating procedures for linear regression with Gaussian data in the overparameterized regime. We apply this result to obtain a lower bound for basis pursuit (the minimum $\ell_1$-norm…

Machine Learning · Statistics 2022-03-21 Niladri S. Chatterji , Philip M. Long

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

In this paper, we study the estimation performance of empirical $\ell_2$ risk minimization (ERM) in noisy (standard) phase retrieval (NPR) given by $y_k = |\alpha_k^*x_0|^2+\eta_k$, or noisy generalized phase retrieval (NGPR) formulated as…

Machine Learning · Statistics 2022-06-29 Junren Chen , Michael K. Ng

This paper presents a systematic numerical study of the effects of noise on the invariant probability densities of dynamical systems with varying degrees of hyperbolicity. It is found that the rate of convergence of invariant densities in…

Dynamical Systems · Mathematics 2009-11-10 Kevin K. Lin

Numerous studies have shown that label noise can lead to poor generalization performance, negatively affecting classification accuracy. Therefore, understanding the effectiveness of classifiers trained using deep neural networks in the…

Machine Learning · Computer Science 2026-03-10 Haixia Liu , Boxiao Li , Can Yang , Yang Wang

We design and mathematically analyze sampling-based algorithms for regularized loss minimization problems that are implementable in popular computational models for large data, in which the access to the data is restricted in some way. Our…

Machine Learning · Computer Science 2019-06-04 Ryan R. Curtin , Sungjin Im , Ben Moseley , Kirk Pruhs , Alireza Samadian

This paper considers the problem of recovering the permutation of an n-dimensional random vector X observed in Gaussian noise. First, a general expression for the probability of error is derived when a linear decoder (i.e., linear estimator…

Information Theory · Computer Science 2021-05-10 Minoh Jeong , Alex Dytso , Martina Cardone