English
Related papers

Related papers: Fast rates for noisy clustering

200 papers

We consider binary classification problems with positive definite kernels and square loss, and study the convergence rates of stochastic gradient methods. We show that while the excess testing loss (squared loss) converges slowly to zero as…

Machine Learning · Computer Science 2018-11-21 Loucas Pillaud-Vivien , Alessandro Rudi , Francis Bach

In the convolution model $Z\_i=X\_i+ \epsilon\_i$, we give a model selection procedure to estimate the density of the unobserved variables $(X\_i)\_{1 \leq i \leq n}$, when the sequence $(X\_i)\_{i \geq 1}$ is strictly stationary but not…

Statistics Theory · Mathematics 2016-08-16 Fabienne Comte , Jérôme Dedecker , Marie-Luce Taupin

The authors consider the problem of estimating the density $g$ of independent and identically distributed variables $X\_i$, from a sample $Z\_1, ..., Z\_n$ where $Z\_i=X\_i+\sigma\epsilon\_i$, $i=1, ..., n$, $\epsilon$ is a noise…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Yves Rozenholc , Marie-Luce Taupin

We consider the possibility of adding noise to a quantum circuit to make it efficiently simulatable classically. In previous works this approach has been used to derive upper bounds to fault tolerance thresholds - usually by identifying a…

Quantum Physics · Physics 2010-03-12 M. B. Plenio , S. Virmani

We derive upper bounds for random design linear regression with dependent ($\beta$-mixing) data absent any realizability assumptions. In contrast to the strictly realizable martingale noise regime, no sharp instance-optimal non-asymptotics…

Machine Learning · Computer Science 2023-10-30 Ingvar Ziemann , Stephen Tu , George J. Pappas , Nikolai Matni

We consider an approach to fault tolerant quantum computing based on a simple error detecting code operating as the substrate for a conventional surface code. We develop a customised decoder to process the information about the likely…

Quantum Physics · Physics 2019-12-11 Xiaosi Xu , Qi Zhao , Xiao Yuan , Simon C. Benjamin

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

Analysis of experimental data must sometimes deal with abrupt changes in the distribution of measured values. Setting upper limits on signals usually involves a veto procedure that excludes data not described by an assumed statistical…

General Relativity and Quantum Cosmology · Physics 2015-03-20 Vladimir Dergachev

In this paper we do a detailed numerical investigation of the fault-tolerant threshold for optical cluster-state quantum computation. Our noise model allows both photon loss and depolarizing noise, as a general proxy for all types of local…

Quantum Physics · Physics 2009-11-13 Christopher M. Dawson , Henry L. Haselgrove , Michael A. Nielsen

Valid causal inference in observational studies often requires controlling for confounders. However, in practice measurements of confounders may be noisy, and can lead to biased estimates of causal effects. We show that we can reduce the…

Machine Learning · Statistics 2018-06-05 Nathan Kallus , Xiaojie Mao , Madeleine Udell

Let $(X_{n,i})_{1\le i\le n,n\in\mathbb{N}}$ be a triangular array of row-wise stationary $\mathbb{R}^d$-valued random variables. We use a "blocks method" to define clusters of extreme values: the rows of $(X_{n,i})$ are divided into $m_n$…

Statistics Theory · Mathematics 2020-05-19 Holger Drees , Holger Rootzén

Let $\cF$ be a set of $M$ classification procedures with values in $[-1,1]$. Given a loss function, we want to construct a procedure which mimics at the best possible rate the best procedure in $\cF$. This fastest rate is called optimal…

Statistics Theory · Mathematics 2008-12-02 Guillaume Lecué

We use the presently observed number density of large X-ray clusters and the linear mass power spectra to constrain $\sigma_8$ and the redshift distortion parameter $\beta$, in both OCDM and $\Lambda$CDM models. The best fit to the observed…

Astrophysics · Physics 2009-10-31 Jiun-Huei Proty Wu

We derive a tight generalization bound for quantum machine learning that is applicable to a wide range of supervised tasks, data, and models. Our bound is both efficiently computable and free of big-O notation. Furthermore, we point out…

Quantum Physics · Physics 2025-10-29 Xin Wang , Rebing Wu

Motivated by a wide-spread use of convex optimization techniques, convexity properties of bit error rate of the maximum likelihood detector operating in the AWGN channel are studied for arbitrary constellations and bit mappings, which also…

Information Theory · Computer Science 2010-04-16 Sergey Loyka , Francois Gagnon , Victoria Kostina

Establishing a theoretical analysis that explains why deep learning can outperform shallow learning such as kernel methods is one of the biggest issues in the deep learning literature. Towards answering this question, we evaluate excess…

Machine Learning · Statistics 2020-12-08 Taiji Suzuki , Shunta Akiyama

This paper establishes the first almost sure convergence rate and the first maximal concentration bound with exponential tails for general contractive stochastic approximation algorithms with Markovian noise. As a corollary, we also obtain…

Machine Learning · Computer Science 2024-11-22 Xiaochi Qian , Zixuan Xie , Xinyu Liu , Shangtong Zhang

We study the convergence of a random iterative sequence of a family of operators on infinite dimensional Hilbert spaces, inspired by the Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless regression, as studied in [1].…

Functional Analysis · Mathematics 2022-09-02 Soumyadip Ghosh , Yingdong Lu , Tomasz J. Nowicki

We analyze the influence of long-range correlated (colored) external noise on extinction phase transitions in growth and spreading processes. Uncorrelated environmental noise (i.e., temporal disorder) was recently shown to give rise to an…

Statistical Mechanics · Physics 2018-08-15 Alexander H. O. Wada , Matthew Small , Thomas Vojta

To assess generalization, machine learning scientists typically either (i) bound the generalization gap and then (after training) plug in the empirical risk to obtain a bound on the true risk; or (ii) validate empirically on holdout data.…

Machine Learning · Computer Science 2021-11-09 Saurabh Garg , Sivaraman Balakrishnan , J. Zico Kolter , Zachary C. Lipton
‹ Prev 1 8 9 10 Next ›