English
Related papers

Related papers: Convergence bounds for local least squares approxi…

200 papers

We deal with the problem of the adaptive estimation of the $\mathbb{L}_2$-norm of a probability density on $\mathbb{R}^d$, $d\geq 1$, from independent observations. The unknown density is assumed to be uniformly bounded and to belong to the…

Statistics Theory · Mathematics 2024-05-28 Galatia Cleanthous , Athanasios G. Georgiadis , Oleg V. Lepski

We address the problem of producing a lower bound for the mean of a discrete probability distribution, with known support over a finite set of real numbers, from an iid sample of that distribution. Up to a constant, this is equivalent to…

Statistics Theory · Mathematics 2025-02-25 Erik Learned-Miller

Minimax lower bounds are pessimistic in nature: for any given estimator, minimax lower bounds yield the existence of a worst-case target vector $\beta^*_{worst}$ for which the prediction error of the given estimator is bounded from below.…

Statistics Theory · Mathematics 2017-10-10 Pierre C Bellec

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

Machine Learning · Statistics 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

``Localization'' has proven to be a valuable tool in the Statistical Learning literature as it allows sharp risk bounds in terms of the problem geometry. Localized bounds seem to be much less exploited in the Stochastic Optimization…

Optimization and Control · Mathematics 2023-03-30 Roberto I. Oliveira , Philip Thompson

We prove a bound on the finite sample error of sequential Monte Carlo (SMC) on static spaces using the $L_2$ distance between interpolating distributions and the mixing times of Markov kernels. This result is unique in that it is the first…

Computation · Statistics 2025-08-26 Joe Marion , Joseph Mathews , Scott C. Schmidler

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

Given a statistical model, the maximum likelihood degree is the number of complex solutions to the likelihood equations for generic data. We consider discrete algebraic statistical models and study the solutions to the likelihood equations…

Algebraic Geometry · Mathematics 2014-05-06 Elizabeth Gross , Jose Israel Rodriguez

We prove finite sample complexities for sequential Monte Carlo (SMC) algorithms which require only local mixing times of the associated Markov kernels. Our bounds are particularly useful when the target distribution is multimodal and global…

Computation · Statistics 2022-08-16 Joseph Mathews , Scott C. Schmidler

We study a version of the proximal gradient algorithm for which the gradient is intractable and is approximated by Monte Carlo methods (and in particular Markov Chain Monte Carlo). We derive conditions on the step size and the Monte Carlo…

Statistics Theory · Mathematics 2016-11-22 Yves F. Atchade , Gersende Fort , Eric Moulines

We show two novel concentration inequalities for suprema of empirical processes when sampling without replacement, which both take the variance of the functions into account. While these inequalities may potentially have broad applications…

Machine Learning · Statistics 2014-11-27 Ilya Tolstikhin , Gilles Blanchard , Marius Kloft

We present and analyze an algorithm for estimating the size, under a Gaussian or uniform measure, of a localized neighborhood in neural network parameter space with behavior similar to an ``anchor'' point. We refer to this as the "local…

Machine Learning · Computer Science 2025-04-09 Adam Scherlis , Nora Belrose

Monte Carlo planners can often return sub-optimal actions, even if they are guaranteed to converge in the limit of infinite samples. Known asymptotic regret bounds do not provide any way to measure confidence of a recommended action at the…

Artificial Intelligence · Computer Science 2021-11-04 John Mern , Mykel J. Kochenderfer

When dealing with difficult inverse problems such as inverse rendering, using Monte Carlo estimated gradients to optimise parameters can slow down convergence due to variance. Averaging many gradient samples in each iteration reduces this…

Graphics · Computer Science 2023-09-28 Martin Balint , Karol Myszkowski , Hans-Peter Seidel , Gurprit Singh

We study the problem of estimating a multivariate convex function defined on a convex body in a regression setting with random design. We are interested in optimal rates of convergence under a squared global continuous $l_2$ loss in the…

Statistics Theory · Mathematics 2016-01-27 Qiyang Han , Jon A. Wellner

One of the main problems in random network coding is to compute good lower and upper bounds on the achievable cardinality of the so-called subspace codes in the projective space $\mathcal{P}_q(n)$ for a given minimum distance. The…

Information Theory · Computer Science 2020-11-16 Tao Feng , Sascha Kurz , Shuangqing Liu

Sensitivity measures how much the output of an algorithm changes, in terms of Hamming distance, when part of the input is modified. While approximation algorithms with low sensitivity have been developed for many problems, no sensitivity…

Data Structures and Algorithms · Computer Science 2025-10-17 Noah Fleming , Yuichi Yoshida

In this paper, we generalize the property of local asymptotic normality (LAN) to an enlarged neighborhood, under the name of rescaled local asymptotic normality (RLAN). We obtain sufficient conditions for a regular parametric model to…

Statistics Theory · Mathematics 2020-12-02 Ning Ning , Edward Ionides , Ya'acov Ritov

Continuous level Monte Carlo is an unbiased, continuous version of the celebrated multilevel Monte Carlo method. The approximation level is assumed to be continuous resulting in a stochastic process describing the quantity of interest.…

Numerical Analysis · Mathematics 2024-02-19 Cedric Aaron Beschle , Andrea Barth

In many interesting situations the size of epsilon-nets depends only on $\epsilon$ together with different complexity measures. The aim of this paper is to give a systematic treatment of such complexity measures arising in Discrete and…

Computational Geometry · Computer Science 2021-01-05 Andrey Kupavskii , Nikita Zhivotovskiy