English
Related papers

Related papers: Minimax Hausdorff estimation of density level sets

200 papers

We consider a generalization of the classifier-based density-ratio estimation task to a quasiprobabilistic setting where probability densities can be negative. The problem with most loss functions used for this task is that they implicitly…

Machine Learning · Statistics 2025-12-24 Matthew Drnevich , Stephen Jiggins , Kyle Cranmer

Motivated by set estimation problems, we consider three closely related shape conditions for compact sets: positive reach, r-convexity and rolling condition. First, the relations between these shape conditions are analyzed. Second, we…

Statistics Theory · Mathematics 2011-10-21 Antonio Cuevas , Ricardo Fraiman , Beatriz Pateiro-López

In this paper, we consider adaptive estimation of an unknown planar compact, convex set from noisy measurements of its support function on a uniform grid. Both the problem of estimating the support function at a point and that of estimating…

Statistics Theory · Mathematics 2015-08-18 Tony Cai , Adityanand Guntuboyina , Yuting Wei

Estimating the ratio of two probability densities from finitely many observations of the densities is a central problem in machine learning and statistics with applications in two-sample testing, divergence estimation, generative modeling,…

Machine Learning · Computer Science 2024-03-12 Werner Zellinger , Stefan Kindermann , Sergei V. Pereverzyev

We present the first minimax risk bounds for estimators of the spectral measure in multivariate linear factor models, where observations are linear combinations of regularly varying latent factors. Non-asymptotic convergence rates are…

Statistics Theory · Mathematics 2024-11-12 Xuhui Zhang , Jose Blanchet , Youssef Marzouk , Viet Anh Nguyen , Sven Wang

We study the problem of estimating a mean pattern from a set of similar curves in the setting where the variability in the data is due to random geometric deformations and additive noise. We propose an estimator based on the notion of…

Statistics Theory · Mathematics 2013-06-12 Jérémie Bigot , Xavier Gendre

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

A wide array of machine learning problems are formulated as the minimization of the expectation of a convex loss function on some parameter space. Since the probability distribution of the data of interest is usually unknown, it is is often…

Optimization and Control · Mathematics 2019-05-27 Emilie Chouzenoux , Henri Gérard , Jean-Christophe Pesquet

In the context of density level set estimation, we study the convergence of general plug-in methods under two main assumptions on the density for a given level $\lambda$. More precisely, it is assumed that the density (i) is smooth in a…

Statistics Theory · Mathematics 2016-09-07 Philippe Rigollet , Régis Vert

We consider a circular deconvolution problem, in which the density $f$ of a circular random variable $X$ must be estimated nonparametrically based on an i.i.d. sample from a noisy observation $Y$ of $X$. The additive measurement error is…

Statistics Theory · Mathematics 2013-12-11 Jan Johannes , Maik Schwarz

We derive asymptotic theory for the plug-in estimate for density level sets under Hausdoff loss. Based on the asymptotic theory, we propose two bootstrap confidence regions for level sets. The confidence regions can be used to perform tests…

Methodology · Statistics 2016-09-06 Yen-Chi Chen , Christopher R. Genovese , Larry Wasserman

We focus on solving constrained convex optimization problems using mini-batch stochastic gradient descent. Dynamic sample size rules are presented which ensure a descent direction with high probability. Empirical results from two…

Optimization and Control · Mathematics 2017-08-03 Michael R. Metel

While the problem of estimating a probability density function (pdf) from its observations is classical, the estimation under additional shape constraints is both important and challenging. We introduce an efficient, geometric approach for…

Methodology · Statistics 2018-04-05 Sutanoy Dasgupta , Debdeep Pati , Ian H. Jermyn , Anuj Srivastava

The problem of the mean-square optimal estimation of the linear functionals which depend on the unknown values of a stochastic stationary sequence from observations of the sequence in special sets of points is considered. Formulas for…

Statistics Theory · Mathematics 2021-10-19 Oleksandr Masyutka , Mikhail Moklyachuk

We study the convergence properties, in Hellinger and related distances, of nonparametric density estimators based on measure transport. These estimators represent the measure of interest as the pushforward of a chosen reference…

Statistics Theory · Mathematics 2022-09-20 Sven Wang , Youssef Marzouk

Shape constrained densities are encountered in many nonparametric estimation problems. The classes of monotone or convex (and monotone) densities can be viewed as special cases of the classes of k-monotone densities. A density g is said to…

Statistics Theory · Mathematics 2007-06-13 Fadoua Balabdaoui , Jon A. Wellner

We study posterior contraction rates for mixing measures in homoscedastic location-scale mixture models with infinitely many components. While posterior convergence at the level of densities is well understood, ensuring convergence of the…

Statistics Theory · Mathematics 2026-05-11 Nicola Bariletto , Dung Le , Alessandro Rinaldo , Nhat Ho

The nonparametric regression with a random design model is considered. We want to recover the regression function at a point x where the design density is vanishing or exploding. Depending on assumptions on the regression function local…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas

We consider a family of algorithms that successively sample and minimize simple stochastic models of the objective function. We show that under reasonable conditions on approximation quality and regularity of the models, any such algorithm…

Optimization and Control · Mathematics 2018-08-28 Damek Davis , Dmitriy Drusvyatskiy

The estimation of a log-concave density on $\mathbb{R}^d$ represents a central problem in the area of nonparametric inference under shape constraints. In this paper, we study the performance of log-concave density estimators with respect to…

Statistics Theory · Mathematics 2015-09-29 Arlene K. H. Kim , Richard J. Samworth