English
Related papers

Related papers: Minimax Manifold Estimation

200 papers

This paper presents minimax rates for density estimation when the data dimension $d$ is allowed to grow with the number of observations $n$ rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which…

Statistics Theory · Mathematics 2017-08-16 Daniel J. McDonald

We consider minimizing a nonconvex, smooth function $f$ on a Riemannian manifold $\mathcal{M}$. We show that a perturbed version of Riemannian gradient descent algorithm converges to a second-order stationary point (and hence is able to…

Optimization and Control · Mathematics 2019-06-19 Yue Sun , Nicolas Flammarion , Maryam Fazel

Let $X_t$ be the (reflecting) diffusion process generated by $L:=\Delta+\nabla V$ on a complete connected Riemannian manifold $M$ possibly with a boundary $\partial M$, where $V\in C^1(M)$ such that $\mu(d x):= e^{V(x)}d x$ is a probability…

Probability · Mathematics 2021-07-06 Feng-Yu Wang

We consider a problem of manifold estimation from noisy observations. Many manifold learning procedures locally approximate a manifold by a weighted average over a small neighborhood. However, in the presence of large noise, the assigned…

Statistics Theory · Mathematics 2022-02-07 Nikita Puchkin , Vladimir Spokoiny

We study the estimation of the reach, an ubiquitous regularity parameter in manifold estimation and geometric data analysis. Given an i.i.d. sample over an unknown $d$-dimensional $\mathcal{C}^k$-smooth submanifold of $\mathbb{R}^D$, we…

Statistics Theory · Mathematics 2022-07-14 Eddie Aamari , Clément Berenfeld , Clément Levrard

We investigate density estimation from a $n$-sample in the Euclidean space $\mathbb R^D$, when the data is supported by an unknown submanifold $M$ of possibly unknown dimension $d < D$ under a reach condition. We study nonparametric kernel…

Statistics Theory · Mathematics 2020-11-02 Clément Berenfeld , Marc Hoffmann

Consider the problem of estimating the $\gamma$-level set $G^*_{\gamma}=\{x:f(x)\geq\gamma\}$ of an unknown $d$-dimensional density function $f$ based on $n$ independent observations $X_1,...,X_n$ from the density. This problem has been…

Statistics Theory · Mathematics 2009-08-26 Aarti Singh , Clayton Scott , Robert Nowak

In any closed smooth Riemannian manifold of dimension at least three, we use the min-max construction to find anisotropic minimal hyper-surfaces with respect to elliptic integrands, with a singular set of codimension~$2$ vanishing Hausdorff…

Differential Geometry · Mathematics 2024-09-24 Guido De Philippis , Antonio De Rosa , Yangyang Li

High-dimensional data are ubiquitous, with examples ranging from natural images to scientific datasets, and often reside near low-dimensional manifolds. Leveraging this geometric structure is vital for downstream tasks, including signal…

Machine Learning · Statistics 2025-06-24 Yihan Shen , Shiyu Wang , Arnaud Lamy , Mariam Avagyan , John Wright

We prove that under some regularity and strong identifiability conditions, around a mixing distribution with $m_0$ components, the optimal local minimax rate of estimation of a mixture with $m$ components is $n^{-1/(4(m-m_0) + 2)}$. This…

Statistics Theory · Mathematics 2015-04-15 Philippe Heinrich , Jonas Kahn

In order to avoid the curse of dimensionality, frequently encountered in Big Data analysis, there was a vast development in the field of linear and nonlinear dimension reduction techniques in recent years. These techniques (sometimes…

Graphics · Computer Science 2020-02-27 Barak Sober , David Levin

A popular class of problem in statistics deals with estimating the support of a density from $n$ observations drawn at random from a $d$-dimensional distribution. The one-dimensional case reduces to estimating the end points of a univariate…

Statistics Theory · Mathematics 2018-04-27 Victor-Emmanuel Brunel , Jason M. Klusowski , Dana Yang

Maximum Variance Unfolding is one of the main methods for (nonlinear) dimensionality reduction. We study its large sample limit, providing specific rates of convergence under standard assumptions. We find that it is consistent when the…

Machine Learning · Statistics 2013-03-21 Ery Arias-Castro , Bruno Pelletier

We study the asymptotics of the expected Wasserstein distance between the empirical measure of a Point Process and the background volume form. The main DPP studied is the harmonic ensemble, where we get the optimal rate of convergence for…

Probability · Mathematics 2026-04-20 Pablo García-Arias

We consider the problem of recovering a $d-$dimensional manifold $\mathcal{M} \subset \mathbb{R}^n$ when provided with noiseless samples from $\mathcal{M}$. There are many algorithms (e.g., Isomap) that are used in practice to fit manifolds…

Statistics Theory · Mathematics 2017-09-13 Kitty Mohammed , Hariharan Narayanan

A common observation in data-driven applications is that high dimensional data has a low intrinsic dimension, at least locally. In this work, we consider the problem of estimating a $d$ dimensional sub-manifold of $\mathbb{R}^D$ from a…

Statistics Theory · Mathematics 2021-07-21 Yariv Aizenbud , Barak Sober

An important estimation problem that is closely related to large-scale multiple testing is that of estimating the null density and the proportion of nonnull effects. A few estimators have been introduced in the literature; however, several…

Statistics Theory · Mathematics 2010-01-12 T. Tony Cai , Jiashun Jin

A solution manifold is the collection of points in a $d$-dimensional space satisfying a system of $s$ equations with $s<d$. Solution manifolds occur in several statistical problems including hypothesis testing, curved-exponential families,…

Statistics Theory · Mathematics 2021-12-15 Yen-Chi Chen

We develop a technique for establishing lower bounds on the sample complexity of Least Squares (or, Empirical Risk Minimization) for large classes of functions. As an application, we settle an open problem regarding optimality of Least…

Statistics Theory · Mathematics 2020-06-09 Gil Kur , Alexander Rakhlin , Adityanand Guntuboyina

Let $\mathcal{M}$ be a smooth submanifold of $\mathbb{R}^n$ equipped with the Euclidean (chordal) metric. This note considers the smallest dimension $m$ for which there exists a bi-Lipschitz function $f: \mathcal{M} \mapsto \mathbb{R}^m$…

Numerical Analysis · Mathematics 2021-05-31 Mark Iwen , Arman Tavakoli , Benjamin Schmidt