English
Related papers

Related papers: Local Averaging Accurately Distills Manifold Struc…

200 papers

Autoencoders have demonstrated remarkable success in learning low-dimensional latent features of high-dimensional data across various applications. Assuming that data are sampled near a low-dimensional manifold, we employ chart…

Machine Learning · Statistics 2023-10-26 Hao Liu , Alex Havrilla , Rongjie Lai , Wenjing Liao

We investigate density estimation from a $n$-sample in the Euclidean space $\mathbb R^D$, when the data is supported by an unknown submanifold $M$ of possibly unknown dimension $d < D$ under a reach condition. We study nonparametric kernel…

Statistics Theory · Mathematics 2020-11-02 Clément Berenfeld , Marc Hoffmann

The denoising process of diffusion models can be interpreted as an approximate projection of noisy samples onto the data manifold. Moreover, the noise level in these samples approximates their distance to the underlying manifold. Building…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Abulikemu Abuduweili , Chenyang Yuan , Changliu Liu , Frank Permenter

This paper proposes a method for estimating a surface that contains a given set of points from noisy measurements. More precisely, by assuming that the surface is described by the zero set of a function in the span of a given set of…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Omar M. Sleem , Sahand Kiani , Constantino M. Lagoa

We consider the problem of positioning a cloud of points in the Euclidean space $\mathbb{R}^d$, using noisy measurements of a subset of pairwise distances. This task has applications in various areas, such as sensor network localization and…

Statistics Theory · Mathematics 2012-11-22 Adel Javanmard , Andrea Montanari

Manifold learning builds on the "manifold hypothesis," which posits that data in high-dimensional datasets are drawn from lower-dimensional manifolds. Current tools generate global embeddings of data, rather than the local maps used to…

Machine Learning · Computer Science 2025-08-28 Serena Hughes , Timothy Hamilton , Tom Kolokotrones , Eric J. Deeds

Locating a target is key in many applications, namely in high-stakes real-world scenarios, like detecting humans or obstacles in vehicular networks. In scenarios where precise statistics of the measurement noise are unavailable,…

Optimization and Control · Mathematics 2022-08-17 João Domingos , Cláudia Soares , João Xavier

We find the minimax rate of convergence in Hausdorff distance for estimating a manifold M of dimension d embedded in R^D given a noisy sample from the manifold. We assume that the manifold satisfies a smoothness condition and that the noise…

Machine Learning · Statistics 2011-09-29 Christopher Genovese , Marco Perone-Pacifico , Isabella Verdinelli , Larry Wasserman

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

This work is about parameter estimation for a fast-slow stochastic system with non-Gaussian $\alpha$-stable L\'evy noise. When the observations are only available for slow components, a system parameter is estimated and the accuracy for…

Dynamical Systems · Mathematics 2020-02-28 Ying Chao , Pingyuan Wei , Jinqiao Duan

Nonlocal patch-based methods, in particular the Bayes' approach of Lebrun, Buades and Morel (2013), are considered as state-of-the-art methods for denoising (color) images corrupted by white Gaussian noise of moderate variance. This paper…

Computer Vision and Pattern Recognition · Computer Science 2016-12-14 Friederike Laus , Mila Nikolova , Johannes Persch , Gabriele Steidl

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

Machine Learning · Computer Science 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

We consider the averaging process on the discrete $d$-dimensional torus. On this graph, the process is known to converge to equilibrium on diffusive timescales, not exhibiting cutoff. In this work, we refine this picture in two ways.…

Probability · Mathematics 2024-07-02 Federico Sau

This paper surveys and evaluates some popular state of the art methods for algorithmic curvature and normal estimation. In addition to surveying existing methods we also propose a new method for robust curvature estimation and evaluate it…

Computational Geometry · Computer Science 2023-06-02 Jared Spang

Let $\mathcal{M}$ be a compact manifold of $\mathbb{R}^d$. The goal of this paper is to decide, based on a sample of points, whether the interior of $\mathcal{M}$ is empty or not. We divide this work in two main parts. Firstly, under a…

Statistics Theory · Mathematics 2020-11-02 Nuno Picado , Paulo Eduardo Oliveira

Anomalies are samples that significantly deviate from the rest of the data and their detection plays a major role in building machine learning models that can be reliably used in applications such as data-driven design and novelty…

Machine Learning · Statistics 2023-06-19 Amin Yousefpour , Mehdi Shishehbor , Zahra Zanjani Foumani , Ramin Bostanabad

We study the recovery of geometric structure from data generated by convolving the uniform measure on a smooth compact submanifold $M\subset\mathbb{R}^D$ with ambient Gaussian noise. Our main result is that several fundamental Riemannian…

Statistics Theory · Mathematics 2026-03-31 Junhao Chen , Ruowei Li , Zhigang Yao

The inference stage of diffusion models can be seen as running a reverse-time diffusion stochastic differential equation, where samples from a Gaussian latent distribution are transformed into samples from a target distribution that usually…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Lorenzo Luzi , Paul M Mayer , Josue Casco-Rodriguez , Ali Siahkoohi , Richard G. Baraniuk

Despite a variety of available techniques the issue of the proper regularization parameter choice for inverse problems still remains one of the biggest challenges. The main difficulty lies in constructing a rule, allowing to compute the…

Numerical Analysis · Mathematics 2017-10-13 Ernesto De Vito , Massimo Fornasier , Valeriya Naumova

The Manifold Hypothesis is a widely accepted tenet of Machine Learning which asserts that nominally high-dimensional data are in fact concentrated near a low-dimensional manifold, embedded in high-dimensional space. This phenomenon is…

Methodology · Statistics 2025-03-24 Nick Whiteley , Annie Gray , Patrick Rubin-Delanchy