English
Related papers

Related papers: Non-Parametric Estimation of Manifolds from Noisy …

200 papers

Likelihood-based deep generative models have recently been shown to exhibit pathological behaviour under the manifold hypothesis as a consequence of using high-dimensional densities to model data with low-dimensional structure. In this…

Manifold learning builds on the "manifold hypothesis," which posits that data in high-dimensional datasets are drawn from lower-dimensional manifolds. Current tools generate global embeddings of data, rather than the local maps used to…

Machine Learning · Computer Science 2025-08-28 Serena Hughes , Timothy Hamilton , Tom Kolokotrones , Eric J. Deeds

In this paper, we consider the fundamental problem of approximation of functions on a low-dimensional manifold embedded in a high-dimensional space, with noise affecting both in the data and values of the functions. Due to the curse of…

Numerical Analysis · Mathematics 2020-12-29 Shira Faigenbaum-Golovin , David Levin

We study the problem of overcoming exponential sample complexity in differential entropy estimation under Gaussian convolutions. Specifically, we consider the estimation of the differential entropy $h(X+Z)$ via $n$ independently and…

Information Theory · Computer Science 2023-05-12 Kristjan Greenewald , Brian Kingsbury , Yuancheng Yu

We define a stochastic variant of the proximal point algorithm in the general setting of nonlinear (separable) Hadamard spaces for approximating zeros of the mean of a stochastically perturbed monotone vector field and prove its convergence…

Optimization and Control · Mathematics 2025-10-14 Nicholas Pischke

Modern machine learning systems are increasingly trained on large amounts of data embedded in high-dimensional spaces. Often this is done without analyzing the structure of the dataset. In this work, we propose a framework to study the…

Machine Learning · Computer Science 2023-04-27 Carlos Hurtado , Sarath Shekkizhar , Javier Ruiz-Hidalgo , Antonio Ortega

Many of the tools available for robot learning were designed for Euclidean data. However, many applications in robotics involve manifold-valued data. A common example is orientation; this can be represented as a 3-by-3 rotation matrix or a…

Robotics · Computer Science 2024-05-15 P. C. Lopez-Custodio , K. Bharath , A. Kucukyilmaz , S. P. Preston

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell

We propose an extrinsic regression framework for modeling data with manifold valued responses and Euclidean predictors. Regression with manifold responses has wide applications in shape analysis, neuroscience, medical imaging and many other…

Statistics Theory · Mathematics 2015-08-11 Lizhen Lin , Brian St. Thomas , Hongtu Zhu , David B. Dunson

A popular class of problem in statistics deals with estimating the support of a density from $n$ observations drawn at random from a $d$-dimensional distribution. The one-dimensional case reduces to estimating the end points of a univariate…

Statistics Theory · Mathematics 2018-04-27 Victor-Emmanuel Brunel , Jason M. Klusowski , Dana Yang

In the realm of continual learning, the presence of noisy labels within data streams represents a notable obstacle to model reliability and fairness. We focus on the data stream scenario outlined in pertinent literature, characterized by…

Machine Learning · Computer Science 2024-04-09 Yu-Hsi Chen

We study the problem of PAC learning $\gamma$-margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is known to be $\widetilde{\Theta}(1/(\gamma^2…

Machine Learning · Computer Science 2025-01-17 Ilias Diakonikolas , Nikos Zarifis

We study denoising score matching (DSM) when the latent distribution is supported on a smooth embedded manifold $M \subset \mathbb{R}^D$. Under ambient Gaussian corruption, the tangent denoising target contains a singular normal-fiber noise…

Machine Learning · Statistics 2026-05-28 Divit Rawal

Score-based diffusion models are a highly effective method for generating samples from a distribution of images. We consider scenarios where the training data comes from a noisy version of the target distribution, and present an efficiently…

Machine Learning · Statistics 2025-09-30 Dennis Elbrächter , Giovanni S. Alberti , Matteo Santacesaria

We consider the two-dimensional multi-target detection (MTD) problem of estimating a target image from a noisy measurement that contains multiple copies of the image, each randomly rotated and translated. The MTD model serves as a…

Signal Processing · Electrical Eng. & Systems 2022-05-17 Shay Kreymer , Amit Singer , Tamir Bendory

Measuring the Data analytically finds the intrinsic manifold in big data. First, Optimal Transport generates the tangent space at each data point from which the intrinsic dimension is revealed. Then, the Koopman Dimensionality Reduction…

Machine Learning · Computer Science 2025-04-04 Ido Cohen

Manifold-valued parameters routinely arise in modern statistical applications such as in medical imaging, robotics, and computer vision, to name a few. While traditional Bayesian approaches are applicable to such settings by considering an…

Methodology · Statistics 2026-01-27 Rong Tang , Anirban Bhattacharya , Debdeep Pati , Yun Yang

This paper studies robust regression for data on Riemannian manifolds. Geodesic regression is the generalization of linear regression to a setting with a manifold-valued dependent variable and one or more real-valued independent variables.…

Machine Learning · Statistics 2022-01-26 Ha-Young Shin , Hee-Seok Oh

Nonparametric density estimation is an unsupervised learning problem. In this work we propose a two-step procedure that casts the density estimation problem in the first step into a supervised regression problem. The advantage is that we…

Statistics Theory · Mathematics 2024-06-04 Thijs Bos , Johannes Schmidt-Hieber

Score-based generative models are trained in high-dimensional ambient spaces, yet many data distributions are supported on low-dimensional nonlinear structures. We prove that, for compact $d$-dimensional smooth manifolds $\mathcal{M}…

Machine Learning · Computer Science 2026-05-18 Guoji Fu , Taiji Suzuki , Wee Sun Lee , Atsushi Nitanda