English
Related papers

Related papers: Manifold-adaptive dimension estimation revisited

200 papers

A common observation in data-driven applications is that high-dimensional data have a low intrinsic dimension, at least locally. In this work, we consider the problem of point estimation for manifold-valued data. Namely, given a finite set…

Statistics Theory · Mathematics 2025-03-11 Yariv Aizenbud , Barak Sober

In this paper, we address the problem of estimating a multidimensional density $f$ by using indirect observations from the statistical model $Y=X+\varepsilon$. Here, $\varepsilon$ is a measurement error independent of the random vector $X$…

Statistics Theory · Mathematics 2015-05-15 Gilles Rebelles

While classical data analysis has addressed observations that are real numbers or elements of a real vector space, at present many statistical problems of high interest in the sciences address the analysis of data that consist of more…

Statistics Theory · Mathematics 2023-08-15 Zhigang Yao , Jiaji Su , Bingjie Li , Shing-Tung Yau

Given a random sample from some unknown density $f_0: \mathbb R \to [0, \infty)$ we devise Haar wavelet estimators for $f_0$ with variable resolution levels constructed from localised test procedures (as in Lepski, Mammen, and Spokoiny…

Statistics Theory · Mathematics 2012-02-23 Florian Gach , Richard Nickl , Vladimir Spokoiny

Manifold learning approaches seek the intrinsic, low-dimensional data structure within a high-dimensional space. Mainstream manifold learning algorithms, such as Isomap, UMAP, $t$-SNE, Diffusion Map, and Laplacian Eigenmaps do not use data…

Machine Learning · Statistics 2023-07-04 Jake S. Rhodes

We develop a family of infinite-dimensional Banach manifolds of measures on an abstract measurable space, employing charts that are "balanced" between the density and log-density functions. The manifolds, $(\tilde{M}_{\lambda},\lambda\in…

Probability · Mathematics 2016-02-10 Nigel J. Newton

The present paper solves the problem of local linear approximation of the Fr\'echet conditional mean in an extrinsic and intrinsic way from time correlated bivariate curve data evaluated in a manifold (see Torres et al, 2025, on global…

Statistics Theory · Mathematics 2025-10-06 M. D. Ruiz-Medina , A. Torres-Signes

Modern datasets often contain high-dimensional features exhibiting complex dependencies. To effectively analyze such data, dimensionality reduction methods rely on estimating the dataset's intrinsic dimension (id) as a measure of its…

Machine Learning · Computer Science 2025-10-21 Dhruv Gupta , Aditya Nagarsekar , Vraj Shah , Sujith Thomas

Learning an individualized dose rule in personalized medicine is a challenging statistical problem. Existing methods often suffer from the curse of dimensionality, especially when the decision function is estimated nonparametrically. To…

Methodology · Statistics 2021-10-22 Wenzhuo Zhou , Ruoqing Zhu , Donglin Zeng

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from…

Cosmology and Nongalactic Astrophysics · Physics 2018-04-11 Justin Alsing , Benjamin Wandelt , Stephen Feeney

While many phenomena in physics and engineering are formally high-dimensional, their long-time dynamics often live on a lower-dimensional manifold. The present work introduces an autoencoder framework that combines implicit regularization…

Machine Learning · Computer Science 2023-12-07 Kevin Zeng , Carlos E. Pérez De Jesús , Andrew J. Fox , Michael D. Graham

We study likelihood-based inference for the anisotropic hyperbolic wrapped normal distribution on standard hyperbolic space. The model has a manifold-valued location parameter and a full positive definite covariance matrix in tangent…

Statistics Theory · Mathematics 2026-05-04 Kisung You

In unsupervised anomaly detection (UAD) research, while state-of-the-art models have reached a saturation point with extensive studies on public benchmark datasets, they adopt large-scale tailor-made neural networks (NN) for detection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 YeongHyeon Park , Sungho Kang , Myung Jin Kim , Hyeong Seok Kim , Juneho Yi

An additive autoencoder for dimension reduction, which is composed of a serially performed bias estimation, linear trend estimation, and nonlinear residual estimation, is proposed and analyzed. Computational experiments confirm that an…

Machine Learning · Computer Science 2022-10-14 Tommi Kärkkäinen , Jan Hänninen

Functional data analysis (FDA) methods have computational and theoretical appeals for some high dimensional data, but lack the scalability to modern large sample datasets. To tackle the challenge, we develop randomized algorithms for two…

Computation · Statistics 2022-04-11 Shiyuan He , Xiaomeng Yan

Datasets such as images, text, or movies are embedded in high-dimensional spaces. However, in important cases such as images of objects, the statistical structure in the data constrains samples to a manifold of dramatically lower…

Machine Learning · Computer Science 2019-10-29 Stefano Recanatesi , Matthew Farrell , Madhu Advani , Timothy Moore , Guillaume Lajoie , Eric Shea-Brown

This paper proposes new ANOVA-based approximations of functions and emulators of high-dimensional models using either available derivatives or local stochastic evaluations of such models. Our approach makes use of sensitivity indices to…

Statistics Theory · Mathematics 2025-03-18 Matieyendou Lamboni

A common observation in data-driven applications is that high dimensional data has a low intrinsic dimension, at least locally. In this work, we consider the problem of estimating a $d$ dimensional sub-manifold of $\mathbb{R}^D$ from a…

Statistics Theory · Mathematics 2021-07-21 Yariv Aizenbud , Barak Sober

We present novel algorithms for simulation optimization using random directions stochastic approximation (RDSA). These include first-order (gradient) as well as second-order (Newton) schemes. We incorporate both continuous-valued as well as…

Optimization and Control · Mathematics 2015-08-11 Prashanth L. A. , Shalabh Bhatnagar , Michael Fu , Steve Marcus

Estimating intrinsic dimensionality of data is a classic problem in pattern recognition and statistics. Principal Component Analysis (PCA) is a powerful tool in discovering dimensionality of data sets with a linear structure; it, however,…

Computer Vision and Pattern Recognition · Computer Science 2010-02-11 Mingyu Fan , Nannan Gu , Hong Qiao , Bo Zhang