English
Related papers

Related papers: Density estimation on an unknown submanifold

200 papers

In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide…

Methodology · Statistics 2018-12-06 Robert Bassett , James Sharpnack

Motivated by small bandwidth asymptotics for kernel-based semiparametric estimators in econometrics, this paper establishes Gaussian approximation results for high-dimensional fixed-order $U$-statistics whose kernels depend on the sample…

Statistics Theory · Mathematics 2025-10-15 Shunsuke Imai , Yuta Koike

Given a sample $\{X_i\}_{i=1}^n$ from $f_X$, we construct kernel density estimators for $f_Y$, the convolution of $f_X$ with a known error density $f_{\epsilon}$. This problem is known as density estimation with Berkson error and has…

Methodology · Statistics 2014-07-30 James P. Long , Noureddine El Karoui , John A. Rice

Dyadic data is often encountered when quantities of interest are associated with the edges of a network. As such it plays an important role in statistics, econometrics and many other data science disciplines. We consider the problem of…

Statistics Theory · Mathematics 2023-10-17 Matias D. Cattaneo , Yingjie Feng , William G. Underwood

We study the estimation, in Lp-norm, of density functions defined on [0,1]^d. We construct a new family of kernel density estimators that do not suffer from the so-called boundary bias problem and we propose a data-driven procedure based on…

Statistics Theory · Mathematics 2018-10-29 Karine Bertin , Salima El Kolei , Nicolas Klutchnikoff

The existing approaches to intrinsic dimension estimation usually are not reliable when the data are nonlinearly embedded in the high dimensional space. In this work, we show that the explicit accounting to geometric properties of unknown…

Machine Learning · Statistics 2019-04-15 Marina Gomtsyan , Nikita Mokrov , Maxim Panov , Yury Yanovich

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

We consider the problem of estimating the mixing density $f$ from $n$ i.i.d. observations distributed according to a mixture density with unknown mixing distribution. In contrast with finite mixtures models, here the distribution of the…

Statistics Theory · Mathematics 2015-05-26 Tabea Rebafka , François Roueff

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger

Function approximation based on data drawn randomly from an unknown distribution is an important problem in machine learning. The manifold hypothesis assumes that the data is sampled from an unknown submanifold of a high dimensional…

Machine Learning · Computer Science 2024-08-20 H. N. Mhaskar , Ryan O'Dowd

The traditional kernel density estimator of an unknown density is by construction completely nonparametric, in the sense that it has no preferences and will work reasonably well for all shapes. The present paper develops a class of…

Methodology · Statistics 2026-05-05 Nils Lid Hjort , Ingrid Kristine Glad

We construct a kernel density estimator on symmetric spaces of non-compact type and establish an upper bound for its convergence rate, analogous to the minimax rate for classical kernel density estimators on Euclidean space. Symmetric…

Statistics Theory · Mathematics 2022-06-30 Dena Marie Asta

In the manifold learning problem one seeks to discover a smooth low dimensional surface, i.e., a manifold embedded in a higher dimensional linear vector space, based on a set of measured sample points on the surface. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Jose Costa , Alfred Hero

We consider nonparametric measurement error density deconvolution subject to heteroscedastic measurement errors as well as symmetry about zero and shape constraints, in particular unimodality. The problem is motivated by applications where…

Methodology · Statistics 2020-02-19 Ya Su , Anirban Bhattacharya , Yan Zhang , Nilanjan Chatterjee , Raymond J. Carroll

Research on manifold learning within a density ridge estimation framework has shown great potential in recent work for both estimation and de-noising of manifolds, building on the intuitive and well-defined notion of principal curves and…

Machine Learning · Statistics 2016-04-11 Jonas Nordhaug Myhre , Matineh Shaker , Devrim Kaba , Robert Jenssen , Deniz Erdogmus

Diffusion models often generate novel samples even when the learned score is only \emph{coarse} -- a phenomenon not accounted for by the standard view of diffusion training as density estimation. In this paper, we show that, under the…

Machine Learning · Computer Science 2026-03-26 Zebang Shen , Ya-Ping Hsieh , Niao He

There is an intense and partly recent literature focussing on the problem of selecting the bandwidth parameter for kernel density estimators. Available methods are largely `very nonparametric', in the sense of not requiring any knowledge…

Methodology · Statistics 2026-02-17 Nils Lid Hjort

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

The spectral density function describes the second-order properties of a stationary stochastic process on $\mathbb{R}^d$. This paper considers the nonparametric estimation of the spectral density of a continuous-time stochastic process…

Statistics Theory · Mathematics 2023-02-07 Rafail Kartsioukas , Stilian Stoev , Tailen Hsing