English
Related papers

Related papers: Nonparametric Score Estimators

200 papers

Generative models, like large language models, are becoming increasingly relevant in our daily lives, yet a theoretical framework to assess their generalization behavior and uncertainty does not exist. Particularly, the problem of…

Machine Learning · Computer Science 2024-07-11 Sebastian G. Gruber , Florian Buettner

We estimate the density and its derivatives using a local polynomial approximation to the logarithm of an unknown density $f$. The estimator is guaranteed to be nonnegative and achieves the same optimal rate of convergence in the interior…

Econometrics · Economics 2020-06-03 Joris Pinkse , Karl Schurter

In the context of a species sampling problem we discuss a non-parametric maximum likelihood estimator for the underlying probability mass function. The estimator is known in the computer science literature as the high profile estimator. We…

Statistics Theory · Mathematics 2018-01-12 Dragi Anevski , Richard D. Gill , Stefan Zohren

When a strict subset of covariates are given, we propose conditional quantile treatment effect to capture the heterogeneity of treatment effects via the quantile sheet that is the function of the given covariates and quantile. We focus on…

Statistics Theory · Mathematics 2020-09-23 Niwen Zhou , Xu Guo , Lixing Zhu

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative.…

Statistics Theory · Mathematics 2011-01-06 Bert van Es

The goal of nonparametric regression is to recover an underlying regression function from noisy observations, under the assumption that the regression function belongs to a pre-specified infinite dimensional function space. In the online…

Methodology · Statistics 2021-04-05 Tianyu Zhang , Noah Simon

We derive and analyze a generic, recursive algorithm for estimating all splits in a finite cluster tree as well as the corresponding clusters. We further investigate statistical properties of this generic clustering algorithm when it…

Machine Learning · Statistics 2021-11-02 Ingo Steinwart , Bharath K. Sriperumbudur , Philipp Thomann

We consider the problem of estimating the density of observations taking values in classical or nonclassical spaces such as manifolds and more general metric spaces. Our setting is quite general but also sufficiently rich in allowing the…

Probability · Mathematics 2019-02-12 G. Cleanthous , A. Georgiadis , G. Kerkyacharian , P. Petrushev , D. Picard

We study the problem of estimating the ridges of a density function. Ridge estimation is an extension of mode finding and is useful for understanding the structure of a density. It can also be used to find hidden structure in point cloud…

Statistics Theory · Mathematics 2014-08-29 Christopher R. Genovese , Marco Perone-Pacifico , Isabella Verdinelli , Larry Wasserman

Penalties that induce smoothness are common in nonparametric regression. In many settings, the amount of smoothness in the data generating function will not be known. Simon and Shojaie (2021) derived convergence rates for nonparametric…

Statistics Theory · Mathematics 2023-08-04 Marlena S. Bannick , Noah Simon

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most…

Methodology · Statistics 2014-04-30 Rafael Izbicki , Ann B. Lee , Chad M. Schafer

Reconstruction of sets from a random sample of points intimately related to them is the goal of set estimation theory. Within this context, a particular problem is the one related with the reconstruction of density level sets and…

Methodology · Statistics 2020-11-06 Paula Saavedra-Nieves , Rosa María Crujeiras

The standard definition of pedestrian density produces scattered values, hence, many approaches have been developed to improve the features of the estimated density. This paper provides a review of generally applied methods and presents a…

Physics and Society · Physics 2023-07-18 Jana Vacková , Marek Bukáček

This paper develops a nonparametric density estimator with parametric overtones. Suppose $f(x,\theta)$ is some family of densities, indexed by a vector of parameters $\theta$. We define a local kernel smoothed likelihood function which for…

Methodology · Statistics 2026-04-22 Nils Lid Hjort , M. C. Jones

Consistent weighted least square estimators are proposed for a wide class of nonparametric regression models with random regression function, where this real-valued random function of $k$ arguments is assumed to be continuous with…

Statistics Theory · Mathematics 2023-07-04 Yu. Yu. Linke , I. S. Borisov , P. S. Ruzankin

Kernel ridge regression (KRR) is a foundational tool in machine learning, with recent work emphasizing its connections to neural networks. However, existing theory primarily addresses the i.i.d. setting, while real-world data often exhibits…

Machine Learning · Statistics 2025-10-20 Dechen Zhang , Zhenmei Shi , Yi Zhang , Yingyu Liang , Difan Zou

We study the problem of estimating the probability density function of a circular random variable subject to censoring. To this end, we propose a fully computable quotient estimator that combines a projection estimator on linear sieves with…

Statistics Theory · Mathematics 2025-08-11 Nicolas Conanec

The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilistic predictors, also known as credal sets. One popular way of…

Machine Learning · Computer Science 2025-07-30 Mira Jürgens , Thomas Mortier , Eyke Hüllermeier , Viktor Bengs , Willem Waegeman

A nonparametric kernel density estimator for directional-linear data is introduced. The proposal is based on a product kernel accounting for the different nature of both (directional and linear) components of the random vector. Expressions…

‹ Prev 1 4 5 6 7 8 10 Next ›