English
Related papers

Related papers: Combining local and global smoothing in multivaria…

200 papers

Density estimation is a crucial component of many machine learning methods, and manifold learning in particular, where geometry is to be constructed from data alone. A significant practical limitation of the current density estimation…

Classical Analysis and ODEs · Mathematics 2016-01-06 Tyrus Berry , Timothy Sauer

By a mixture density is meant a density of the form $\pi_{\mu}(\cdot)=\int\pi_{\theta}(\cdot)\times\mu(d\theta)$, where $(\pi_{\theta})_{\theta\in\Theta}$ is a family of probability densities and $\mu$ is a probability measure on $\Theta$.…

Statistics Theory · Mathematics 2016-08-16 François Roueff , Tobias Rydén

Mode clustering is a nonparametric method for clustering that defines clusters using the basins of attraction of a density estimator's modes. We provide several enhancements to mode clustering: (i) a soft variant of cluster assignment, (ii)…

Methodology · Statistics 2015-12-23 Yen-Chi Chen , Christopher R. Genovese , Larry Wasserman

The estimation of probability density functions is a fundamental problem in science and engineering. However, common methods such as kernel density estimation (KDE) have been demonstrated to lack robustness, while more complex methods have…

Machine Learning · Computer Science 2025-06-30 Anna Mészáros , Julian F. Schumann , Javier Alonso-Mora , Arkady Zgonnikov , Jens Kober

In this paper, we study the Bernstein polynomial model for estimating the multivariate distribution functions and densities with bounded support. As a mixture model of multivariate beta distributions, the maximum (approximate) likelihood…

Methodology · Statistics 2019-01-23 Tao Wang , Zhong Guan

The importance of developing efficient image denoising methods is immense especially for modern applications such as image comparisons, image monitoring, medical image diagnostics, and so forth. Available methods in the vast literature on…

Applications · Statistics 2025-08-26 Subhasish Basak , Partha Sarathi Mukherjee

This article introduces a general statistical modeling principle called "Density Sharpening" and applies it to the analysis of discrete count data. The underlying foundation is based on a new theory of nonparametric approximation and…

Methodology · Statistics 2021-08-24 Subhadeep Mukhopadhyay

In the context of regressing a response $Y$ on a predictor $X$, we consider estimating the local modes of the distribution of $Y$ given $X=x$ when $X$ is prone to measurement error. We propose two nonparametric estimation methods, with one…

Methodology · Statistics 2016-10-28 Haiming Zhou , Xianzheng Huang

The Dirichlet process mixture model and more general mixtures based on discrete random probability measures have been shown to be flexible and accurate models for density estimation and clustering. The goal of this paper is to illustrate…

Methodology · Statistics 2013-10-02 Ernesto Barrios , Antonio Lijoi , Luis E. Nieto-Barajas , Igor Prünster

Density estimation is a fundamental technique employed in various fields to model and to understand the underlying distribution of data. The primary objective of density estimation is to estimate the probability density function of a random…

Machine Learning · Statistics 2024-02-20 Cristiano Tamborrino , Antonella Falini , Francesca Mazzia

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general H\"{o}lder class and estimate it via a nonparametric local polynomial approach that consists of…

Statistics Theory · Mathematics 2021-02-11 Leonie Selk , Charles Tillier , Orlando Marigliano

The general regularisation scheme, a versatile approach for nonparametric estimation, has been successfully applied to regression, density ratio, and score estimation. In this paper, we introduce a unified framework encompassing these…

Statistics Theory · Mathematics 2026-05-12 Gilles Germain

Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods…

Computation · Statistics 2021-09-09 Pierre L'Ecuyer , Florian Puchhammer

Testing procedures for assessing specific parametric model forms, or for checking the plausibility of simplifying assumptions, play a central role in the mathematical treatment of the uncertain. No certain answers are obtained by testing…

Estimation of the covariance structure of spatial processes is of fundamental importance in spatial statistics. In the literature, several non-parametric and semi-parametric methods have been developed to estimate the covariance structure…

Methodology · Statistics 2016-11-06 Shu Yang , Zhengyuan Zhu

We analyze four different approaches to estimate a multivariate probability density (or the log-density) and its first and second order derivatives. Two methods, local log-likelihood and local Hyv\"arinen score estimation, are in terms of…

Statistics Theory · Mathematics 2020-08-11 Christof Strähl , Johanna F. Ziegel , Lutz Duembgen

We deal with the problem of gradient estimation for stochastic differentiable relaxations of algorithms, operators, simulators, and other non-differentiable functions. Stochastic smoothing conventionally perturbs the input of a…

Machine Learning · Computer Science 2024-10-11 Felix Petersen , Christian Borgelt , Aashwin Mishra , Stefano Ermon

The task of calibration is to retrospectively adjust the outputs from a machine learning model to provide better probability estimates on the target variable. While calibration has been investigated thoroughly in classification, it has not…

Machine Learning · Statistics 2018-06-21 Hao Song , Meelis Kull , Peter Flach

In this paper we develop a data-driven smoothing technique for high-dimensional and non-linear panel data models. We allow for individual specific (non-linear) functions and estimation with econometric or machine learning methods by using…

Methodology · Statistics 2020-01-06 Xi Chen , Ye Luo , Martin Spindler

The two most extended density-based approaches to clustering are surely mixture model clustering and modal clustering. In the mixture model approach, the density is represented as a mixture and clusters are associated to the different…

Machine Learning · Statistics 2016-09-16 José E. Chacón