English
Related papers

Related papers: Fully Data-driven Normalized and Exponentiated Ker…

200 papers

Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been proposed in the literature. Semiparametric density models are…

Statistics Theory · Mathematics 2019-01-11 Jian Shi , Jiahui Yu , Anna Liu , Yuedong Wang

We propose an estimator of the kernel-based conditional mean dependence measure obtained from an appropriate modification of a naive estimator based on usual empirical estimators. We then get asymptotic normality of this estimator both…

Statistics Theory · Mathematics 2022-07-27 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet

We introduce a methodology for robust Bayesian estimation with robust divergence (e.g., density power divergence or {\gamma}-divergence), indexed by a single tuning parameter. It is well known that the posterior density induced by robust…

Methodology · Statistics 2022-07-04 Shouto Yonekura , Shonosuke Sugasawa

The rate of normal approximation for the integral norm of kernel density estimators is investigated in the case of densities with power-type singularities. The quantities from the formulations of published results by the author are…

Probability · Mathematics 2018-05-22 Andrei Yu. Zaitsev

We formulate an optimization problem to estimate probability densities in the context of multidimensional problems that are sampled with uneven probability. It considers detector sensitivity as an heterogeneous density and takes advantage…

Machine Learning · Computer Science 2025-06-04 Aleix Boquet-Pujadas , Pol del Aguila Pla , Michael Unser

In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed, where the defining convex function has an exponential nature. These estimators avoid the necessity of using an intermediate kernel…

Methodology · Statistics 2019-11-25 Taranga Mukherjee , Abhijit Mandal , Ayanendranath Basu

Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical…

Machine Learning · Statistics 2025-10-02 Dehao Dai , Jianqing Fan , Yihong Gu , Debarghya Mukherjee

A density estimation method in a Bayesian nonparametric framework is presented when recorded data are not coming directly from the distribution of interest, but from a length biased version. From a Bayesian perspective, efforts to…

Statistics Theory · Mathematics 2015-10-23 Spyridon J. Hatjispyros , Theodoros Nicoleris , Stephen G. Walker

Kernel density estimation (KDE) is integral to a range of generative and discriminative tasks in machine learning. Drawing upon tools from the multidimensional calculus of variations, we derive an optimal weight function that reduces bias…

Machine Learning · Computer Science 2023-11-07 Sangwoong Yoon , Frank C. Park , Gunsu S Yun , Iljung Kim , Yung-Kyun Noh

There are two types of deep generative models: explicit and implicit. The former defines an explicit density form that allows likelihood inference; while the latter targets a flexible transformation from random noise to generated samples.…

Machine Learning · Computer Science 2021-10-27 Qitian Wu , Rui Gao , Hongyuan Zha

Estimating probability density and its score from samples remains a core problem in generative modeling, Bayesian inference, and kinetic theory. Existing methods are bifurcated: classical kernel density estimators (KDE) generalize across…

Machine Learning · Computer Science 2026-05-29 Vasily Ilin , Peter Sushko , Ranjay Krishna

Kernel density estimation is a convenient way to estimate the probability density of a distribution given the sample of data points. However, it has certain drawbacks: proper description of the density using narrow kernels needs large data…

Data Analysis, Statistics and Probability · Physics 2015-02-27 Anton Poluektov

We study an estimator for smoothing irregularly sampled data into a smooth map. The estimator has been widely used in astronomy, owing to its low level of noise; it involves a weight function -- or smoothing kernel -- w(\theta). We show…

Astrophysics · Physics 2009-11-06 Marco Lombardi , Peter Schneider

We propose a novel method for density estimation that leverages an estimated score function to debias kernel density estimation (SD-KDE). In our approach, each data point is adjusted by taking a single step along the score function with a…

Machine Learning · Computer Science 2025-06-24 Elliot L. Epstein , Rajat Dwaraknath , Thanawat Sornwanee , John Winnicki , Jerry Weihong Liu

We introduce kernel integrated $R^2$, a new measure of statistical dependence that combines the local normalization principle of the recently introduced integrated $R^2$ with the flexibility of reproducing kernel Hilbert spaces (RKHSs). The…

Machine Learning · Statistics 2026-02-27 Pouya Roudaki , Shakeel Gavioli-Akilagun , Florian Kalinke , Mona Azadkia , Zoltán Szabó

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

Machine Learning · Statistics 2023-07-06 Guangyu Wu , Anders Lindquist

A kernel method for estimating a probability density function (pdf) from an i.i.d. sample drawn from such density is presented. Our estimator is a linear combination of kernel functions, the coefficients of which are determined by a linear…

Statistics Theory · Mathematics 2023-04-20 Yoshihito Kazashi , Fabio Nobile

In a circular deconvolution model we consider the fully data driven density estimation of a circular random variable where the density of the additive independent measurement error is unknown. We have at hand two independent iid samples,…

Statistics Theory · Mathematics 2021-02-02 Jan Johannes , Xavier Loizeau

We introduce a novel two-step approach for estimating a probability density function (pdf) given its samples, with the second and important step coming from a geometric formulation. The procedure involves obtaining an initial estimate of…

Methodology · Statistics 2017-12-14 Sutanoy Dasgupta , Debdeep Pati , Anuj Srivastava

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti