English
Related papers

Related papers: Density estimation with non-parametric methods

200 papers

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

The task of calibration is to retrospectively adjust the outputs from a machine learning model to provide better probability estimates on the target variable. While calibration has been investigated thoroughly in classification, it has not…

Machine Learning · Statistics 2018-06-21 Hao Song , Meelis Kull , Peter Flach

Motivated by fluorescence lifetime measurements this paper considers the problem of nonparametric density estimation in the pile-up model. Adaptive nonparametric estimators are proposed for the pile-up model in its simple form as well as in…

Applications · Statistics 2010-11-03 Fabienne Comte , Tabea Rebafka

In this paper we consider the problem of estimating $f$, the conditional density of $Y$ given $X$, by using an independent sample distributed as $(X,Y)$ in the multivariate setting. We consider the estimation of $f(x,.)$ where $x$ is a…

Statistics Theory · Mathematics 2014-12-30 Karine Bertin , Claire Lacour , Vincent Rivoirard

Kernel estimation of a probability density function supported on the unit interval has proved difficult, because of the well known boundary bias issues a conventional kernel density estimator would necessarily face in this situation.…

Methodology · Statistics 2013-03-19 Gery Geenens

This paper introduces the kernel mixture network, a new method for nonparametric estimation of conditional probability densities using neural networks. We model arbitrarily complex conditional densities as linear combinations of a family of…

Machine Learning · Statistics 2017-05-22 Luca Ambrogioni , Umut Güçlü , Marcel A. J. van Gerven , Eric Maris

Nonparametric estimation of a mixing density based on observations from the corresponding mixture is a challenging statistical problem. This paper surveys the literature on a fast, recursive estimator based on the predictive recursion…

Methodology · Statistics 2022-09-15 Ryan Martin

Density estimation is a fundamental task in statistics and machine learning applications. Kernel density estimation is a powerful tool for non-parametric density estimation in low dimensions; however, its performance is poor in higher…

Machine Learning · Computer Science 2022-08-08 Joseph A. Gallego , Fabio A. González

In this paper, we study the problem of adaptive estimation of the spectral density of a stationary Gaussian process. For this purpose, we consider a wavelet-based method which combines the ideas of wavelet approximation and estimation by…

Statistics Theory · Mathematics 2011-06-07 Jérémie Bigot , Rolando Biscay Lirio , Jean-Michel Loubes , Lilian Muniz Alvarez

I consider two problems in machine learning and statistics: the problem of estimating the joint probability density of a collection of random variables, known as density estimation, and the problem of inferring model parameters when their…

Machine Learning · Statistics 2019-10-30 George Papamakarios

This paper investigates the nonparametric estimation of a heteroskedastic variance function on the sphere in a regression framework, assuming the variance belongs to a Besov regularity class. A needlet-based estimator is proposed, combining…

Statistics Theory · Mathematics 2026-01-08 Claudio Durastanti , Radomyra Shevchenko

Redshift is a key quantity for inferring cosmological model parameters. In photometric redshift estimation, cosmologists use the coarse data collected from the vast majority of galaxies to predict the redshift of individual galaxies. To…

Applications · Statistics 2016-04-07 Rafael Izbicki , Ann B. Lee , Peter E. Freeman

Accurately estimating data density is crucial for making informed decisions and modeling in various fields. This paper presents a novel nonparametric density estimation procedure that utilizes bivariate penalized spline smoothing over…

Methodology · Statistics 2024-10-29 Kunal Das , Shan Yu , Guannan Wang , Li Wang

The challenge of understanding the Universe's dynamics, particularly the Hubble tension, requires precise measurements of the Hubble constant. Building upon the existing spectral-siren method, which capitalizes on population information…

General Relativity and Quantum Cosmology · Physics 2025-01-10 Thomas C. K. Ng , Stefano Rinaldi , Otto A. Hannuksela

We consider the problem of estimation of a bivariate density function with support $\Re\times[0,\infty)$, where a classical bivariate kernel estimator causes boundary bias due to the non-negative variable. To overcome this problem, we…

Applications · Statistics 2019-08-08 Uttam Bandyopadhyay , Soumita Modak

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

This paper studies density estimation and regression analysis with contaminated data observed on the unit hypersphere S^d. Our methodology and theory are based on harmonic analysis on general S^d. We establish novel nonparametric density…

Statistics Theory · Mathematics 2023-01-10 Jeong Min Jeon , Ingrid Van Keilegom

Mixture models are regularly used in density estimation applications, but the problem of estimating the mixing distribution remains a challenge. Nonparametric maximum likelihood produce estimates of the mixing distribution that are…

Computation · Statistics 2019-06-28 Minwoo Chae , Ryan Martin , Stephen G. Walker

We aim at estimating in a non-parametric way the density $\pi$ of the stationary distribution of a $d$-dimensional stochastic differential equation $(X_t)_{t \in [0, T]}$, for $d \ge 2$, from the discrete observations of a finite sample…

Statistics Theory · Mathematics 2022-12-29 Chiara Amorino , Arnaud Gloter

Thanks to the tractability of their likelihood, several deep generative models show promise for seemingly straightforward but important applications like anomaly detection, uncertainty estimation, and active learning. However, the…

Machine Learning · Computer Science 2022-01-19 Charline Le Lan , Laurent Dinh