English
Related papers

Related papers: Nonparametric Density Estimation from Markov Chain…

200 papers

This invited paper proposes and discusses several Bayesian attempts at nonparametric and semiparametric density estimation. The main categories of these ideas are as follows: 1) Build a nonparametric prior around a given parametric model.…

Statistics Theory · Mathematics 2026-04-23 Nils Lid Hjort

Conditional density estimation generalizes regression by modeling a full density f(yjx) rather than only the expected value E(yjx). This is important for many tasks, including handling multi-modality and generating prediction intervals.…

Methodology · Statistics 2012-06-26 Michael P. Holmes , Alexander G. Gray , Charles Lee Isbell

Predictive hotspot mapping plays a critical role in hotspot policing. Existing methods such as the popular kernel density estimation (KDE) do not consider the temporal dimension of crime. Building upon recent works in related fields, this…

Applications · Statistics 2020-06-02 Yujie Hu , Fahui Wang , Cecile Guin , Haojie Zhu

Traditional hidden Markov models have been a useful tool to understand and model stochastic dynamic data; in the case of non-Gaussian data, models such as mixture of Gaussian hidden Markov models can be used. However, these suffer from the…

Machine Learning · Statistics 2023-05-16 Carlos Puerto-Santana , Concha Bielza , Pedro Larrañaga , Gustav Eje Henter

We study efficient mechanisms for differentially private kernel density estimation (DP-KDE). Prior work for the Gaussian kernel described algorithms that run in time exponential in the number of dimensions $d$. This paper breaks the…

Data Structures and Algorithms · Computer Science 2023-07-06 Tal Wagner , Yonatan Naamad , Nina Mishra

This study proposes a data condensation method for multivariate kernel density estimation by genetic algorithm. First, our proposed algorithm generates multiple subsamples of a given size with replacement from the original sample. The…

Methodology · Statistics 2022-03-04 Kiheiji Nishida

We provide finite-sample analysis of a general framework for using k-nearest neighbor statistics to estimate functionals of a nonparametric continuous probability density, including entropies and divergences. Rather than plugging a…

Statistics Theory · Mathematics 2016-08-23 Shashank Singh , Barnabás Póczos

Parametric density estimation, for example as Gaussian distribution, is the base of the field of statistics. Machine learning requires inexpensive estimation of much more complex densities, and the basic approach is relatively costly…

Machine Learning · Computer Science 2017-02-21 Jarek Duda

Semicontinuous outcomes occur frequently in health services, insurance, and cost studies. Standard nonparametric density estimators are not well suited to such data because they do not naturally accommodate the mixed structure, the…

Methodology · Statistics 2026-05-06 Guanjie Lyu , Frédéric Ouimet , Cindy Feng

A kernel method for estimating a probability density function (pdf) from an i.i.d. sample drawn from such density is presented. Our estimator is a linear combination of kernel functions, the coefficients of which are determined by a linear…

Statistics Theory · Mathematics 2023-04-20 Yoshihito Kazashi , Fabio Nobile

The solution to a multivariate linear Stochastic Differential Equation (SDE) with constant initial state is well known to be a Gaussian Markov process, but its covariance kernel involves the solution to an integral equation in the general…

Probability · Mathematics 2016-05-10 Kerry Fendick

We propose a flexible method for estimating luminosity functions (LFs) based on kernel density estimation (KDE), the most popular nonparametric density estimation approach developed in modern statistics, to overcome issues surrounding…

Methodology · Statistics 2020-05-01 Zunli Yuan , Matt J. Jarvis , Jiancheng Wang

Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical…

Machine Learning · Statistics 2025-10-02 Dehao Dai , Jianqing Fan , Yihong Gu , Debarghya Mukherjee

Nonparametric kernel density and local polynomial regression estimators are very popular in Statistics, Economics, and many other disciplines. They are routinely employed in applied work, either as part of the main empirical analysis or as…

Computation · Statistics 2020-07-21 Sebastian Calonico , Matias D. Cattaneo , Max H. Farrell

Given the output of a data source taking values in a finite alphabet, we wish to detect change-points, that is times when the statistical properties of the source change. Motivated by ideas of match lengths in information theory, we…

Probability · Mathematics 2014-10-24 Oliver Johnson , Dino Sejdinovic , James Cruise , Ayalvadi Ganesh , Robert Piechocki

We study the estimation, in Lp-norm, of density functions defined on [0,1]^d. We construct a new family of kernel density estimators that do not suffer from the so-called boundary bias problem and we propose a data-driven procedure based on…

Statistics Theory · Mathematics 2018-10-29 Karine Bertin , Salima El Kolei , Nicolas Klutchnikoff

In the context of kernel density estimation, we give a characterization of the kernels for which the parametric mean integrated squared error rate $n^{-1}$ may be obtained, where $n$ is the sample size. Also, for the cases where this rate…

Statistics Theory · Mathematics 2011-11-22 J. E. Chacón , J. Montanero , A. G. Nogales

In this paper, we introduce a new estimator for the emission densities of a nonparametric hidden Markov model. It is adaptive and minimax with respect to each state's regularity--as opposed to globally minimax estimators, which adapt to the…

Statistics Theory · Mathematics 2018-07-17 Luc Lehéricy

This papers presents a generalization of the Weitzman overlapping coefficient, originally defined for two probability density functions, to a setting involving k independent distributions, denoted by Delta. To estimate this generalized…

Methodology · Statistics 2026-03-24 Omar Eidous , Noura Almasri

Envelope methods improve the estimation efficiency in multivariate linear regression by identifying and separating the material and immaterial parts of the responses or the predictors and estimating the regression coefficients using only…

Methodology · Statistics 2025-09-10 Tate Jacobson