English
Related papers

Related papers: Kernel Density Estimation and Convolution Revisite…

200 papers

This paper introduces a novel density estimator supported on $d$-dimensional half-spaces. It stands out as the first asymmetric kernel density estimator for half-spaces in the literature. Using the multivariate inverse Gaussian (MIG)…

Statistics Theory · Mathematics 2026-03-09 Léo R. Belzile , Alain Desgagné , Christian Genest , Frédéric Ouimet

High-dimensional dense embeddings have become central to modern Information Retrieval, but many dimensions are noisy or redundant. Recently proposed DIME (Dimension IMportance Estimation), provides query-dependent scores to identify…

Information Retrieval · Computer Science 2026-04-13 Giulio D'Erasmo , Cesare Campagnano , Antonio Mallia , Pierpaolo Brutti , Nicola Tonellotto , Fabrizio Silvestri

An exact, closed form, and easy to compute expression for the mean integrated squared error (MISE) of a kernel estimator of a normal mixture cumulative distribution function is derived for the class of arbitrary order Gaussian-based…

Methodology · Statistics 2020-03-04 Vitaliy Oryshchenko

We develop a novel procedure for constructing confidence bands for components of a sparse additive model. Our procedure is based on a new kernel-sieve hybrid estimator that combines two most popular nonparametric estimation methods in the…

Machine Learning · Statistics 2018-02-14 Junwei Lu , Mladen Kolar , Han Liu

This paper presents a novel density estimation method for anomaly detection using density matrices (a powerful mathematical formalism from quantum mechanics) and Fourier features. The method can be seen as an efficient approximation of…

Machine Learning · Computer Science 2022-10-27 Oscar Bustos-Brinez , Joseph Gallego-Mejia , Fabio A. González

An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, properties of the distribution and smoothness…

Statistics Theory · Mathematics 2025-04-17 Geoffrey Wolfer , Pierre Alquier

This work presents AEGIS, a novel mixed-signal framework for real-time anomaly detection by examining sensor stream statistics. AEGIS utilizes Kernel Density Estimation (KDE)-based non-parametric density estimation to generate a real-time…

Signal Processing · Electrical Eng. & Systems 2020-03-24 Ahish Shylendra , Priyesh Shukla , Saibal Mukhopadhyay , Swarup Bhunia , Amit Ranjan Trivedi

Detecting arbitrarily shaped clusters in high-dimensional noisy data is challenging for current clustering methods. We introduce SHADE (Structure-preserving High-dimensional Analysis with Density-based Exploration), the first deep…

Machine Learning · Computer Science 2024-10-10 Anna Beer , Pascal Weber , Lukas Miklautz , Collin Leiber , Walid Durani , Christian Böhm , Claudia Plant

Conditional density estimation (CDE) goes beyond regression by modeling the full conditional distribution, providing a richer understanding of the data than just the conditional mean in regression. This makes CDE particularly useful in…

Machine Learning · Computer Science 2024-10-16 Lincen Yang , Matthijs van Leeuwen

In density estimation, the mean integrated squared error (MISE) is commonly used as a measure of performance. In that setting, the cross-validation criterion provides an unbiased estimator of the MISE minus the integral of the squared…

Methodology · Statistics 2024-07-30 José E. Chacón , Carlos Tenreiro

A kernel density estimator (KDE) is one of the most popular non-parametric density estimators. In this paper we focus on a best bandwidth selection method for use in an analogue of a classical KDE using the tropical symmetric distance,…

Populations and Evolution · Quantitative Biology 2025-12-30 Ruriko Yoshida , Zhiwen Wang

With the rise of the Internet of Things, strategies for effectively processing big data are essential for discovering meaningul insights. The time series datasets produced by groups of interconnected devices contain valuable underlying…

Signal Processing · Electrical Eng. & Systems 2022-10-04 Turner Richmond , Namita Lokare , Qian Ge , Edgar Lobaton

Directional data consist of observations distributed on a (hyper)sphere, and appear in many applied fields, such as astronomy, ecology, and environmental science. This paper studies both statistical and computational problems of kernel…

Machine Learning · Statistics 2021-10-18 Yikun Zhang , Yen-Chi Chen

Dynamic density estimation is ubiquitous in many applications, including computer vision and signal processing. One popular method to tackle this problem is the "sliding window" kernel density estimator. There exist various implementations…

Machine Learning · Statistics 2024-03-13 Yinsong Wang , Yu Ding , Shahin Shahrampour

When estimating target parameters in nonparametric models with nuisance parameters, substituting the unknown nuisances with nonparametric estimators can introduce ``plug-in bias.'' Traditional methods addressing this suboptimal…

Methodology · Statistics 2024-06-04 Brian Cho , Yaroslav Mukhin , Kyra Gan , Ivana Malenica

There is an intense and partly recent literature focussing on the problem of selecting the bandwidth parameter for kernel density estimators. Available methods are largely `very nonparametric', in the sense of not requiring any knowledge…

Methodology · Statistics 2026-02-17 Nils Lid Hjort

Modal regression estimates the local modes of the distribution of $Y$ given $X=x$, instead of the mean, as in the usual regression sense, and can hence reveal important structure missed by usual regression methods. We study a simple…

Methodology · Statistics 2016-03-31 Yen-Chi Chen , Christopher R. Genovese , Ryan J. Tibshirani , Larry Wasserman

Kernel density estimation is a key component of a wide variety of algorithms in machine learning, Bayesian inference, stochastic dynamics and signal processing. However, the unsupervised density estimation technique requires tuning a…

Machine Learning · Computer Science 2025-12-17 Sunia Tanweer , Firas A. Khasawneh

It is common, in deconvolution problems, to assume that the measurement errors are identically distributed. In many real-life applications, however, this condition is not satisfied and the deconvolution estimators developed for…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Alexander Meister

Kernel density estimation is a widely used nonparametric approach to estimate an unknown distribution. Recent work in Bayesian predictive inference has considered stochastic processes formed by specifying the predictive distribution for the…

Methodology · Statistics 2026-05-15 Torey Hilbert