English
Related papers

Related papers: A Tutorial on Kernel Density Estimation and Recent…

200 papers

A kernel density is an aggregate of kernel functions, which are itself densities and could be kernel densities. This is used to decompose a kernel into its constituent parts. Pearson's test for equality of proportions is applied to…

Methodology · Statistics 2020-03-23 Richard S. J. Tol

Allthough nonparametric kernel density estimation with bias reduce is nowadays a standard technique in explorative data-analysis, there is still a big dispute on how to assess the quality of the estimate and which choice of bandwidth is…

Methodology · Statistics 2019-03-26 Hamza Dhakera , El Hadji Demeb , Youssou Cissb

We investigate statistical properties for a broad class of modern kernel-based regression (KBR) methods. These kernel methods were developed during the last decade and are inspired by convex risk minimization in infinite-dimensional Hilbert…

Statistics Theory · Mathematics 2009-09-29 Andreas Christmann , Ingo Steinwart

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

Coresets have emerged as a powerful tool to summarize data by selecting a small subset of the original observations while retaining most of its information. This approach has led to significant computational speedups but the performance of…

Statistics Theory · Mathematics 2020-12-10 Paxton Turner , Jingbo Liu , Philippe Rigollet

Consider the nonparametric regression model Y=m(X)+E, where the function m is smooth but unknown, and E is independent of X. An estimator of the density of the error term E is proposed and its weak consistency is obtained. The contribution…

Statistics Theory · Mathematics 2011-12-25 Rawane Samb

A Local Orthogonal Polynomial Expansion (LOrPE) of the empirical density function is proposed as a novel method to estimate the underlying density. The estimate is constructed by matching localized expectation values of orthogonal…

Applications · Statistics 2015-05-05 D. P. Amali Dassanayake , Igor Volobouev , A. Alexandre Trindade

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative.…

Statistics Theory · Mathematics 2011-01-06 Bert van Es

Dot-product attention mechanism plays a crucial role in modern deep architectures (e.g., Transformer) for sequence modeling, however, na\"ive exact computation of this model incurs quadratic time and memory complexities in sequence length,…

Machine Learning · Computer Science 2023-06-30 Amir Zandieh , Insu Han , Majid Daliri , Amin Karbasi

As the third paper in a series regarding the estimation of luminosity functions (LFs) via kernel density estimation (KDE), we present a further generalization of our framework by extending its applicability to multiple flux-limited samples.…

Instrumentation and Methods for Astrophysics · Physics 2026-03-17 Zunli Yuan , Chuanqi Li , Wenjie Wang , Luozhenhan Liu

This paper studies Kernel Density Estimation for a high-dimensional distribution $\rho(x)$. Traditional approaches have focused on the limit of large number of data points $n$ and fixed dimension $d$. We analyze instead the regime where…

Machine Learning · Computer Science 2024-10-21 Giulio Biroli , Marc Mézard

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

Accurate approximations to density functionals have recently been obtained via machine learning (ML). By applying ML to a simple function of one variable without any random sampling, we extract the qualitative dependence of errors on…

Computational Physics · Physics 2015-01-29 Kevin Vu , John Snyder , Li Li , Matthias Rupp , Brandon F. Chen , Tarek Khelif , Klaus-Robert Müller , Kieron Burke

In this paper, we construct a moment inequality for mixing dependent random variables, it is of independent interest. As applications, the consistency of the kernel density estimation is investigated. Several limit theorems are established:…

Statistics Theory · Mathematics 2013-06-07 Yuexu Zhao , Zhengyan Lin

The quest for a formula that satisfactorily measures the effective degrees of freedom in kernel density estimation (KDE) is a long standing problem with few solutions. Starting from the orthogonal polynomial sequence (OPS) expansion for the…

Methodology · Statistics 2025-03-25 Sofia Guglielmini , Igor Volobouev , Alexandre Trindade

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger

Feature matching is a challenging computer vision task that involves finding correspondences between two images of a 3D scene. In this paper we consider the dense approach instead of the more common sparse paradigm, thus striving to find…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Johan Edstedt , Ioannis Athanasiadis , Mårten Wadenbäck , Michael Felsberg

Feature preprocessing continues to play a critical role when applying machine learning and statistical methods to tabular data. In this paper, we propose the use of the kernel density integral transformation as a feature preprocessing step.…

Machine Learning · Statistics 2023-10-20 Calvin McCarter

Density estimation and inference methods are widely used in empirical work. When the underlying distribution has compact support, conventional kernel-based density estimators are no longer consistent near or at the boundary because of their…

Computation · Statistics 2021-02-24 Matias D. Cattaneo , Michael Jansson , Xinwei Ma