English
Related papers

Related papers: $\beta$-Divergence loss for the kernel density est…

200 papers

We present a new method for estimating the frontier of a multidimensional sample. The estimator is based on a kernel regression on the power-transformed data. We assume that the exponent of the transformation goes to infinity while the…

Methodology · Statistics 2011-03-31 Stéphane Girard , Pierre Jacob

In this paper we consider the kernel estimators of a distribution function defined by the stochastic approximation algorithm when the observation are contamined by measurement errors. It is well known that this estimators depends heavily on…

Statistics Theory · Mathematics 2016-06-28 Yousri Slaoui

We study the worst case error of kernel density estimates via subset approximation. A kernel density estimate of a distribution is the convolution of that distribution with a fixed kernel (e.g. Gaussian kernel). Given a subset (i.e. a point…

Computational Geometry · Computer Science 2012-04-05 Jeff M. Phillips

We propose a new estimator for nonparametric binary choice models that does not impose a parametric structure on either the systematic function of covariates or the distribution of the error term. A key advantage of our approach is its…

Econometrics · Economics 2026-01-13 Guo Yan

In this article we study the field of Hilbertian metrics and positive definit (pd) kernels on probability measures, they have a real interest in kernel methods. Firstly we will make a study based on the Alpha-Beta-divergence to have a…

Methodology · Statistics 2018-09-18 Mactar Ndaw , Macoumba Ndour , Papa Ngom

Local polynomial regression of order at least one often performs poorly in regions of sparse data. Local constant regression is exceptional in this regard, though it is the least accurate method in general, especially at the boundaries of…

Methodology · Statistics 2024-06-18 Chunlei Ge , W. John Braun

Many statistical estimation techniques for high-dimensional or functional data are based on a preliminary dimension reduction step, which consists in projecting the sample $\bX_1, \hdots, \bX_n$ onto the first $D$ eigenvectors of the…

Statistics Theory · Mathematics 2010-04-26 Gérard Biau , André Mas

Bayesian density deconvolution using nonparametric prior distributions is a useful alternative to the frequentist kernel based deconvolution estimators due to its potentially wide range of applicability, straightforward uncertainty…

Statistics Theory · Mathematics 2013-09-10 Abhra Sarkar , Debdeep Pati , Bani K. Mallick , Raymond J. Carroll

Dataset bias has attracted increasing attention recently for its detrimental effect on the generalization ability of fine-tuned models. The current mainstream solution is designing an additional shallow model to pre-identify biased…

Computation and Language · Computer Science 2022-10-17 Songyang Gao , Shihan Dou , Qi Zhang , Xuanjing Huang

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland

We introduce the concept of compressed convolution, a technique to convolve a given data set with a large number of non-orthogonal kernels. In typical applications our technique drastically reduces the effective number of computations. The…

Instrumentation and Methods for Astrophysics · Physics 2014-01-08 F. Elsner , B. D. Wandelt

A standard approach to confidence intervals for quantiles requires good estimates of the quantile density. The optimal bandwidth for kernel estimation of the quantile density depends on an underlying location-scale family only through the…

Methodology · Statistics 2017-02-01 Luke A. Prendergast , Robert G. Staudte

An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, properties of the distribution and smoothness…

Statistics Theory · Mathematics 2025-04-17 Geoffrey Wolfer , Pierre Alquier

Standard nonlinear regression is commonly used when modeling indifference points due to its ability to closely follow observed data, resulting in a good model fit. However, standard nonlinear regression currently lacks a reasonable…

Methodology · Statistics 2024-06-07 Mingang Kim , Mikhail N. Koffarnus , Christopher T Franck

Kernel based methods have shown effective performance in many remote sensing classification tasks. However their performance significantly depend on its hyper-parameters. The conventional technique to estimate the parameter comes with high…

Machine Learning · Statistics 2018-04-17 Bharath Bhushan Damodaran

Density estimation is a crucial component of many machine learning methods, and manifold learning in particular, where geometry is to be constructed from data alone. A significant practical limitation of the current density estimation…

Classical Analysis and ODEs · Mathematics 2016-01-06 Tyrus Berry , Timothy Sauer

Spatial autocorrelation in regression models can lead to downward biased standard errors and thus incorrect inference. The most common correction in applied economics is the spatial heteroskedasticity and autocorrelation consistent (HAC)…

Econometrics · Economics 2026-03-05 Alexander Lehner

This study proposes a mathematical programming-based algorithm for the integrated selection of variable subsets and bandwidth estimation in geographically weighted regression, a local regression method that allows the kernel bandwidth and…

Methodology · Statistics 2025-03-24 Hyunwoo Lee , Young Woong Park

Kernel methods for deconvolution have attractive features, and prevail in the literature. However, they have disadvantages, which include the fact that they are usually suitable only for cases where the error distribution is infinitely…

Statistics Theory · Mathematics 2009-09-29 Peter Hall , Alexander Meister

We study the density estimation problem with observations generated by certain dynamical systems that admit a unique underlying invariant Lebesgue density. Observations drawn from dynamical systems are not independent and moreover, usual…

Machine Learning · Statistics 2016-07-14 Hanyuan Hang , Ingo Steinwart , Yunlong Feng , Johan A. K. Suykens