English
Related papers

Related papers: A multivariate adaptation of direct kernel estimat…

200 papers

Our article addresses the problem of flexibly estimating a multivariate density while also attempting to estimate its marginals correctly. We do so by proposing two new estimators that try to capture the best features of mixture of normals…

Methodology · Statistics 2009-01-05 Paolo Giordani , Xiuyan Mun , Robert Kohn

A new multivariate density estimator for stationary sequences is obtained by Fourier inversion of the thresholded empirical characteristic function. This estimator does not depend on the choice of parameters related to the smoothness of the…

Statistics Theory · Mathematics 2023-05-24 Sinda Ammous , Jérôme Dedecker , Céline Duval

Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform…

Machine Learning · Statistics 2017-07-14 Felipe Tobar

A kernel density estimator for data on the polysphere $\mathbb{S}^{d_1}\times\cdots\times\mathbb{S}^{d_r}$, with $r,d_1,\ldots,d_r\geq 1$, is presented in this paper. We derive the main asymptotic properties of the estimator, including mean…

Methodology · Statistics 2024-11-08 Eduardo García-Portugués , Andrea Meilán-Vila

In this paper, we propose a random projection approach to estimate variance in kernel ridge regression. Our approach leads to a consistent estimator of the true variance, while being computationally more efficient. Our variance estimator is…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Jean Honorio , Guang Cheng

There is a rich literature on Bayesian methods for density estimation, which characterize the unknown density as a mixture of kernels. Such methods have advantages in terms of providing uncertainty quantification in estimation, while being…

Methodology · Statistics 2024-04-10 Shounak Chattopadhyay , Antik Chakraborty , David B. Dunson

While robust parameter estimation has been well studied in parametric density estimation, there has been little investigation into robust density estimation in the nonparametric setting. We present a robust version of the popular kernel…

Machine Learning · Statistics 2014-11-18 Robert A. Vandermeulen , Clayton D. Scott

We study the estimation, in Lp-norm, of density functions defined on [0,1]^d. We construct a new family of kernel density estimators that do not suffer from the so-called boundary bias problem and we propose a data-driven procedure based on…

Statistics Theory · Mathematics 2018-10-29 Karine Bertin , Salima El Kolei , Nicolas Klutchnikoff

The R package CVEK introduces a suite of flexible machine learning models and robust hypothesis tests for learning the joint nonlinear effects of multiple covariates in limited samples. It implements the Cross-validated Ensemble of Kernels…

Computation · Statistics 2020-12-22 Wenying Deng , Jeremiah Zhe Liu , Erin Lake , Brent A. Coull

Density estimation is a crucial component of many machine learning methods, and manifold learning in particular, where geometry is to be constructed from data alone. A significant practical limitation of the current density estimation…

Classical Analysis and ODEs · Mathematics 2016-01-06 Tyrus Berry , Timothy Sauer

The K-means algorithm is among the most commonly used data clustering methods. However, the regular K-means can only be applied in the input space and it is applicable when clusters are linearly separable. The kernel K-means, which extends…

Machine Learning · Computer Science 2020-12-08 Amir Aradnia , Maryam Amir Haeri , Mohammad Mehdi Ebadzadeh

Density ratio estimation serves as an important technique in the unsupervised machine learning toolbox. However, such ratios are difficult to estimate for complex, high-dimensional data, particularly when the densities of interest are…

Machine Learning · Computer Science 2021-07-07 Kristy Choi , Madeline Liao , Stefano Ermon

Multiple kernel clustering (MKC) is committed to achieving optimal information fusion from a set of base kernels. Constructing precise and local kernel matrices is proved to be of vital significance in applications since the unreliable…

Machine Learning · Computer Science 2022-07-08 Liang Li , Siwei Wang , Xinwang Liu , En Zhu , Li Shen , Kenli Li , Keqin Li

We develop a nonparametric two-sample test for distributions supported on the cone of symmetric positive definite matrices. The procedure relies on the Wishart kernel density estimator (KDE) introduced by Belzile et al. (2025), whose…

Statistics Theory · Mathematics 2026-03-17 Frédéric Ouimet

In this paper, we consider a k-nearest neighbor kernel type estimator when the random variables belong in a Riemannian manifolds. We study asymptotic properties such as the consistency and the asymptotic distribution. A simulation study is…

Statistics Theory · Mathematics 2011-06-24 Guillermo Henry , Andrés Muñoz , Daniela Rodriguez

Kernel methods are popular in clustering due to their generality and discriminating power. However, we show that many kernel clustering criteria have density biases theoretically explaining some practically significant artifacts empirically…

Machine Learning · Statistics 2017-12-11 Dmitrii Marin , Meng Tang , Ismail Ben Ayed , Yuri Boykov

Associated kernels have been introduced to improve the classical continuous kernels for smoothing any functional on several kinds of supports such as bounded continuous and discrete sets. This work deals with the effects of combined…

Statistics Theory · Mathematics 2021-09-08 Sobom M. Somé , Célestin C. Kokonendji

In this paper we prove large and moderate deviations principles for the recursive kernel estimator of a probability density function and its partial derivatives. Unlike the density estimator, the derivatives estimators exhibit a quadratic…

Statistics Theory · Mathematics 2007-06-13 Abdelkader Mokkadem , Mariane Pelletier , Baba Thiam

In this paper, we will discuss the concept of an array variate random variable and introduce a class of skew normal array densities that are obtained through a selection model that uses the array variate normal density as the kernel and the…

Statistics Theory · Mathematics 2011-03-23 Deniz Akdemir

A kernel method is proposed to estimate the condensed density of the generalized eigenvalues of pencils of Hankel matrices whose elements have a joint noncentral Gaussian distribution with nonidentical covariance. These pencils arise when…

Statistics Theory · Mathematics 2015-10-02 Piero Barone