English
Related papers

Related papers: Signed variable optimal kernel for non-parametric …

200 papers

Kernel density estimation is a key component of a wide variety of algorithms in machine learning, Bayesian inference, stochastic dynamics and signal processing. However, the unsupervised density estimation technique requires tuning a…

Machine Learning · Computer Science 2025-12-17 Sunia Tanweer , Firas A. Khasawneh

Kernel density estimators (KDEs) are ubiquitous tools for nonparametric estimation of probability density functions (PDFs), when data are obtained from unknown data generating processes. The KDEs that are typically available in software…

Computation · Statistics 2018-08-07 Andrew T. Jones , Hien D. Nguyen , Geoffrey J. McLachlan

Motivation: ``Molecular signatures'' or ``gene-expression signatures'' are used to predict patients' characteristics using data from coexpressed genes. Signatures can enhance understanding about biological mechanisms and have diagnostic…

Quantitative Methods · Quantitative Biology 2007-05-23 Ramon Diaz-Uriarte

This paper presents minimax rates for density estimation when the data dimension $d$ is allowed to grow with the number of observations $n$ rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which…

Statistics Theory · Mathematics 2017-08-16 Daniel J. McDonald

High-dimensional data, where the dimension of the feature space is much larger than sample size, arise in a number of statistical applications. In this context, we construct the generalized multivariate sign transformation, defined as a…

Methodology · Statistics 2021-07-05 Subhabrata Majumdar , Snigdhansu Chatterjee

The success of kernel methods has initiated the design of novel positive semidefinite functions, in particular for structured data. A leading design paradigm for this is the convolution kernel, which decomposes structured objects into their…

Machine Learning · Computer Science 2017-02-01 Nils M. Kriege , Pierre-Louis Giscard , Richard C. Wilson

We define a new bandwidth-dependent kernel density estimator that improves existing convergence rates for the bias, and preserves that of the variation, when the error is measured in $L_1$. No additional assumptions are imposed to the…

Statistics Theory · Mathematics 2016-12-28 Kairat Mynbaev , Carlos Martins-Filho

Nonparametric density estimation is considered for a discretely observed stationary continuous-time process. For each of three given time sampling procedures either random or deterministic, we establish that histograms and frequency…

Statistics Theory · Mathematics 2009-01-19 François-Xavier Lejeune

Decision trees and their ensembles are endowed with a rich set of diagnostic tools for ranking and screening variables in a predictive model. Despite the widespread use of tree based variable importance measures, pinning down their…

Machine Learning · Statistics 2020-12-14 Jason M. Klusowski , Peter M. Tian

The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its…

Machine Learning · Statistics 2021-01-15 Li Wenliang , Danica J. Sutherland , Heiko Strathmann , Arthur Gretton

We address the estimation of "extreme" conditional quantiles i.e. when their order converges to one as the sample size increases. Conditions on the rate of convergence of their order to one are provided to obtain asymptotically Gaussian…

Statistics Theory · Mathematics 2012-12-07 L. Gardes , S. Girard

Controlled ordinary differential equations driven by continuous bounded variation curves can be considered a continuous time analogue of recurrent neural networks for the construction of expressive features of the input curves. We ask up to…

Classical Analysis and ODEs · Mathematics 2025-02-06 Mie Glückstad , Nicola Muca Cirone , Josef Teichmann

This paper considers estimation of a univariate density from an individual numerical sequence. It is assumed that (i) the limiting relative frequencies of the numerical sequence are governed by an unknown density, and (ii) there is a known…

Probability · Mathematics 2008-06-19 Andrew B. Nobel , Gusztav Morvai , Sanjeev R. Kulkarni

Let $X_1,...,X_n$ be i.i.d. observations, where $X_i=Y_i+\sigma_n Z_i$ and the $Y$'s and $Z$'s are independent. Assume that the $Y$'s are unobservable and that they have the density $f$ and also that the $Z$'s have a known density $k.$…

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Bert van Es

In this paper, we propose a variable selection method for general nonparametric kernel-based estimation. The proposed method consists of two-stage estimation: (1) construct a consistent estimator of the target function, (2) approximate the…

Machine Learning · Statistics 2018-12-05 Kota Matsui , Wataru Kumagai , Kenta Kanamori , Mitsuaki Nishikimi , Takafumi Kanamori

We study the kernel estimator of the transition density of bifurcating Markov chains. Under some ergodic and regularity properties, we prove that this estimator is consistent and asymptotically normal. Next, in the numerical studies, we…

Statistics Theory · Mathematics 2023-03-28 S. Valère Bitseki Penda

A known property of conditional expectation is extended to the framework of Markov kernels. Its meaning in terms of densities is provided. Some examples located in the field of clinical diagnosis are presented to delimit the main result of…

Probability · Mathematics 2021-10-28 A. G. Nogales

We propose the periodic scaled Korobov kernel (PSKK) method for nonparametric density estimation on $\mathbb{R}^d$. By first wrapping the target density into a periodic version through modulo operation and subsequently applying kernel ridge…

Statistics Theory · Mathematics 2025-12-23 Ziyang Ye , Haoyuan Tan , Xiaoqun Wang , Zhijian He

We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-dependent Gaussian process frequency density surfaces. We solve…

Machine Learning · Statistics 2019-09-25 Sami Remes , Markus Heinonen , Samuel Kaski

This paper derives the asymptotic distribution of variance weighted Kolmogorov-Smirnov statistics for conditional moment inequality models for the case of a one dimensional covariate. The asymptotic distribution depends on the data…

Methodology · Statistics 2012-02-02 Timothy B. Armstrong