English
Related papers

Related papers: On Uniform Error Bounds for Kernel Regression unde…

200 papers

We provide new asymptotic theory for kernel density estimators, when these are applied to autoregressive processes exhibiting moderate deviations from a unit root. This fills a gap in the existing literature, which has to date considered…

Statistics Theory · Mathematics 2019-08-19 James A. Duffy

We study the concentration of random kernel matrices around their mean. We derive nonasymptotic exponential concentration inequalities for Lipschitz kernels assuming that the data points are independent draws from a class of multivariate…

Statistics Theory · Mathematics 2020-01-28 Arash A. Amini , Zahra S. Razaee

We consider kernel smoothed Grenander-type estimators for a monotone hazard rate and a monotone density in the presence of randomly right censored data. We show that they converge at rate $n^{2/5}$ and that the limit distribution at a fixed…

Statistics Theory · Mathematics 2018-05-18 Hendrik P. Lopuhaä , Eni Musta

We propose nonparametric estimation of divergence measures between continuous distributions. Our approach is based on a plug-in kernel- type estimators of density functions. We give the uniform in bandwidth consistency for the proposal…

Methodology · Statistics 2014-06-24 Papa Ngom , Hamza Dhaker , Pierre Mendy , El Hadji Deme

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

Machine Learning · Computer Science 2025-10-14 Yunlong Feng , Qiang Wu

Reliable prediction of protein variant effects is crucial for both protein optimization and for advancing biological understanding. For practical use in protein engineering, it is important that we can also provide reliable uncertainty…

Biomolecules · Quantitative Biology 2024-11-01 Peter Mørch Groth , Mads Herbert Kerrn , Lars Olsen , Jesper Salomon , Wouter Boomsma

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

Statistics Theory · Mathematics 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov

Gaussian Process regression is a kernel method successfully adopted in many real-life applications. Recently, there is a growing interest on extending this method to non-Euclidean input spaces, like the one considered in this paper,…

Machine Learning · Computer Science 2022-12-05 Antonio Candelieri , Andrea Ponti , Francesco Archetti

Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational…

Machine Learning · Statistics 2018-02-26 Jiaxin Shi , Shengyang Sun , Jun Zhu

We consider drawing statistical inferences based on data subject to non-Gaussian measurement error. Unlike most existing methods developed under the assumption of Gaussian measurement error, the proposed strategy exploits hypercomplex…

Methodology · Statistics 2025-05-06 Nicholas W. Woolsey , Xianzheng Huang

We prove finite-sample concentration and anti-concentration bounds for dimension estimation using Gaussian kernel sums. Our bounds provide explicit dependence on sample size, bandwidth, and local geometric and distributional parameters,…

Statistics Theory · Mathematics 2026-02-24 Martin Andersson

We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-dependent Gaussian process frequency density surfaces. We solve…

Machine Learning · Statistics 2019-09-25 Sami Remes , Markus Heinonen , Samuel Kaski

We consider the problem of optimizing a black-box function based on noisy bandit feedback. Kernelized bandit algorithms have shown strong empirical and theoretical performance for this problem. They heavily rely on the assumption that the…

Machine Learning · Computer Science 2021-11-10 Ilija Bogunovic , Andreas Krause

In statistical learning theory, generalization error is used to quantify the degree to which a supervised machine learning algorithm may overfit to training data. Recent work [Xu and Raginsky (2017)] has established a bound on the…

Machine Learning · Computer Science 2018-01-16 Ankit Pensia , Varun Jog , Po-Ling Loh

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…

The gaussian spread regression model for the calibration of site specific ensemble temperature forecasts depends on the apparently restrictive assumption that the uncertainty around temperature forecasts is normally distributed. We…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Stephen Jewson

Robust regression aims to develop methods for estimating an unknown regression function in the presence of outliers, heavy-tailed distributions, or contaminated data, which can severely impact performance. Most existing theoretical results…

Machine Learning · Statistics 2025-03-27 Hongwei Wen , Annika Betken , Wouter Koolen

We propose a lower bound on the log marginal likelihood of Gaussian process regression models that can be computed without matrix factorisation of the full kernel matrix. We show that approximate maximum likelihood learning of model…

Machine Learning · Statistics 2021-02-17 Artem Artemev , David R. Burt , Mark van der Wilk

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

Instrumental variable regression is a foundational tool for causal analysis across the social and biomedical sciences. Recent advances use kernel methods to estimate nonparametric causal relationships, with general data types, while…

Statistics Theory · Mathematics 2026-01-21 Marvin Lob , Rahul Singh , Suhas Vijaykumar
‹ Prev 1 3 4 5 6 7 10 Next ›