English
Related papers

Related papers: Nadaraya-Watson kernel smoothing as a random energ…

200 papers

We investigate the asymptotic mean squared error of kernel estimators of the intensity function of a spatial point process. We show that when $n$ independent copies of a point process in $\mathbb R^d$ are superposed, the optimal bandwidth…

Statistics Theory · Mathematics 2019-04-11 M. N. M. van Lieshout

We construct a family of estimators for a regression function based on a sample following a qdistribution. Our approach is nonparametric, using kernel methods built from operations that leverage the properties of q-calculus. Furthermore,…

Statistics Theory · Mathematics 2025-03-11 Emmanuel De Dieu Nkou , Fridolin Melong

Via a simulation study we compare the finite sample performance of the deconvolution kernel density estimator in the supersmooth deconvolution problem to its asymptotic behaviour predicted by two asymptotic normality theorems. Our results…

Methodology · Statistics 2008-01-18 Bert van Es , Shota Gugushvili

We compute the distribution of likelihoods from the non-parametric iterative smoothing method over a set of mock Pantheon-like type Ia supernova datasets. We use this likelihood distribution to test whether typical dark energy models are…

Cosmology and Nongalactic Astrophysics · Physics 2021-03-17 Hanwool Koo , Arman Shafieloo , Ryan E. Keeley , Benjamin L'Huillier

We investigate how the training curve of isotropic kernel methods depends on the symmetry of the task to be learned, in several settings. (i) We consider a regression task, where the target function is a Gaussian random field that depends…

Machine Learning · Computer Science 2020-12-16 Jonas Paccolat , Stefano Spigler , Matthieu Wyart

This works extends the Random Embedding Bayesian Optimization approach by integrating a warping of the high dimensional subspace within the covariance kernel. The proposed warping, that relies on elementary geometric considerations, allows…

Optimization and Control · Mathematics 2015-03-19 Mickaël Binois , David Ginsbourger , Olivier Roustant

The family of Mat\'ern kernels are often used in spatial statistics, function approximation and Gaussian process methods in machine learning. One reason for their popularity is the presence of a smoothness parameter that controls, for…

Statistics Theory · Mathematics 2025-06-06 Moritz Korte-Stapff , Toni Karvonen , Eric Moulines

The heat kernel expansion is a very convenient tool for studying one-loop divergences, anomalies and various asymptotics of the effective action. The aim of this report is to collect useful information on the heat kernel coefficients…

High Energy Physics - Theory · Physics 2008-11-26 D. V. Vassilevich

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

A nonparametric method to predict non-Markovian time series of partially observed dynamics is developed. The prediction problem we consider is a supervised learning task of finding a regression function that takes a delay embedded…

Methodology · Statistics 2021-01-14 Faheem Gilani , Dimitrios Giannakis , John Harlim

We establish the asymptotic normality of the regression estimator in a fixed-design setting when the errors are given by a field of dependent random variables. The result applies to martingale-difference or strongly mixing random fields. On…

Statistics Theory · Mathematics 2009-07-10 Mohamed El Machkouri , Radu Stoica

Kernel quadrature is widely used to approximate integrals of smooth functions, with worst-case error typically decaying at the minimax rate $n^{-\alpha/d}$ for smoothness $\alpha$ in dimension $d$. Existing rate-optimal methods often depend…

Computation · Statistics 2026-05-19 Edoardo Bandoni , Christian Robert , Julien Stoehr

We propose a novel algorithm that extends the methods of ball smoothing and Gaussian smoothing for noisy derivative-free optimization by accounting for the heterogeneous curvature of the objective function. The algorithm dynamically adapts…

Machine Learning · Computer Science 2024-05-06 Sam Reifenstein , Timothee Leleu , Yoshihisa Yamamoto

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

Neural simulation-based inference is a powerful class of machine-learning-based methods for statistical inference that naturally handles high-dimensional parameter estimation without the need to bin data into low-dimensional summary…

Data Analysis, Statistics and Probability · Physics 2025-06-16 ATLAS Collaboration

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

Quantile regression is a powerful tool for learning the relationship between a response variable and a multivariate predictor while exploring heterogeneous effects. In this paper, we consider statistical inference for quantile regression…

Statistics Theory · Mathematics 2021-05-19 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

Under a partially linear models we study a family of robust estimates for the regression parameter and the regression function when some of the predictor variables take values on a Riemannian manifold. We obtain the consistency and the…

Statistics Theory · Mathematics 2011-05-26 Guillermo Henry , Daniela Rodriguez

Motivated by a wide variety of applications, ranging from stochastic optimization to dimension reduction through variable selection, the problem of estimating gradients accurately is of crucial importance in statistics and learning theory.…

Machine Learning · Computer Science 2020-06-29 Guillaume Ausset , Stephan Clémençon , François Portier

We determine the expected error by smoothing the data locally. Then we optimize the shape of the kernel smoother to minimize the error. Because the optimal estimator depends on the unknown function, our scheme automatically adjusts to the…

Methodology · Statistics 2019-11-19 Kurt S. Riedel , A. Sidorenko