English
Related papers

Related papers: Local Regularity Estimation through Sobolev-Scale …

200 papers

We propose a new approach to non-parametric density estimation that is based on regularizing a Sobolev norm of the density. This method is statistically consistent, and makes the inductive bias of the model clear and interpretable. While…

Machine Learning · Statistics 2024-02-15 Mark Kozdoba , Binyamin Perets , Shie Mannor

By selecting different filter functions, spectral algorithms can generate various regularization methods to solve statistical inverse problems within the learning-from-samples framework. This paper combines distributed spectral algorithms…

Machine Learning · Statistics 2025-02-18 Jiading Liu , Lei Shi

Random smoothing data augmentation is a unique form of regularization that can prevent overfitting by introducing noise to the input data, encouraging the model to learn more generalized features. Despite its success in various…

Machine Learning · Statistics 2023-05-15 Liang Ding , Tianyang Hu , Jiahang Jiang , Donghao Li , Wenjia Wang , Yuan Yao

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

In this paper we investigate the approximation properties of kernel interpolants on manifolds. The kernels we consider will be obtained by the restriction of positive definite kernels on $\R^d$, such as radial basis functions (RBFs), to a…

Functional Analysis · Mathematics 2011-01-19 Edward Fuselier , Grady Wright

We develop local elliptic regularity for operators having coefficients in a range of Sobolev-type function spaces (Bessel potential, Sobolev-Slobodeckij, Triebel-Lizorkin, Besov) where the coefficients have a regularity structure typical of…

Analysis of PDEs · Mathematics 2023-06-29 Michael Holst , David Maxwell , Gantumur Tsogtgerel

We study the consistency of minimum-norm interpolation in reproducing kernel Hilbert spaces corresponding to bounded kernels. Our main result give lower bounds for the generalization error of the kernel interpolation measured in a…

Machine Learning · Statistics 2025-09-30 Yunfei Yang

This work provides theoretical foundations for kernel methods in the hyperspherical context. Specifically, we characterise the native spaces (reproducing kernel Hilbert spaces) and the Sobolev spaces associated with kernels defined over…

Machine Learning · Statistics 2022-11-18 Simon Hubbert , Emilio Porcu , Chris. J. Oates , Mark Girolami

We study the estimation, in Lp-norm, of density functions defined on [0,1]^d. We construct a new family of kernel density estimators that do not suffer from the so-called boundary bias problem and we propose a data-driven procedure based on…

Statistics Theory · Mathematics 2018-10-29 Karine Bertin , Salima El Kolei , Nicolas Klutchnikoff

We prove a higher regularity result for weak solutions to nonlinear nonlocal equations along the integrability scale of Bessel potential spaces $H^{s,p}$ under a mild continuity assumption on the kernel. By embedding, this also yields…

Analysis of PDEs · Mathematics 2020-08-13 Simon Nowak

Classical convergence analysis for kernel interpolation typically assumes that the target function $f$ lies in the reproducing kernel Hilbert space $\mathcal{H}_k\!\left(\Omega\right)$ induced by a kernel on a domain…

Numerical Analysis · Mathematics 2025-12-09 Tobias Ehring , Max-Paul Vogel , Bernard Haasdonk

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

Kulldorff's (1997) seminal paper on spatial scan statistics (SSS) has led to many methods considering different regions of interest, different statistical models, and different approximations while also having numerous applications in…

Machine Learning · Statistics 2019-08-13 Mingxuan Han , Michael Matheny , Jeff M. Phillips

We extend sharp direct and inverse approximation statements for kernel-based methods for finitely smooth kernels, i.e. those whose native spaces are norm-equivalent to Sobolev spaces. In particular, our inverse results are now formulated…

Numerical Analysis · Mathematics 2025-12-22 Sara Avesani , Leevan Ling , Francesco Marchetti , Tizian Wenzel

Recent advances in machine learning have inspired a surge of research into reconstructing specific quantities of interest from measurements that comply with certain physical laws. These efforts focus on inverse problems that are governed by…

Machine Learning · Statistics 2025-04-23 Honam Wong , Wendao Wu , Fanghui Liu , Yiping Lu

This article gives a new insight of kernel-based (approximation) methods to solve the high-dimensional stochastic partial differential equations. We will combine the techniques of meshfree approximation and kriging interpolation to extend…

Numerical Analysis · Mathematics 2015-02-20 Qi Ye

We study the higher H\"older regularity of local weak solutions to a class of nonlinear nonlocal elliptic equations with kernels that satisfy a mild continuity assumption. An interesting feature of our main result is that the obtained…

Analysis of PDEs · Mathematics 2021-01-19 Simon Nowak

Kernel methods are widely used in machine learning, especially for classification problems. However, the theoretical analysis of kernel classification is still limited. This paper investigates the statistical performances of kernel…

Statistics Theory · Mathematics 2024-02-05 Jianfa Lai , Zhifan Li , Dongming Huang , Qian Lin

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

Approximation/interpolation from spaces of positive definite or conditionally positive definite kernels is an increasingly popular tool for the analysis and synthesis of scattered data, and is central to many meshless methods. For a set of…

Numerical Analysis · Mathematics 2013-09-11 E. Fuselier , T. Hangelbroek , F. J. Narcowich , J. D. Ward , G. B. Wright
‹ Prev 1 2 3 10 Next ›