English
Related papers

Related papers: Sharp inverse statements for kernel approximation:…

200 papers

The saturation effects, which originally refer to the fact that kernel ridge regression (KRR) fails to achieve the information-theoretical lower bound when the regression function is over-smooth, have been observed for almost 20 years and…

Machine Learning · Statistics 2025-03-04 Weihao Lu , Haobo Zhang , Yicheng Li , Qian Lin

Reparametrization invariant Sobolev metrics on spaces of regular curves have been shown to be of importance in the field of mathematical shape analysis. For practical applications, one usually discretizes the space of smooth curves and…

Differential Geometry · Mathematics 2025-03-26 Jonathan Cerqueira , Emmanuel Hartman , Eric Klassen , Martin Bauer

Kernel methods are widely used in machine learning, especially for classification problems. However, the theoretical analysis of kernel classification is still limited. This paper investigates the statistical performances of kernel…

Statistics Theory · Mathematics 2024-02-05 Jianfa Lai , Zhifan Li , Dongming Huang , Qian Lin

We prove various theorems on approximation using polynomials with integer coefficients in the Bernstein basis of any given order. In the extreme, we draw the coefficients from $\{ \pm 1\}$ only. A basic case of our results states that for…

Information Theory · Computer Science 2022-12-08 C. Sinan Güntürk , Weilin Li

In this article we establish exponential moment bounds, moment bounds in fractional order smoothness spaces, a uniform H\"older continuity in time, and strong convergence rates for a class of fully discrete exponential Euler-type numerical…

Probability · Mathematics 2021-11-02 Arnulf Jentzen , Felix Lindner , Primož Pušnik

The paper introduces a new characterisation of strictly positive definiteness for kernels on the 2-sphere without assuming the kernel to be radially (isotropic) or axially symmetric. The results use the series expansion of the kernel in…

Numerical Analysis · Mathematics 2022-05-06 Janin Jäger

In this paper, we develop approximation error estimates as well as corresponding inverse inequalities for B-splines of maximum smoothness, where both the function to be approximated and the approximation error are measured in standard…

Numerical Analysis · Mathematics 2017-05-16 Stefan Takacs , Thomas Takacs

In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relative to an active…

Optimization and Control · Mathematics 2015-03-11 Jingwei Liang , Jalal Fadili , Gabriel Peyré

We develop a new theoretical framework to analyze the generalization error of deep learning, and derive a new fast learning rate for two representative algorithms: empirical risk minimization and Bayesian deep learning. The series of…

Statistics Theory · Mathematics 2017-05-31 Taiji Suzuki

We develop an intrinsic, heat-kernel based fractional Sobolev framework on closed Riemannian manifolds and study the critical fractional Sobolev embedding. We determine the optimal coefficient of the lower-order $L^{p}$ term and prove that…

Analysis of PDEs · Mathematics 2025-12-23 Hao Tan , Zetian Yan , Zhipeng Yang

Kernel Density Estimation is a very popular technique of approximating a density function from samples. The accuracy is generally well-understood and depends, roughly speaking, on the kernel decay and local smoothness of the true density.…

Statistics Theory · Mathematics 2019-01-03 Maciej Skorski

Let $(X_1,\ldots,X_n)$ be an i.i.d. sequence of random variables in $\mathbb{R}^d$, $d\geq 1$. We show that, for any function $\varphi :\mathbb{R}^d\rightarrow\mathbb{R}$, under regularity conditions, \[n^…

Statistics Theory · Mathematics 2016-06-07 Bernard Delyon , François Portier

It is common to model a deterministic response function, such as the output of a computer experiment, as a Gaussian process with a Mat\'ern covariance kernel. The smoothness parameter of a Mat\'ern kernel determines many important…

Statistics Theory · Mathematics 2023-11-28 Toni Karvonen

Function values are, in some sense, "almost as good" as general linear information for $L_2$-approximation (optimal recovery, data assimilation) of functions from a reproducing kernel Hilbert space. This was recently proved by new upper…

Numerical Analysis · Mathematics 2022-03-23 Aicke Hinrichs , David Krieg , Erich Novak , Jan Vybiral

We deal with the relaxed area functional in the strict $BV$-convergence of non-smooth maps defined in domains of generic dimension and taking values into the unit circle. In case of Sobolev maps, a complete explicit formula is obtained. Our…

Analysis of PDEs · Mathematics 2023-12-01 Simone Carano , Domenico Mucci

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

We consider neural network approximation spaces that classify functions according to the rate at which they can be approximated (with error measured in $L^p$) by ReLU neural networks with an increasing number of coefficients, subject to…

Functional Analysis · Mathematics 2021-10-29 Philipp Grohs , Felix Voigtlaender

We introduce a sharpness functional for probabilistic models that quantifies sharpness as an intrinsic property of the probability distribution. The measure is derived based on a rank-based concentration principle that tracks upward…

Methodology · Statistics 2026-04-03 Pekka Syrjänen

This paper proposes and studies a numerical method for approximation of posterior expectations based on interpolation with a Stein reproducing kernel. Finite-sample-size bounds on the approximation error are established for posterior…

Statistics Theory · Mathematics 2022-01-12 Alessandro Barp , Chris. J. Oates , Emilio Porcu , Mark Girolami

We are interested in the kernel of one-dimensional diffusion equations with continuous coefficients as evaluated by means of explicit discretization schemes of uniform step $h>0$ in the limit as $h\to0$. We consider both semidiscrete…

Numerical Analysis · Mathematics 2007-11-02 Claudio Albanese