English
Related papers

Related papers: Sobolev norm inconsistency of kernel interpolation

200 papers

The $L\_2$-minimax risk in Sobolev classes of densities with non-integer smoothness index is shown to have an analog form to that in integer Sobolev classes. To this end, the notion of Sobolev classes is generalized to fractional…

Statistics Theory · Mathematics 2007-06-13 Clementine Dalelane

A kernel based procedure for correcting experimental data for distortions due to the finite resolution and limited detector acceptance is presented. The unfolding problem is known to be an ill-posed problem that can not be solved without…

Data Analysis, Statistics and Probability · Physics 2012-09-19 N. D. Gagunashvili , M. Schmelling

We establish some new bounds on the log-covering numbers of (anisotropic) Gaussian reproducing kernel Hilbert spaces. Unlike previous results in this direction we focus on small explicit constants and their dependency on crucial parameters…

Functional Analysis · Mathematics 2020-11-17 Ingo Steinwart , Simon Fischer

This paper characterizes the maximum mean discrepancies (MMD) that metrize the weak convergence of probability measures for a wide class of kernels. More precisely, we prove that, on a locally compact, non-compact, Hausdorff space, the MMD…

Machine Learning · Computer Science 2021-09-06 Carl-Johann Simon-Gabriel , Alessandro Barp , Bernhard Schölkopf , Lester Mackey

We consider a family of Gagliardo-Nirenberg-Sobolev interpolation inequalities which interpolate between Sobolev's inequality and the logarithmic Sobolev inequality, with optimal constants. The difference of the two terms in the…

Analysis of PDEs · Mathematics 2012-07-12 Jean Dolbeault , Giuseppe Toscani

This paper investigates instances of Sobolev embeddings characterized by local compactness at every point within their domain, except for a single point. We obtain the sharp conditions that distinguish compactness from non-compactness and…

Functional Analysis · Mathematics 2024-09-17 Chian Yeong Chuah , Jan Lang

In this paper we show how ideas from spline theory can be used to construct a local basis for the space of translates of a general iterated Brownian Bridge kernel $k_{\beta,\varepsilon}$ for $\beta\in\mathbb{N}$, $\varepsilon\geq 0$. In the…

Numerical Analysis · Mathematics 2023-06-09 Gabriele Santin

This paper studies the statistical complexity of kernel hyperparameter tuning in the setting of active regression under adversarial noise. We consider the problem of finding the best interpolant from a class of kernels with unknown…

Machine Learning · Computer Science 2020-06-16 Raphael A. Meyer , Christopher Musco

It is common, in deconvolution problems, to assume that the measurement errors are identically distributed. In many real-life applications, however, this condition is not satisfied and the deconvolution estimators developed for…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Alexander Meister

Kernel Density Estimation is a very popular technique of approximating a density function from samples. The accuracy is generally well-understood and depends, roughly speaking, on the kernel decay and local smoothness of the true density.…

Statistics Theory · Mathematics 2019-01-03 Maciej Skorski

We construct a class of super-reflexive complementably minimal spaces, and study uniformly convex distortions of the norm on Hilbert space by using methods of complex interpolation.

Functional Analysis · Mathematics 2009-09-25 Peter G. Casazza , Nigel J. Kalton , Denka Kutzarova , M. Mastylo

We show in this note that the Sobolev Discrepancy introduced in Mroueh et al in the context of generative adversarial networks, is actually the weighted negative Sobolev norm $||.||_{\dot{H}^{-1}(\nu_q)}$, that is known to linearize the…

Machine Learning · Computer Science 2018-05-17 Youssef Mroueh

To help understand various reproducing kernels used in applied sciences, we investigate the inclusion relation of two reproducing kernel Hilbert spaces. Characterizations in terms of feature maps of the corresponding reproducing kernels are…

Functional Analysis · Mathematics 2011-06-22 Haizhang Zhang , Liang Zhao

We investigate the space of non-local Sobolev functions associated with an integral kernel. We prove an extension result, Sobolev and Poincar\'e inequalities and an isoperimetric inequality for the non-local perimeter restricted to a set.…

Functional Analysis · Mathematics 2025-04-09 Konstantinos Bessas , Giuseppe Cosma Brusca

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger

Random smoothing data augmentation is a unique form of regularization that can prevent overfitting by introducing noise to the input data, encouraging the model to learn more generalized features. Despite its success in various…

Machine Learning · Statistics 2023-05-15 Liang Ding , Tianyang Hu , Jiahang Jiang , Donghao Li , Wenjia Wang , Yuan Yao

In this paper, we propose to use the general $L^2$-based Sobolev norms, i.e., $H^s$ norms where $s\in \mathbb{R}$, to measure the data discrepancy due to noise in image processing tasks that are formulated as optimization problems. As…

Numerical Analysis · Mathematics 2022-03-01 Bowen Zhu , Jingwei Hu , Yifei Lou , Yunan Yang

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test integrand is less…

Numerical Analysis · Mathematics 2018-10-31 Motonobu Kanagawa , Bharath K. Sriperumbudur , Kenji Fukumizu

An evolving line of machine learning works observe empirical evidence that suggests interpolating estimators -- the ones that achieve zero training error -- may not necessarily be harmful. This paper pursues theoretical understanding for an…

Statistics Theory · Mathematics 2021-10-19 Yue Li , Yuting Wei

Let (V,A) be a weighted graph with a finite vertex set V, with a symmetric matrix of nonnegative weights A and with Laplacian $\Delta$. Let $S_*:V\times V\mapsto{\mathbb{R}}$ be a symmetric kernel defined on the vertex set V. Consider n…

Statistics Theory · Mathematics 2013-05-10 Vladimir Koltchinskii , Pedro Rangel