English
Related papers

Related papers: General superconvergence for kernel-based approxim…

200 papers

A full interpolation theory for Sobolev functions with smoothness between 0 and 1 and vanishing trace on a part of the boundary of an open set is established. Geometric assumptions are of mostly measure theoretic nature and reach beyond…

Classical Analysis and ODEs · Mathematics 2021-02-23 Sebastian Bechtel , Moritz Egert

Overparametrized neural networks tend to perfectly fit noisy training data yet generalize well on test data. Inspired by this empirical observation, recent work has sought to understand this phenomenon of benign overfitting or harmless…

Machine Learning · Statistics 2022-02-23 Andrew D. McRae , Santhosh Karnik , Mark A. Davenport , Vidya Muthukumar

This paper considers paired operators in the context of the Lebesgue Hilbert space on the unit circle and its subspace, the Hardy space $H^2$. The kernels of such operators, together with their analytic projections, which are…

Functional Analysis · Mathematics 2024-02-09 M. Cristina Câmara , Jonathan R. Partington

There exists a plethora of parametric models for positive definite kernels, and their use is ubiquitous in disciplines as diverse as statistics, machine learning, numerical analysis, and approximation theory. Usually, the kernel parameters…

Machine Learning · Statistics 2025-01-06 Xavier Emery , Emilio Porcu , Moreno Bevilacqua

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

In this paper, we study the problem of sparse multiple kernel learning (MKL), where the goal is to efficiently learn a combination of a fixed small number of kernels from a large pool that could lead to a kernel classifier with a small…

Machine Learning · Computer Science 2013-02-05 Rong Jin , Tianbao Yang , Mehrdad Mahdavi

This paper introduces a quasi-interpolation operator for scalar- and vector-valued finite element spaces constructed on affine, shape-regular meshes with some continuity across mesh interfaces.This operator gives optimal estimates of the…

Numerical Analysis · Mathematics 2016-10-07 Alexandre Ern , Jean-Luc Guermond

A fundamental task in kernel methods is to pick nodes and weights, so as to approximate a given function from an RKHS by the weighted sum of kernel translates located at the nodes. This is the crux of kernel density estimation, kernel…

Machine Learning · Statistics 2020-02-25 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Reduced modeling in high-dimensional reproducing kernel Hilbert spaces offers the opportunity to approximate efficiently non-linear dynamics. In this work, we devise an algorithm based on low rank constraint optimization and kernel-based…

Machine Learning · Computer Science 2020-02-23 Patrick Heas , Cedric Herzet , Benoit Combes

Reproducing kernel Hilbert spaces provide a foundational framework for kernel-based learning, where regularization and interpolation problems admit finite-dimensional solutions through classical representer theorems. Many modern learning…

Machine Learning · Computer Science 2026-02-10 Isabel de la Higuera , Francisco Herrera , M. Victoria Velasco

Bregman divergences play a pivotal role in statistics, machine learning and computational information geometry. Particularly in the context of machine learning, they are central to clustering, exponential families, parameter estimation and…

Machine Learning · Computer Science 2026-04-28 Russell Tsuchida , Frank Nielsen

This note comprises a synthesis of certain results in the theory of exact interpolation between Hilbert spaces. In particular, we examine various characterizations of interpolation spaces and their relations to a number of results in…

Functional Analysis · Mathematics 2019-07-02 Yacin Ameur

We consider linear approximation based on function evaluations in reproducing kernel Hilbert spaces of certain analytic weighted power series kernels and stationary kernels on the interval $[-1,1]$. Both classes contain the popular Gaussian…

Numerical Analysis · Mathematics 2025-10-03 Toni Karvonen , Yuya Suzuki

Hyperspectral imaging is a powerful technology that is plagued by large dimensionality. Herein, we explore a way to combat that hindrance via non-contiguous and contiguous (simpler to realize sensor) band grouping for dimensionality…

Image and Video Processing · Electrical Eng. & Systems 2019-05-31 Muhammad Aminul Islam , Derek T. Anderson , John E. Ball , Nicolas H. Younan

Mercer's expansion and Mercer's theorem are cornerstone results in kernel theory. While the classical Mercer's theorem only considers continuous symmetric positive definite kernels, analogous expansions are effective in practice for…

Numerical Analysis · Mathematics 2025-06-18 Sungwoo Jeong , Alex Townsend

We study kernel functions, and associated reproducing kernel Hilbert spaces $\mathscr{H}$ over infinite, discrete and countable sets $V$. Numerical analysis builds discrete models (e.g., finite element) for the purpose of finding…

Functional Analysis · Mathematics 2015-08-17 Palle Jorgensen , Feng Tian

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

Many algorithms in scientific computing and data science take advantage of low-rank approximation of matrices and kernels, and understanding why nearly-low-rank structure occurs is essential for their analysis and further development. This…

Numerical Analysis · Mathematics 2025-10-16 Marcus Webb

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun