English
Related papers

Related papers: On the optimal shape parameter for kernel methods:…

200 papers

This article establishes sharp inverse and saturation statements for kernel-based approximation using finitely smooth Sobolev kernels on bounded Lipschitz regions. The analysis focuses on the superconvergence regime, for which direct…

Numerical Analysis · Mathematics 2026-01-06 Tizian Wenzel

While direct statements for kernel based interpolation on regions $\Omega \subset \mathbb{R}^d$ are well researched, far less is known about corresponding inverse statements. The available inverse statements for kernel based interpolation…

Numerical Analysis · Mathematics 2025-04-23 Tizian Wenzel

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

Low-rank approximations are popular methods to reduce the high computational cost of algorithms involving large-scale kernel matrices. The success of low-rank methods hinges on the matrix rank of the kernel matrix, and in practice, these…

Numerical Analysis · Computer Science 2020-10-22 Ruoxi Wang , Yingzhou Li , Eric Darve

In this paper we investigate and compare different gradient algorithms designed for the domain expression of the shape derivative. Our main focus is to examine the usefulness of kernel reproducing Hilbert spaces for PDE constrained shape…

Optimization and Control · Mathematics 2016-04-20 Martin Eigel , Kevin Sturm

Because of the high approximation power and simplicity of computation of smooth radial basis functions (RBFs), in recent decades they have received much attention for function approximation. These RBFs contain a shape parameter that…

Numerical Analysis · Mathematics 2023-06-23 Fatemeh Pooladi , Hossein Hosseinzadeh

Radial basis functions (RBFs) play an important role in function interpolation, in particular in an arbitrary set of interpolation nodes. The accuracy of the interpolation depends on a parameter called the shape parameter. There are many…

Numerical Analysis · Mathematics 2025-08-27 Maria Han Veiga , Faezeh Nassajian Mojarrad , Fatemeh Nassajian Mojarrad

Radial Basis Function (RBF), or Gaussian, kernels are among the most widely used parametric kernels in machine learning, particularly in methods such as Support Vector Machines (SVM) and kernel-based subspace approaches. The kernel…

General Mathematics · Mathematics 2026-04-03 Lakhdar Remaki

We consider parametrized problems driven by spatially nonlocal integral operators with parameter-dependent kernels. In particular, kernels with varying nonlocal interaction radius $\delta > 0$ and fractional Laplace kernels, parametrized by…

Numerical Analysis · Mathematics 2019-10-02 Olena Burkovska , Max Gunzburger

The choice of the shape parameter highly effects the behaviour of radial basis function (RBF) approximations, as it needs to be selected to balance between ill-condition of the interpolation matrix and high accuracy. In this paper, we…

Numerical Analysis · Mathematics 2024-06-26 Fatemeh Nassajian Mojarrad , Maria Han Veiga , Jan S. Hesthaven , Philipp Öffner

We tackle the problem of optimizing over all possible positive definite radial kernels on Riemannian manifolds for classification. Kernel methods on Riemannian manifolds have recently become increasingly popular in computer vision. However,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Sadeep Jayasumana , Richard Hartley , Mathieu Salzmann , Hongdong Li , Mehrtash Harandi

Random Fourier features (RFF) represent one of the most popular and wide-spread techniques in machine learning to scale up kernel algorithms. Despite the numerous successful applications of RFFs, unfortunately, quite little is understood…

Machine Learning · Statistics 2019-02-12 Zoltan Szabo , Bharath K. Sriperumbudur

The computation of global radial basis function (RBF) approximations requires the solution of a linear system which, depending on the choice of RBF parameters, may be ill-conditioned. We study the stability and accuracy of approximation…

Numerical Analysis · Mathematics 2022-11-24 Ben Adcock , Daan Huybrechs , Cécile Piret

This article studies sufficient conditions on families of approximating kernels which provide $N$--term approximation errors from an associated nonlinear approximation space which match the best known orders of $N$--term wavelet expansion.…

Functional Analysis · Mathematics 2019-03-15 Keaton Hamm , Jeff Ledford

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

A spectral mixture (SM) kernel is a flexible kernel used to model any stationary covariance function. Although it is useful in modeling data, the learning of the SM kernel is generally difficult because optimizing a large number of…

Machine Learning · Statistics 2020-06-15 Yohan Jung , Kyungwoo Song , Jinkyoo Park

In this paper we investigate the approximation properties of kernel interpolants on manifolds. The kernels we consider will be obtained by the restriction of positive definite kernels on $\R^d$, such as radial basis functions (RBFs), to a…

Functional Analysis · Mathematics 2011-01-19 Edward Fuselier , Grady Wright

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Radial basis functions (RBFs) are prominent examples for reproducing kernels with associated reproducing kernel Hilbert spaces (RKHSs). The convergence theory for the kernel-based interpolation in that space is well understood and optimal…

Classical Analysis and ODEs · Mathematics 2023-09-15 Thomas Hangelbroek , Christian Rieger
‹ Prev 1 2 3 10 Next ›