English
Related papers

Related papers: Regular Families of Kernels for Nonlinear Approxim…

200 papers

We introduce and investigate a new notion of the theory of approximation-the so-called degenerate approximation, i.e. approximation of the function of two (and more) variables (kernel) by means of degenerate function (kernel). We apply…

Probability · Mathematics 2013-03-14 E. Ostrovsky , L. Sirota

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

We produce precise estimates for the Kogbetliantz kernel for the approximation of functions on the sphere. Furthermore, we propose and study a new approximation kernel, which has slightly better properties.

Classical Analysis and ODEs · Mathematics 2017-06-30 Peter J. Grabner

The norm kernel of the generator-coordinate method is shown to be a symmetric kernel of an integral equation with eigenfunctions defined in the Fock--Bargmann space and forming a complete set of orthonormalized states (classified with the…

Nuclear Theory · Physics 2016-09-08 G. F. Filippov , Yu. A. Lashko , S. V. Korennov , K. Kato

This article gives a new insight of kernel-based (approximation) methods to solve the high-dimensional stochastic partial differential equations. We will combine the techniques of meshfree approximation and kriging interpolation to extend…

Numerical Analysis · Mathematics 2015-02-20 Qi Ye

For arbitrary nontrivial linear combinations of a finite number of Poisson kernels, the fulfillment of the Nagy condition is established for all numbers n, starting from some number. It is also proved for any n the existence of linear…

Classical Analysis and ODEs · Mathematics 2024-12-30 A. S. Serdyuk , V. A. Sorych , N. M. Sorych

We show how the essential spectral radius of a bounded positive kernel, acting on bounded functions, is linked to its lower approximation by certain absolutely continuous kernels. The standart Doeblin's condition can be interpreted in this…

Probability · Mathematics 2007-05-23 Hubert Hennion

We provide improved error bounds for kernel-based numerical differentiation in terms of growth functions when kernels are of a finite smoothness, such as polyharmonic splines, thin plate splines or Wendland kernels. In contrast to existing…

Numerical Analysis · Mathematics 2025-12-24 Oleg Davydov

Many interesting machine learning problems are best posed by considering instances that are distributions, or sample sets drawn from distributions. Previous work devoted to machine learning tasks with distributional inputs has done so…

Machine Learning · Statistics 2021-01-15 Danica J. Sutherland , Junier B. Oliva , Barnabás Póczos , Jeff Schneider

Kernel methods are versatile tools for function approximation and surrogate modeling. In particular, greedy techniques offer computational efficiency and reliability through inherent sparsity and provable convergence. Inspired by the…

Numerical Analysis · Mathematics 2026-03-09 Marian Klink , Tobias Ehring , Robin Herkert , Robin Lautenschlager , Dominik Göddeke , Bernard Haasdonk

Nonlinear kernels can be approximated using finite-dimensional feature maps for efficient risk minimization. Due to the inherent trade-off between the dimension of the (mapped) feature space and the approximation accuracy, the key problem…

Machine Learning · Computer Science 2018-10-10 Shahin Shahrampour , Vahid Tarokh

A basic building block in Classical Potential Theory is the fundamental solution of the Laplace equation in ${\mathbb R}^d$ (Newtonian kernel). The main goal of this article is to study the rates of nonlinear $n$-term approximation of…

Classical Analysis and ODEs · Mathematics 2018-08-28 Kamen Ivanov , Pencho Petrushev

Gaussian processes are powerful models for probabilistic machine learning, but are limited in application by their $O(N^3)$ inference complexity. We propose a method for deriving parametric families of kernel functions with compact spatial…

Machine Learning · Computer Science 2020-06-09 Jarred Barber

Many algorithms in scientific computing and data science take advantage of low-rank approximation of matrices and kernels, and understanding why nearly-low-rank structure occurs is essential for their analysis and further development. This…

Numerical Analysis · Mathematics 2025-10-16 Marcus Webb

Approximation using Fourier features is a popular technique for scaling kernel methods to large-scale problems, with myriad applications in machine learning and statistics. This method replaces the integral representation of a…

Machine Learning · Statistics 2024-08-26 Ayoub Belhadji , Qianyu Julie Zhu , Youssef Marzouk

The universality properties of kernels characterize the class of functions that can be approximated in the associated reproducing kernel Hilbert space and are of fundamental importance in the theoretical underpinning of kernel methods in…

Machine Learning · Computer Science 2025-06-25 Franziskus Steinert , Salem Said , Cyrus Mostajeran

Low-rank approximation is a common tool used to accelerate kernel methods: the $n \times n$ kernel matrix $K$ is approximated via a rank-$k$ matrix $\tilde K$ which can be stored in much less space and processed more quickly. In this work…

Data Structures and Algorithms · Computer Science 2017-11-07 Cameron Musco , David P. Woodruff

In this paper we show how specific families of positive definite kernels serve as powerful tools in analyses of iteration algorithms for multiple layer feedforward Neural Network models. Our focus is on particular kernels that adapt well to…

Machine Learning · Computer Science 2023-01-09 Palle E. T. Jorgensen , Myung-Sin Song , James Tian

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

We develop a kernel-based approach for estimating the spatially varying Sobolev regularity~$s$ of an unknown $d$-variate function~$f$ from scattered sampling data, which quantifies the degree of local differentiability supported by the…

Numerical Analysis · Mathematics 2026-01-29 Xiaobin Li , Leevan Ling , Yizhong Sun