English
Related papers

Related papers: Towards a Unified Quadrature Framework for Large-S…

200 papers

Approximation using Fourier features is a popular technique for scaling kernel methods to large-scale problems, with myriad applications in machine learning and statistics. This method replaces the integral representation of a…

Machine Learning · Statistics 2024-08-26 Ayoub Belhadji , Qianyu Julie Zhu , Youssef Marzouk

Kernel quadratures and other kernel-based approximation methods typically suffer from prohibitive cubic time and quadratic space complexity in the number of function evaluations. The problem arises because a system of linear equations needs…

Numerical Analysis · Mathematics 2018-01-09 Toni Karvonen , Simo Särkkä

We consider the problem of improving kernel approximation via randomized feature maps. These maps arise as Monte Carlo approximation to integral representations of kernel functions and scale up kernel methods for larger datasets. Based on…

Machine Learning · Computer Science 2018-10-31 Marina Munkhoeva , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

An infinitely wide model is a weighted integration $\int \varphi(x,v) d \mu(v)$ of feature maps. This model excels at handling an infinite number of features, and thus it has been adopted to the theoretical study of deep learning. Kernel…

Machine Learning · Statistics 2020-07-08 Sho Sonoda

Kernel methods have recently attracted resurgent interest, showing performance competitive with deep neural networks in tasks such as speech recognition. The random Fourier features map is a technique commonly used to scale up kernel…

Machine Learning · Computer Science 2018-02-01 Tri Dao , Christopher De Sa , Christopher Ré

We study kernel quadrature rules with convex weights. Our approach combines the spectral properties of the kernel with recombination results about point measures. This results in effective algorithms that construct convex quadrature rules…

Numerical Analysis · Mathematics 2022-10-12 Satoshi Hayakawa , Harald Oberhauser , Terry Lyons

We present a systematic computational framework for generating positive quadrature rules in multiple dimensions on general geometries. A direct moment-matching formulation that enforces exact integration on polynomial subspaces yields…

Numerical Analysis · Computer Science 2018-09-03 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

We establish a deterministic and stochastic spherical quasi-interpolation framework featuring scaled zonal kernels derived from radial basis functions on the ambient Euclidean space. The method incorporates both quasi-Monte Carlo and Monte…

Numerical Analysis · Mathematics 2025-10-15 Zhengjie Sun , Mengyuan Lv , Xingping Sun

This article derives an accurate, explicit, and numerically stable approximation to the kernel quadrature weights in one dimension and on tensor product grids when the kernel and integration measure are Gaussian. The approximation is based…

Numerical Analysis · Mathematics 2019-05-03 Toni Karvonen , Simo Särkkä

In order to fully utilize "big data", it is often required to use "big models". Such models tend to grow with the complexity and size of the training data, and do not make strong parametric assumptions upfront on the nature of the…

Machine Learning · Statistics 2015-04-17 Vikas Sindhwani , Haim Avron

A scheme for approximating the kernel $w$ of the fractional $\alpha$-integral by a linear combination of exponentials is proposed and studied. The scheme is based on the application of a composite Gauss-Jacobi quadrature rule to an integral…

Numerical Analysis · Mathematics 2018-10-12 Daniel Baffet

The rate of convergence of weighted kernel herding (WKH) and sequential Bayesian quadrature (SBQ), two kernel-based sampling algorithms for estimating integrals with respect to some target probability measure, is investigated. Under…

Machine Learning · Statistics 2021-11-02 Rajiv Khanna , Liam Hodgkinson , Michael W. Mahoney

This paper presents new quadrature rules for functions in a reproducing kernel Hilbert space using nodes drawn by a sampling algorithm known as randomly pivoted Cholesky. The resulting computational procedure compares favorably to previous…

Numerical Analysis · Mathematics 2023-12-08 Ethan N. Epperly , Elvira Moreno

We study quadrature rules for functions from an RKHS, using nodes sampled from a determinantal point process (DPP). DPPs are parametrized by a kernel, and we use a truncated and saturated version of the RKHS kernel. This link between the…

Machine Learning · Statistics 2020-01-03 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Kernel interpolation, especially in the context of Gaussian process emulation, is a widely used technique in surrogate modelling, where the goal is to cheaply approximate an input-output map using a limited number of function evaluations.…

Numerical Analysis · Mathematics 2025-11-13 Elliot J. Addy , Jonas Latz , Aretha L. Teckentrup

Data sites selected from modeling high-dimensional problems often appear scattered in non-paternalistic ways. Except for sporadic clustering at some spots, they become relatively far apart as the dimension of the ambient space grows. These…

Numerical Analysis · Mathematics 2021-09-28 Shao-Bo Lin , Xiangyu Chang , Xingping Sun

Kernel quadrature is widely used to approximate integrals of smooth functions, with worst-case error typically decaying at the minimax rate $n^{-\alpha/d}$ for smoothness $\alpha$ in dimension $d$. Existing rate-optimal methods often depend…

Computation · Statistics 2026-05-19 Edoardo Bandoni , Christian Robert , Julien Stoehr

A fundamental task in kernel methods is to pick nodes and weights, so as to approximate a given function from an RKHS by the weighted sum of kernel translates located at the nodes. This is the crux of kernel density estimation, kernel…

Machine Learning · Statistics 2020-02-25 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

A method of deriving quadrature rules has been developed which gives nodes and weights for a Gaussian-type rule which integrates functions of the form: f(x,y,t) = a(x,y,t)/((x-t)^2+y^2) + b(x,y,t)/([(x-t)^2+y^2]^{1/2}) +…

Numerical Analysis · Mathematics 2010-09-21 Michael Carley
‹ Prev 1 2 3 10 Next ›