English
Related papers

Related papers: Fully symmetric kernel quadrature

200 papers

In this paper, we develop a quadrature framework for large-scale kernel machines via a numerical integration representation. Considering that the integration domain and measure of typical kernels, e.g., Gaussian kernels, arc-cosine kernels,…

Machine Learning · Computer Science 2021-06-14 Fanghui Liu , Xiaolin Huang , Yudong Chen , Johan A. K. Suykens

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are advantages of this…

Numerical Analysis · Mathematics 2022-07-18 Kazuma Tsuji , Ken'ichiro Tanaka

We study kernel quadrature rules with convex weights. Our approach combines the spectral properties of the kernel with recombination results about point measures. This results in effective algorithms that construct convex quadrature rules…

Numerical Analysis · Mathematics 2022-10-12 Satoshi Hayakawa , Harald Oberhauser , Terry Lyons

This article derives an accurate, explicit, and numerically stable approximation to the kernel quadrature weights in one dimension and on tensor product grids when the kernel and integration measure are Gaussian. The approximation is based…

Numerical Analysis · Mathematics 2019-05-03 Toni Karvonen , Simo Särkkä

We present a geometric formulation of the Multiple Kernel Learning (MKL) problem. To do so, we reinterpret the problem of learning kernel weights as searching for a kernel that maximizes the minimum (kernel) distance between two convex…

Machine Learning · Computer Science 2014-03-18 John Moeller , Parasaran Raman , Avishek Saha , Suresh Venkatasubramanian

Kernel matrices, as well as weighted graphs represented by them, are ubiquitous objects in machine learning, statistics and other related fields. The main drawback of using kernel methods (learning and inference using kernel matrices) is…

Machine Learning · Computer Science 2022-12-02 Ainesh Bakshi , Piotr Indyk , Praneeth Kacham , Sandeep Silwal , Samson Zhou

Kernel means are frequently used to represent probability distributions in machine learning problems. In particular, the well known kernel density estimator and the kernel mean embedding both have the form of a kernel mean. Unfortunately,…

Machine Learning · Statistics 2015-03-03 E. Cruz Cortés , C. Scott

Quadrature formulas for spheres, the rotation group, and other compact, homogeneous manifolds are important in a number of applications and have been the subject of recent research. The main purpose of this paper is to study coordinate…

Numerical Analysis · Mathematics 2012-11-26 E. Fuselier , T. Hangelbroek , F. J. Narcowich , J. D. Ward , G. B. Wright

In this paper we analyze a greedy procedure to approximate a linear functional defined in a Reproducing Kernel Hilbert Space by nodal values. This procedure computes a quadrature rule which can be applied to general functionals, including…

Numerical Analysis · Mathematics 2021-05-19 Gabriele Santin , Toni Karvonen , Bernard Haasdonk

The rate of convergence of weighted kernel herding (WKH) and sequential Bayesian quadrature (SBQ), two kernel-based sampling algorithms for estimating integrals with respect to some target probability measure, is investigated. Under…

Machine Learning · Statistics 2021-11-02 Rajiv Khanna , Liam Hodgkinson , Michael W. Mahoney

An infinitely wide model is a weighted integration $\int \varphi(x,v) d \mu(v)$ of feature maps. This model excels at handling an infinite number of features, and thus it has been adopted to the theoretical study of deep learning. Kernel…

Machine Learning · Statistics 2020-07-08 Sho Sonoda

Approximation using Fourier features is a popular technique for scaling kernel methods to large-scale problems, with myriad applications in machine learning and statistics. This method replaces the integral representation of a…

Machine Learning · Statistics 2024-08-26 Ayoub Belhadji , Qianyu Julie Zhu , Youssef Marzouk

This paper presents new quadrature rules for functions in a reproducing kernel Hilbert space using nodes drawn by a sampling algorithm known as randomly pivoted Cholesky. The resulting computational procedure compares favorably to previous…

Numerical Analysis · Mathematics 2023-12-08 Ethan N. Epperly , Elvira Moreno

We derive symmetric and antisymmetric kernels by symmetrizing and antisymmetrizing conventional kernels and analyze their properties. In particular, we compute the feature space dimensions of the resulting polynomial kernels, prove that the…

Quantum Physics · Physics 2021-12-14 Stefan Klus , Patrick Gelß , Feliks Nüske , Frank Noé

The geometric kernel (or simply the kernel) of a polyhedron is the set of points from which the whole polyhedron is visible. Whilst the computation of the kernel for a polygon has been largely addressed in the literature, fewer methods have…

Computational Geometry · Computer Science 2022-02-15 Tommaso Sorgente , Silvia Biasotti , Michela Spagnuolo

We present a geometric algorithm to compute the geometric kernel of a generic polyhedron. The geometric kernel (or simply kernel) is definedas the set of points from which the whole polyhedron is visible. Whilst the computation of the…

Computational Geometry · Computer Science 2021-10-28 Tommaso Sorgente , Silvia Biasotti , Michela Spagnuolo

Solution and analysis of mathematical programming problems may be simplified when these problems are symmetric under appropriate linear transformations. In particular, a knowledge of the symmetries may help reduce the problem dimension, cut…

Optimization and Control · Mathematics 2020-10-13 A. V. Eremeev , A. S. Yurkov

The runtime for Kernel Partial Least Squares (KPLS) to compute the fit is quadratic in the number of examples. However, the necessity of obtaining sensitivity measures as degrees of freedom for model selection or confidence intervals for…

Machine Learning · Statistics 2010-08-13 Nicole Kraemer , Masashi Sugiyama , Mikio Braun

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

Machine Learning · Computer Science 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir
‹ Prev 1 2 3 10 Next ›