English
Related papers

Related papers: Convergence guarantees for kernel-based quadrature…

200 papers

Estimating the dissipativity of nonlinear systems from empirical data is useful for the analysis and control of nonlinear systems, especially when an accurate model is unavailable. Based on a Koopman operator model of the nonlinear system…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

Exploiting the variational interpretation of kernel interpolation we exhibit a direct connection between interpolation and regression, where interpolation appears as a limiting case of regression. By applying this framework to point clouds…

Numerical Analysis · Mathematics 2026-02-09 Patrick Guidotti

Convex clustering is a well-regarded clustering method, resembling the similar centroid-based approach of Lloyd's $k$-means, without requiring a predefined cluster count. It starts with each data point as its centroid and iteratively merges…

Machine Learning · Statistics 2026-05-15 Shubhayan Pan , Kushal Bose , Debolina Paul , Saptarshi Chakraborty , Swagatam Das

We study the effects of numerical quadrature rules on error convergence rates when solving Maxwell-type variational problems via the curl-conforming or edge finite element method. A complete {\em a priori} error analysis for the case of…

Numerical Analysis · Mathematics 2020-11-06 Rubén Aylwin , Carlos Jerez-Hanckes

We study approaches for compressing the empirical measure in the context of finite dimensional reproducing kernel Hilbert spaces (RKHSs). In this context, the empirical measure is contained within a natural convex set and can be…

Machine Learning · Statistics 2024-08-29 Steffen Grünewälder

We investigate if kernel regularization methods can achieve minimax convergence rates over a source condition regularity assumption for the target function. These questions have been considered in past literature, but only under specific…

Machine Learning · Statistics 2016-11-15 Gilles Blanchard , Nicole Mücke

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

Machine Learning · Statistics 2022-02-17 Junhyunng Park , Krikamol Muandet

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to infinity. First, we…

Machine Learning · Computer Science 2023-10-30 Christian Fiedler , Michael Herty , Sebastian Trimpe

Regularized approaches have been successfully applied to linear system identification in recent years. Many of them model unknown impulse responses exploiting the so called Reproducing Kernel Hilbert spaces (RKHSs) that enjoy the notable…

Machine Learning · Computer Science 2019-09-06 Mauro Bisiacco , Gianluigi Pillonetto

Kernel methods for deconvolution have attractive features, and prevail in the literature. However, they have disadvantages, which include the fact that they are usually suitable only for cases where the error distribution is infinitely…

Statistics Theory · Mathematics 2009-09-29 Peter Hall , Alexander Meister

This work provides theoretical foundations for kernel methods in the hyperspherical context. Specifically, we characterise the native spaces (reproducing kernel Hilbert spaces) and the Sobolev spaces associated with kernels defined over…

Machine Learning · Statistics 2022-11-18 Simon Hubbert , Emilio Porcu , Chris. J. Oates , Mark Girolami

A mean function in a reproducing kernel Hilbert space (RKHS), or a kernel mean, is central to kernel methods in that it is used by many classical algorithms such as kernel principal component analysis, and it also forms the core inference…

Machine Learning · Statistics 2016-02-26 Krikamol Muandet , Bharath Sriperumbudur , Kenji Fukumizu , Arthur Gretton , Bernhard Schölkopf

Kernel methods are powerful for machine learning, as they can represent data in feature spaces that similarities between samples may be faithfully captured. Recently, it is realized that machine learning enhanced by quantum computing is…

Quantum Physics · Physics 2023-08-22 Long Hin Li , Dan-Bo Zhang , Z. D. Wang

We propose a vector-valued regression problem whose solution is equivalent to the reproducing kernel Hilbert space (RKHS) embedding of the Bayesian posterior distribution. This equivalence provides a new understanding of kernel Bayesian…

Machine Learning · Statistics 2016-10-27 Yang Song , Jun Zhu , Yong Ren

The kernel thinning (KT) algorithm of Dwivedi and Mackey (2021) compresses a probability distribution more effectively than independent sampling by targeting a reproducing kernel Hilbert space (RKHS) and leveraging a less smooth square-root…

Machine Learning · Statistics 2025-01-22 Raaz Dwivedi , Lester Mackey

Maximum mean discrepancies (MMDs) like the kernel Stein discrepancy (KSD) have grown central to a wide range of applications, including hypothesis testing, sampler selection, distribution approximation, and variational inference. In each…

Machine Learning · Statistics 2025-03-26 Alessandro Barp , Carl-Johann Simon-Gabriel , Mark Girolami , Lester Mackey

Embedding probability distributions into reproducing kernel Hilbert spaces (RKHS) has enabled powerful nonparametric methods such as the maximum mean discrepancy (MMD), a statistical distance with strong theoretical and computational…

Machine Learning · Statistics 2025-05-28 Masha Naslidnyk , Siu Lun Chau , François-Xavier Briol , Krikamol Muandet

Approximate Markov chain Monte Carlo (MCMC) offers the promise of more rapid sampling at the cost of more biased inference. Since standard MCMC diagnostics fail to detect these biases, researchers have developed computable Stein discrepancy…

Machine Learning · Statistics 2020-10-16 Jackson Gorham , Lester Mackey

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite…

Machine Learning · Computer Science 2024-07-31 Nathael Da Costa , Cyrus Mostajeran , Juan-Pablo Ortega , Salem Said