English
Related papers

Related papers: Gaussian Processes and Reproducing Kernels: Connec…

200 papers

Choosing the most adequate kernel is crucial in many Machine Learning applications. Gaussian Process is a state-of-the-art technique for regression and classification that heavily relies on a kernel function. However, in the Gaussian…

Machine Learning · Computer Science 2019-10-15 Ibai Roman , Roberto Santana , Alexander Mendiburu , Jose A. Lozano

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

Machine Learning · Statistics 2022-04-29 Alexander Terenin

Gaussian Process (GP) regression is a powerful nonparametric Bayesian framework, but its performance depends critically on the choice of covariance kernel. Selecting an appropriate kernel is therefore central to model quality, yet remains…

Machine Learning · Computer Science 2026-01-14 Md Shafiqul Islam , Shakti Prasad Padhy , Douglas Allaire , Raymundo Arróyave

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

Statistics Theory · Mathematics 2022-07-20 Wenjia Wang , Bing-Yi Jing

Reproducing kernel Hilbert spaces are uniquely characterized by their kernel, but reproducing kernel Banach spaces (RKBS) are not. However, a characterization of which RKBS admit a given kernel as reproducing kernel is lacking. This work…

Functional Analysis · Mathematics 2026-03-31 Tjeerd Jan Heeringa

It is often said that control and estimation problems are in duality. Recently, in (Aubin-Frankowski,2021), we found new reproducing kernels in Linear-Quadratic optimal control by focusing on the Hilbert space of controlled trajectories,…

Optimization and Control · Mathematics 2022-10-14 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

This work studies finite sample approximations of the exact and entropic regularized Wasserstein distances between centered Gaussian processes and, more generally, covariance operators of functional random processes. We first show that…

Machine Learning · Statistics 2021-04-27 Minh Ha Quang

With view to applications in stochastic analysis and geometry, we introduce a new correspondence for positive definite kernels (p.d.) $K$ and their associated reproducing kernel Hilbert spaces. With this we establish two kinds of…

Functional Analysis · Mathematics 2019-11-28 Palle Jorgensen , Feng Tian

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper, we develop…

Machine Learning · Computer Science 2019-10-31 Gregory W. Benton , Wesley J. Maddox , Jayson P. Salkey , Julio Albinati , Andrew Gordon Wilson

Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little…

Machine Learning · Computer Science 2023-12-19 Himanshu Singh

Motivated by applications, we introduce a general and new framework for operator valued positive definite kernels. We further give applications both to operator theory and to stochastic processes. The first one yields several dilation…

Functional Analysis · Mathematics 2024-07-31 Palle E. T. Jorgensen , James Tian

For three applications of central interest in finance, we demonstrate the relevance of numerical algorithms based on reproducing kernel Hilbert space (RKHS) techniques. Three use cases are investigated. First, we show that extrapolating…

Numerical Analysis · Mathematics 2024-04-23 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

Gaussian processes are a powerful class of non-linear models, but have limited applicability for larger datasets due to their high computational complexity. In such cases, approximate methods are required, for example, the recently…

Methodology · Statistics 2026-03-24 Soham Mukherjee , Manfred Claassen , Paul-Christian Bürkner

Gaussian processes are probabilistic models that are commonly used as functional priors in machine learning. Due to their probabilistic nature, they can be used to capture the prior information on the statistics of noise, smoothness of the…

Computation · Statistics 2024-02-02 Ahmad Farooq , Cristian A. Galvis-Florez , Simo Särkkä

Kernel methods are one of the mainstays of machine learning, but the problem of kernel learning remains challenging, with only a few heuristics and very little theory. This is of particular importance in methods based on estimation of…

Machine Learning · Statistics 2016-06-03 Seth Flaxman , Dino Sejdinovic , John P. Cunningham , Sarah Filippi

In this paper we investigate a link between state- space models and Gaussian Processes (GP) for time series modeling and forecasting. In particular, several widely used state- space models are transformed into continuous time form and…

Machine Learning · Statistics 2016-10-27 Alexander Grigorievskiy , Juha Karhunen

Gaussian processes are machine learning models capable of learning unknown functions in a way that represents uncertainty, thereby facilitating construction of optimal decision-making systems. Motivated by a desire to deploy Gaussian…

We study a class of Gaussian processes for which the posterior mean, for a particular choice of data, replicates a truncated Taylor expansion of any order. The data consist of derivative evaluations at the expansion point and the prior…

Machine Learning · Computer Science 2023-08-29 Toni Karvonen , Jon Cockayne , Filip Tronarp , Simo Särkkä

We study a reproducing kernel Hilbert space of functions defined on the positive integers and associated to the binomial coefficients. We introduce two transforms, which allow us to develop a related harmonic analysis in this Hilbert space.…

Complex Variables · Mathematics 2014-12-19 Daniel Alpay , Palle Jorgensen