English
Related papers

Related papers: Random walk kernels and learning curves for Gaussi…

200 papers

It has long been known that a single-layer fully-connected neural network with an i.i.d. prior over its parameters is equivalent to a Gaussian process (GP), in the limit of infinite network width. This correspondence enables exact Bayesian…

Gaussian processes (GPs) are powerful probabilistic models that define flexible priors over functions, offering strong interpretability and uncertainty quantification. However, GP models often rely on simple, stationary kernels which can…

Machine Learning · Computer Science 2025-05-20 Nima Negarandeh , Carlos Mora , Ramin Bostanabad

Graph Gaussian Processes (GGPs) provide a data-efficient solution on graph structured domains. Existing approaches have focused on static structures, whereas many real graph data represent a dynamic structure, limiting the applications of…

Machine Learning · Computer Science 2021-11-04 David Blanco-Mulero , Markus Heinonen , Ville Kyrki

The hyperparameters in Gaussian process regression (GPR) model with a specified kernel are often estimated from the data via the maximum marginal likelihood. Due to the non-convexity of marginal likelihood with respect to the…

Machine Learning · Statistics 2018-01-15 Zexun Chen , Bo Wang

Gaussian Processes (GPs) provide a general and analytically tractable way of modeling complex time-varying, nonparametric functions. The Automatic Bayesian Covariance Discovery (ABCD) system constructs natural-language description of…

Machine Learning · Computer Science 2016-02-15 Yunseong Hwang , Anh Tong , Jaesik Choi

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

Gaussian process regression has proven very powerful in statistics, machine learning and inverse problems. A crucial aspect of the success of this methodology, in a wide range of applications to complex and real-world problems, is…

Statistics Theory · Mathematics 2021-03-18 Yifan Chen , Houman Owhadi , Andrew M. Stuart

Gaussian Process Regression is a well-known machine learning technique for which several quantum algorithms have been proposed. We show here that in a wide range of scenarios these algorithms show no exponential speedup. We achieve this by…

Quantum Physics · Physics 2025-07-04 Dominic Lowe , M. S. Kim , Roberto Bondesan

Estimating causal effects in quasi-experiments with spatio-temporal panel data often requires adjusting for unmeasured confounding that varies across space and time. Gaussian Processes (GPs) offer a flexible, nonparametric modeling approach…

Methodology · Statistics 2025-07-08 Sofia L. Vega , Rachel C. Nethery

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Gaussian processes (GPs) are Bayesian nonparametric generative models that provide interpretability of hyperparameters, admit closed-form expressions for training and inference, and are able to accurately represent uncertainty. To model…

Machine Learning · Statistics 2018-03-21 Gonzalo Rios , Felipe Tobar

Bayesian inference and kernel methods are well established in machine learning. The neural network Gaussian process in particular provides a concept to investigate neural networks in the limit of infinitely wide hidden layers by using…

Disordered Systems and Neural Networks · Physics 2023-11-10 Javed Lindner , David Dahmen , Michael Krämer , Moritz Helias

We consider the problem of classifying graphs using graph kernels. We define a new graph kernel, called the generalized shortest path kernel, based on the number and length of shortest paths between nodes. For our example classification…

Data Structures and Algorithms · Computer Science 2015-11-20 Linus Hermansson , Fredrik D. Johansson , Osamu Watanabe

Learning general latent-variable probabilistic graphical models is a key theoretical challenge in machine learning and artificial intelligence. All previous methods, including the EM algorithm and the spectral algorithms, face severe…

Machine Learning · Computer Science 2019-12-02 Borui Wang , Geoffrey Gordon

We introduce in this paper the mechanism of graph random features (GRFs). GRFs can be used to construct unbiased randomized estimators of several important kernels defined on graphs' nodes, in particular the regularized Laplacian kernel. As…

Machine Learning · Computer Science 2023-05-02 Krzysztof Choromanski

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

Quantum computing algorithms have been shown to produce performant quantum kernels for machine-learning classification problems. Here, we examine the performance of quantum kernels for regression problems of practical interest. For an…

Quantum Physics · Physics 2024-09-30 Xuyang Guo , Jun Dai , Roman V. Krems

We study properties of Graph Convolutional Networks (GCNs) by analyzing their behavior on standard models of random graphs, where nodes are represented by random latent variables and edges are drawn according to a similarity kernel. This…

Machine Learning · Statistics 2020-10-26 Nicolas Keriven , Alberto Bietti , Samuel Vaiter

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

The Weisfeiler-Lehman graph kernels are among the most prevalent graph kernels due to their remarkable time complexity and predictive performance. Their key concept is based on an implicit comparison of neighborhood representing trees with…

Machine Learning · Computer Science 2021-01-21 Till Hendrik Schulz , Tamás Horváth , Pascal Welke , Stefan Wrobel