English
Related papers

Related papers: Graph Random Features for Scalable Gaussian Proces…

200 papers

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

Machine Learning · Computer Science 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

Graph neural networks (GNNs) learn to represent nodes by aggregating information from their neighbors. As GNNs increase in depth, their receptive field grows exponentially, leading to high memory costs. Several existing methods address this…

Machine Learning · Computer Science 2025-07-16 Taraneh Younesian , Daniel Daza , Emile van Krieken , Thiviyan Thanapalasingam , Peter Bloem

In a Bayesian learning setting, the posterior distribution of a predictive model arises from a trade-off between its prior distribution and the conditional likelihood of observed data. Such distribution functions usually rely on additional…

Machine Learning · Statistics 2011-11-01 Andrea Schirru , Simone Pampuri , Giuseppe De Nicolao , Sean McLoone

Bayesian optimization with Gaussian process as surrogate model has been successfully applied to analog circuit synthesis. In the traditional Gaussian process regression model, the kernel functions are defined explicitly. The computational…

Machine Learning · Computer Science 2019-12-03 Shuhan Zhang , Wenlong Lyu , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

Gravitational wave Bayesian parameter inference involves repeated comparisons of GW data to generic candidate predictions. Even with algorithmically efficient methods like RIFT or reduced-order quadrature, the time needed to perform these…

Instrumentation and Methods for Astrophysics · Physics 2019-04-24 D. Wysocki , R. O'Shaughnessy , Y-L. L. Fang , Jacob Lange

The Gaussian process (GP) is a widely used probabilistic machine learning method with implicit uncertainty characterization for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear…

Machine Learning · Statistics 2026-04-14 Mark D. Risser , Marcus M. Noack , Hengrui Luo , Ronald Pandolfi

We provide a new kriging procedure of processes on graphs. Based on the construction of Gaussian random processes indexed by graphs, we extend to this framework the usual linear prediction method for spatial random fields, known as kriging.…

Statistics Theory · Mathematics 2014-06-26 Thibault Espinasse , Jean-Michel Loubes

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

Machine Learning · Statistics 2022-04-29 Alexander Terenin

Gaussian processes (GPs) are crucial in machine learning for quantifying uncertainty in predictions. However, their associated covariance matrices, defined by kernel functions, are typically dense and large-scale, posing significant…

Machine Learning · Computer Science 2025-04-02 Theresa Wagner , Tianshi Xu , Franziska Nestler , Yuanzhe Xi , Martin Stoll

We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational…

Machine Learning · Computer Science 2019-11-19 Ferran Alet , Adarsh K. Jeewajee , Maria Bauza , Alberto Rodriguez , Tomas Lozano-Perez , Leslie Pack Kaelbling

A machine-learnable variational scheme using Gaussian radial basis functions (GRBFs) is presented and used to approximate linear problems on bounded and unbounded domains. In contrast to standard mesh-free methods, which use GRBFs to…

Numerical Analysis · Mathematics 2024-10-10 Jonas A. Actor , Anthony Gruber , Eric C. Cyr , Nathaniel Trask

We present a distributed (non-Bayesian) learning algorithm for the problem of parameter estimation with Gaussian noise. The algorithm is expressed as explicit updates on the parameters of the Gaussian beliefs (i.e. means and precision). We…

Optimization and Control · Mathematics 2016-12-08 Angelia Nedić , Alex Olshevsky , César A. Uribe

Recently there has been increased interest in fitting generative graph models to real-world networks. In particular, Bl\"asius et al. have proposed a framework for systematic evaluation of the expressivity of random graph models. We extend…

Social and Information Networks · Computer Science 2024-05-14 Benjamin Dayan , Marc Kaufmann , Ulysse Schaller

Random Fourier features is one of the most popular techniques for scaling up kernel methods, such as kernel ridge regression. However, despite impressive empirical results, the statistical properties of random Fourier features are still not…

Machine Learning · Computer Science 2018-05-22 Haim Avron , Michael Kapralov , Cameron Musco , Christopher Musco , Ameya Velingker , Amir Zandieh

Graph neural networks (GNNs) have demonstrated excellent performance in a wide range of applications. However, the enormous size of large-scale graphs hinders their applications under real-time inference scenarios. Although existing…

Machine Learning · Computer Science 2022-12-29 Xinyi Gao , Wentao Zhang , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart distribution, has a doubly intractable partition function. Recent…

Neurons and Cognition · Quantitative Biology 2014-09-10 Max Hinne , Alex Lenkoski , Tom Heskes , Marcel van Gerven

In this paper we propose a new approach for constructing \emph{multivariate} Gaussian random fields (GRFs) with oscillating covariance functions through systems of stochastic partial differential equations (SPDEs). We discuss how to build…

Methodology · Statistics 2013-07-05 Xiangping Hu , Finn Lindgren , Daniel Simpson , Håvard Rue

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

Recently graph neural network (GNN) based algorithms were proposed to solve a variety of combinatorial optimization problems, including Maximum Cut problem, Maximum Independent Set problem and similar other…

Machine Learning · Computer Science 2023-06-06 David Gamarnik