English
Related papers

Related papers: Neural network Gaussian processes as efficient mod…

200 papers

Gaussian processes (GPs) have been extensively utilized as nonparametric models for component separation in 21 cm data analyses. This exploits the distinct spectral behavior of the cosmological and foreground signals, which are modeled…

Cosmology and Nongalactic Astrophysics · Physics 2025-05-13 Kangning Diao , Richard D. P. Grumitt , Yi Mao

Gaussian Process (GPs) models are a rich distribution over functions with inductive biases controlled by a kernel function. Learning occurs through the optimisation of kernel hyperparameters using the marginal likelihood as the objective.…

Machine Learning · Statistics 2021-11-22 Fergus Simpson , Vidhi Lalchand , Carl Edward Rasmussen

Tensor Networks (TNs) have recently been used to speed up kernel machines by constraining the model weights, yielding exponential computational and storage savings. In this paper we prove that the outputs of Canonical Polyadic Decomposition…

Machine Learning · Computer Science 2024-03-29 Frederiek Wesel , Kim Batselier

Advances in hyperspectral imaging modes including electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM) bring forth the challenges of exploratory and subsequently physics-based analysis of…

Computational Physics · Physics 2020-05-22 Sergei V. Kalinin , Andrew R. Lupini , Rama K. Vasudevan , Maxim Ziatdinov

Physics-informed machine learning (PIML) has emerged as a promising alternative to conventional numerical methods for solving partial differential equations (PDEs). PIML models are increasingly built via deep neural networks (NNs) whose…

Machine Learning · Computer Science 2024-09-30 Carlos Mora , Amin Yousefpour , Shirin Hosseinmardi , Ramin Bostanabad

The interpolation of high-dimensional potential energy surfaces (PESs) is commonly done with physically-inspired deep-neural network models. In this work, we illustrate that Gaussian Processes (GPs) are also capable of interpolating…

Chemical Physics · Physics 2021-09-30 Rodrigo A. Vargas-Hernández , Jake R. Gardner

The goal of the present work is to obtain accurate potential energy surfaces (PES) for high-dimensional molecular systems with a small number of ${\it ab}$ ${\it initio}$ calculations in a system-agnostic way. We use probabilistic modeling…

Computational Physics · Physics 2020-08-27 Hiroki Sugisawa , Tomonori Ida , Roman V. Krems

Quantum computing algorithms have been shown to produce performant quantum kernels for machine-learning classification problems. Here, we examine the performance of quantum kernels for regression problems of practical interest. For an…

Quantum Physics · Physics 2024-09-30 Xuyang Guo , Jun Dai , Roman V. Krems

Deep neural networks excel at function approximation, yet they are typically trained from scratch for each new function. On the other hand, Bayesian methods, such as Gaussian Processes (GPs), exploit prior knowledge to quickly infer the…

Deep neural networks (DNN) and Gaussian processes (GP) are two powerful models with several theoretical connections relating them, but the relationship between their training methods is not well understood. In this paper, we show that…

Machine Learning · Statistics 2020-07-21 Mohammad Emtiyaz Khan , Alexander Immer , Ehsan Abedi , Maciej Korzepa

The Gaussian Process with a deep kernel is an extension of the classic GP regression model and this extended model usually constructs a new kernel function by deploying deep learning techniques like long short-term memory networks. A…

Computational Finance · Quantitative Finance 2021-05-27 Yong Shi , Wei Dai , Wen Long , Bo Li

Constructing a classical potential suited to simulate a given atomic system is a remarkably difficult task. This chapter presents a framework under which this problem can be tackled, based on the Bayesian construction of nonparametric force…

Computational Physics · Physics 2020-07-01 Aldo Glielmo , Claudio Zeni , Ádám Fekete , Alessandro De Vita

Gaussian processes (GPs) are used to make medical and scientific decisions, including in cardiac care and monitoring of atmospheric carbon dioxide levels. Notably, the choice of GP kernel is often somewhat arbitrary. In particular,…

Gaussian processes (GPs) are Bayesian nonparametric generative models that provide interpretability of hyperparameters, admit closed-form expressions for training and inference, and are able to accurately represent uncertainty. To model…

Machine Learning · Statistics 2018-03-21 Gonzalo Rios , Felipe Tobar

Belonging to the family of Bayesian nonparametrics, Gaussian process (GP) based approaches have well-documented merits not only in learning over a rich class of nonlinear functions, but also in quantifying the associated uncertainty.…

Machine Learning · Statistics 2021-10-14 Qin Lu , Georgios V. Karanikolas , Georgios B. Giannakis

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

Machine Learning · Statistics 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

For Bayesian optimization (BO) on high-dimensional data with complex structure, neural network-based kernels for Gaussian processes (GPs) have been used to learn flexible surrogate functions by the high representation power of deep…

Machine Learning · Statistics 2021-11-02 Tomoharu Iwata

We consider the use of Gaussian Processes (GPs) or Neural Networks (NNs) to numerically approximate the solutions to nonlinear partial differential equations (PDEs) with rough forcing or source terms, which commonly arise as pathwise…

Numerical Analysis · Mathematics 2025-01-31 Ricardo Baptista , Edoardo Calvello , Matthieu Darcy , Houman Owhadi , Andrew M. Stuart , Xianjin Yang

Choosing the most adequate kernel is crucial in many Machine Learning applications. Gaussian Process is a state-of-the-art technique for regression and classification that heavily relies on a kernel function. However, in the Gaussian…

Machine Learning · Computer Science 2019-10-15 Ibai Roman , Roberto Santana , Alexander Mendiburu , Jose A. Lozano