English
Related papers

Related papers: A Practitioner's Guide to Automatic Kernel Search …

200 papers

Bayesian optimisation (BO) uses probabilistic surrogate models - usually Gaussian processes (GPs) - for the optimisation of expensive black-box functions. At each BO iteration, the GP hyperparameters are fit to previously-evaluated data by…

Machine Learning · Computer Science 2021-05-04 George De Ath , Richard Everson , Jonathan Fieldsend

Identifying dynamical system (DS) is a vital task in science and engineering. Traditional methods require numerous calls to the DS solver, rendering likelihood-based or least-squares inference frameworks impractical. For efficient parameter…

Computation · Statistics 2024-09-19 Ying Zhou , Jinglai Li , Xiang Zhou , Hongqiao Wang

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Deep Gaussian processes (DGPs) provide a Bayesian non-parametric alternative to standard parametric deep learning models. A DGP is formed by stacking multiple GPs resulting in a well-regularized composition of functions. The Bayesian…

Machine Learning · Statistics 2018-06-06 Vinayak Kumar , Vaibhav Singh , P. K. Srijith , Andreas Damianou

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

Chemical Physics · Physics 2025-12-03 Rohit Goswami , Hannes Jónsson

Objective: Gaussian Processes (GP)-based filters, which have been effectively used for various applications including electrocardiogram (ECG) filtering can be computationally demanding and the choice of their hyperparameters is typically ad…

Signal Processing · Electrical Eng. & Systems 2024-01-10 Mircea Dumitru , Qiao Li , Erick Andres Perez Alday , Ali Bahrami Rad , Gari D. Clifford , Reza Sameni

Constructing a classical potential suited to simulate a given atomic system is a remarkably difficult task. This chapter presents a framework under which this problem can be tackled, based on the Bayesian construction of nonparametric force…

Computational Physics · Physics 2020-07-01 Aldo Glielmo , Claudio Zeni , Ádám Fekete , Alessandro De Vita

Choosing a proper set of kernel functions is an important problem in learning Gaussian Process (GP) models since each kernel structure has different model complexity and data fitness. Recently, automatic kernel composition methods provide…

Machine Learning · Computer Science 2021-02-25 Anh Tong , Toan Tran , Hung Bui , Jaesik Choi

Study of neural networks with infinite width is important for better understanding of the neural network in practical application. In this work, we derive the equivalence of the deep, infinite-width maxout network and the Gaussian process…

Machine Learning · Statistics 2022-08-29 Libin Liang , Ye Tian , Ge Cheng

High-precision measurements require optimal setups and analysis tools to achieve continuous improvements. Systematic corrections need to be modeled with high accuracy and known uncertainty to reconstruct underlying physical phenomena. To…

Data Analysis, Statistics and Probability · Physics 2022-05-31 Max Lamparth , Mattis Bestehorn , Bastian Märkisch

Several machine learning problems arising in natural language processing can be modeled as a sequence labeling problem. We provide Gaussian process models based on pseudo-likelihood approximation to perform sequence labeling. Gaussian…

Machine Learning · Computer Science 2016-09-22 P. K. Srijith , P. Balamurugan , Shirish Shevade

Kernel methods have revolutionized the fields of pattern recognition and machine learning. Their success, however, critically depends on the choice of kernel parameters. Using Gaussian process (GP) classification as a working example, this…

Methodology · Statistics 2014-05-27 Maurizio Filippone

Physics-based battery modelling has emerged to accelerate battery materials discovery and performance assessment. Its success, however, is still hindered by difficulties in aligning models to experimental data. Bayesian approaches are a…

Methodology · Statistics 2025-12-12 Yannick Kuhn , Masaki Adachi , Micha Philipp , David A. Howey , Birger Horstmann

We introduce the Gaussian process (GP) modelling module developed within the UQLab software framework. The novel design of the GP-module aims at providing seamless integration of GP modelling into any uncertainty quantification workflow, as…

Computation · Statistics 2018-08-10 C. Lataniotis , S. Marelli , B. Sudret

We propose an active set selection framework for Gaussian process classification for cases when the dataset is large enough to render its inference prohibitive. Our scheme consists of a two step alternating procedure of active set update…

Machine Learning · Statistics 2011-06-24 Ricardo Henao , Ole Winther

Gaussian processes (GPs) are non-parametric probabilistic regression models that are popular due to their flexibility, data efficiency, and well-calibrated uncertainty estimates. However, standard GP models assume homoskedastic Gaussian…

Machine Learning · Computer Science 2025-01-08 Sebastian Ament , Elizabeth Santorella , David Eriksson , Ben Letham , Maximilian Balandat , Eytan Bakshy

Lithium-ion batteries are a key energy storage technology driving revolutions in mobile electronics, electric vehicles and renewable energy storage. Capacity retention is a vital performance measure that is frequently utilized to assess…

Machine Learning · Computer Science 2024-10-10 Michael J. Kenney , Katerina G. Malollari , Sergei V. Kalinin , Maxim Ziatdinov

The interpolation of high-dimensional potential energy surfaces (PESs) is commonly done with physically-inspired deep-neural network models. In this work, we illustrate that Gaussian Processes (GPs) are also capable of interpolating…

Chemical Physics · Physics 2021-09-30 Rodrigo A. Vargas-Hernández , Jake R. Gardner

Some scenarios require the computation of a predictive distribution of a new value evaluated on an objective function conditioned on previous observations. We are interested on using a model that makes valid assumptions on the objective…

Machine Learning · Computer Science 2021-01-21 Lucia Asencio-Martín , Eduardo C. Garrido-Merchán

A wide variety of battery models are available, and it is not always obvious which model `best' describes a dataset. This paper presents a Bayesian model selection approach using Bayesian quadrature. The model evidence is adopted as the…