English
Related papers

Related papers: Parameter selection in Gaussian process interpolat…

200 papers

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

Bayesian parameter estimation provides a systematic approach to compare heavy ion collision models with measurements, leading to constraints on the properties of nuclear matter with proper accounting of experimental and theoretical…

Nuclear Theory · Physics 2023-05-31 Brandon Weiss , Jean-François Paquet , Steffen A. Bass

Gaussian random fields are popular models for spatially varying uncertainties, arising for instance in geotechnical engineering, hydrology or image processing. A Gaussian random field is fully characterised by its mean function and…

Numerical Analysis · Mathematics 2019-02-19 Jonas Latz , Marvin Eisenberger , Elisabeth Ullmann

By distributing the training process, local approximation reduces the cost of the standard Gaussian Process. An ensemble technique combines local predictions from Gaussian experts trained on different partitions of the data. Ensemble…

Machine Learning · Computer Science 2024-01-09 Hamed Jalali , Gjergji Kasneci

Gaussian processes are ubiquitous in machine learning, statistics, and applied mathematics. They provide a flexible modelling framework for approximating functions, whilst simultaneously quantifying uncertainty. However, this is only true…

Statistics Theory · Mathematics 2021-05-19 George Wynne , François-Xavier Briol , Mark Girolami

Two canonical problems in geostatistics are estimating the parameters in a specified family of stochastic process models and predicting the process at new locations. A number of asymptotic results addressing these problems over a fixed…

Statistics Theory · Mathematics 2012-10-11 Cari Kaufman , Benjamin Shaby

Gaussian process (GP) models have been used in a wide range of battery applications, in which different kernels were manually selected with considerable expertise. However, to capture complex relationships in the ever-growing amount of…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Huang Zhang , Xixi Liu , Faisal Altaf , Torsten Wik

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

Machine Learning · Computer Science 2025-08-14 Wouter M. Kouw

In many real-world applications, we are interested in approximating black-box, costly functions as accurately as possible with the smallest number of function evaluations. A complex computer code is an example of such a function. In this…

Computation · Statistics 2022-03-22 Hossein Mohammadi , Peter Challenor , Daniel Williamson , Marc Goodfellow

Gaussian process priors are a popular choice for Bayesian analysis of regression problems. However, the implementation of these models can be complex, and ensuring that the implementation is correct can be challenging. In this paper we…

Machine Learning · Computer Science 2021-10-29 John Mcleod , Fergus Simpson

There are so many models in the literature that it is difficult for practitioners to decide which combinations are likely to be effective for a new task. This paper attempts to address this question by capturing relationships among…

Artificial Intelligence · Computer Science 2021-11-08 Jiaji Huang , Qiang Qiu , Kenneth Church

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

Methodology · Statistics 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for…

Machine Learning · Computer Science 2013-02-08 Eric Bauer , Daphne Koller , Yoram Singer

The goal of this paper is to compare several widely used Bayesian model selection methods in practical model selection problems, highlight their differences and give recommendations about the preferred approaches. We focus on the variable…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

As Gaussian processes are used to answer increasingly complex questions, analytic solutions become scarcer and scarcer. Monte Carlo methods act as a convenient bridge for connecting intractable mathematical expressions with actionable…

Bayesian filtering serves as the mainstream framework of state estimation in dynamic systems. Its standard version utilizes total probability rule and Bayes' law alternatively, where how to define and compute conditional probability is…

Machine Learning · Statistics 2024-04-02 Wenhan Cao , Shiqi Liu , Chang Liu , Zeyu He , Stephen S. -T. Yau , Shengbo Eben Li

When it is acknowledged that all candidate parameterised statistical models are misspecified relative to the data generating process, the decision maker (DM) must currently concern themselves with inference for the parameter value…

Statistics Theory · Mathematics 2018-07-04 Jack Jewson , Jim Q Smith , Chris Holmes

The multivariate normal linear model is one of the most widely employed models for statistical inference in applied research. Special cases include (multivariate) t testing, (M)AN(C)OVA, (multivariate) multiple regression, and repeated…

Methodology · Statistics 2021-03-15 J. Mulder , H. Hoijtink , X. Gu

One of the most common misconceptions made about the Kalman filter when applied to linear systems is that it requires an assumption that all error and noise processes are Gaussian. This misconception has frequently led to the Kalman filter…

Optimization and Control · Mathematics 2024-05-02 Jeffrey Uhlmann , Simon Julier