English
Related papers

Related papers: Uncertainty quantification using martingales for m…

200 papers

Gaussian processes (GPs) are a mature and widely-used component of the ML toolbox. One of their desirable qualities is automatic hyperparameter selection, which allows for training without user intervention. However, in many realistic…

Machine Learning · Computer Science 2024-02-16 Sebastian W. Ober , Artem Artemev , Marcel Wagenländer , Rudolfs Grobins , Mark van der Wilk

In many areas of the observational and experimental sciences data is scarce. Data observation in high-energy astrophysics is disrupted by celestial occlusions and limited telescope time while data derived from laboratory experiments in…

Machine Learning · Statistics 2023-03-28 Ryan-Rhys Griffiths

Uncertainty quantification for complex deep learning models is increasingly important as these techniques see growing use in high-stakes, real-world settings. Currently, the quality of a model's uncertainty is evaluated using…

Machine Learning · Computer Science 2021-12-15 Benjamin Kompa , Jasper Snoek , Andrew Beam

Learning uncertain dynamics models using Gaussian process~(GP) regression has been demonstrated to enable high-performance and safety-aware control strategies for challenging real-world applications. Yet, for computational tractability,…

Optimization and Control · Mathematics 2024-09-17 Manish Prajapat , Amon Lahr , Johannes Köhler , Andreas Krause , Melanie N. Zeilinger

To better understand the theoretical behavior of large neural networks, several works have analyzed the case where a network's width tends to infinity. In this regime, the effect of random initialization and the process of training a neural…

Machine Learning · Computer Science 2022-01-14 Florian Juengermann , Maxime Laasri , Marius Merkle

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

Accurately predicting the future capacity and remaining useful life of batteries is necessary to ensure reliable system operation and to minimise maintenance costs. The complex nature of battery degradation has meant that mechanistic…

Applications · Statistics 2017-06-01 Robert R. Richardson , Michael A. Osborne , David A. Howey

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

Machine Learning · Statistics 2021-10-19 Tristan Fauvel , Matthew Chalk

Gaussian process (GP) regression has been widely used in supervised machine learning due to its flexibility and inherent ability to describe uncertainty in function estimation. In the context of control, it is seeing increasing use for…

Systems and Control · Computer Science 2020-01-01 Lukas Hewing , Juraj Kabzan , Melanie N. Zeilinger

Studies of hadron resonances and their properties are limited by the accuracy and consistency of measured datasets, which can originate from many different experiments. We have used Gaussian Processes (GP) to build interpolated datasets,…

Data Analysis, Statistics and Probability · Physics 2025-05-06 R. F. Ferguson , D. G. Ireland , B. McKinnon

While causal models are becoming one of the mainstays of machine learning, the problem of uncertainty quantification in causal inference remains challenging. In this paper, we study the causal data fusion problem, where datasets pertaining…

Machine Learning · Statistics 2021-06-08 Siu Lun Chau , Jean-François Ton , Javier González , Yee Whye Teh , Dino Sejdinovic

Stochastic spectral methods have become a popular technique to quantify the uncertainties of nano-scale devices and circuits. They are much more efficient than Monte Carlo for certain design cases with a small number of random parameters.…

Computational Engineering, Finance, and Science · Computer Science 2016-03-22 Zheng Zhang , Tsui-Wei Weng , Luca Daniel

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

The accessibility of spatially distributed data, enabled by affordable sensors, field, and numerical experiments, has facilitated the development of data-driven solutions for scientific problems, including climate change, weather…

Machine Learning · Computer Science 2023-11-09 Vardhan Dongre , Gurpreet Singh Hora

Deep Ensemble (DE) is an effective alternative to Bayesian neural networks for uncertainty quantification in deep learning. The uncertainty of DE is usually conveyed by the functional inconsistency among the ensemble members, say, the…

Machine Learning · Computer Science 2022-05-03 Zhijie Deng , Feng Zhou , Jianfei Chen , Guoqiang Wu , Jun Zhu

Survival models are used in various fields, such as the development of cancer treatment protocols. Although many statistical and machine learning models have been proposed to achieve accurate survival predictions, little attention has been…

Machine Learning · Computer Science 2020-03-26 Hrushikesh Loya , Pranav Poduval , Deepak Anand , Neeraj Kumar , Amit Sethi

Gaussian process (GP) models are widely used to emulate propagation uncertainty in computer experiments. GP emulation sits comfortably within an analytically tractable Bayesian framework. Apart from propagating uncertainty of the input…

Methodology · Statistics 2015-01-30 Silvia Montagna , Surya T. Tokdar

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

Model Predictive Control (MPC) of an unknown system that is modelled by Gaussian Process (GP) techniques is studied in this paper. Using GP, the variances computed during the modelling and inference processes allow us to take model…

Systems and Control · Computer Science 2016-12-06 Gang Cao , Edmund M-K Lai , Fakhrul Alam

Reliable uncertainty estimates are crucial for deploying pretrained models; yet, many strong methods for quantifying uncertainty require retraining, Monte Carlo sampling, or expensive second-order computations and may alter a frozen…