English
Related papers

Related papers: Robustness Guarantees for Bayesian Inference with …

200 papers

In deep learning applications, robustness measures the ability of neural models that handle slight changes in input data, which could lead to potential safety hazards, especially in safety-critical applications. Pre-deployment assessment of…

Software Engineering · Computer Science 2024-04-26 Wenchuan Mu , Kwan Hui Lim

Recently, a novel linear model predictive control algorithm based on a physics-informed Gaussian Process has been introduced, whose realizations strictly follow a system of underlying linear ordinary differential equations with constant…

Optimization and Control · Mathematics 2025-05-01 Adrian Lepp , Jörn Tebbe , Andreas Besginow

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

Machine Learning · Statistics 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari

In many cases, neural networks perform well on test data, but tend to overestimate their confidence on out-of-distribution data. This has led to adoption of Bayesian neural networks, which better capture uncertainty and therefore more…

Machine Learning · Computer Science 2021-08-02 Erick Galinkin

The computational efficiency of approximate Bayesian computation (ABC) has been improved by using surrogate models such as Gaussian processes (GP). In one such promising framework the discrepancy between the simulated and observed data is…

Machine Learning · Statistics 2020-08-07 Marko Järvenpää , Aki Vehtari , Pekka Marttinen

We introduce a scalable Bayesian preference learning method for identifying convincing arguments in the absence of gold-standard rat- ings or rankings. In contrast to previous work, we avoid the need for separate methods to perform quality…

Computation and Language · Computer Science 2018-06-08 Edwin Simpson , Iryna Gurevych

Large neural networks trained on large datasets have become the dominant paradigm in machine learning. These systems rely on maximum likelihood point estimates of their parameters, precluding them from expressing model uncertainty. This may…

Machine Learning · Statistics 2024-05-01 Javier Antoran

The Gaussian process (GP) is a widely used probabilistic machine learning method with implicit uncertainty characterization for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear…

Machine Learning · Statistics 2026-04-14 Mark D. Risser , Marcus M. Noack , Hengrui Luo , Ronald Pandolfi

In many product development problems, the performance of the product is governed by two types of parameters called design parameter and environmental parameter. While the former is fully controllable, the latter varies depending on the…

Machine Learning · Statistics 2020-06-23 Shogo Iwazaki , Yu Inatsu , Ichiro Takeuchi

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

Many algorithms in computer vision and robotics make strong assumptions about uncertainty, and rely on the validity of these assumptions to produce accurate and consistent state estimates. In practice, dynamic environments may degrade…

Robotics · Computer Science 2017-08-04 Valentin Peretroukhin , William Vega-Brown , Nicholas Roy , Jonathan Kelly

The accurate predictions and principled uncertainty measures provided by GP regression incur O(n^3) cost which is prohibitive for modern-day large-scale applications. This has motivated extensive work on computationally efficient…

Machine Learning · Statistics 2023-12-29 Robert Allison , Anthony Stephenson , Samuel F , Edward Pyzer-Knapp

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior,…

Machine Learning · Computer Science 2023-06-07 Paul E. Chang , Prakhar Verma , S. T. John , Arno Solin , Mohammad Emtiyaz Khan

This paper proposes a hybrid Gaussian process (GP) approach to robust economic model predictive control under unknown future disturbances in order to reduce the conservatism of the controller. The proposed hybrid GP is a combination of two…

Systems and Control · Electrical Eng. & Systems 2020-01-08 Mohammadreza Rostam , Ryozo Nagamune , Vladimir Grebenyuk

Bayesian inference promises a framework for principled uncertainty quantification of neural network predictions. Barriers to adoption include the difficulty of fully characterizing posterior distributions on network parameters and the…

Machine Learning · Statistics 2025-01-22 Katharine Fisher , Youssef Marzouk

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

Machine Learning · Computer Science 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

We apply Gaussian process (GP) regression, which provides a powerful non-parametric probabilistic method of relating inputs to outputs, to survival data consisting of time-to-event and covariate measurements. In this context, the covariates…

Statistics Theory · Mathematics 2014-09-08 James E. Barrett , Anthony C. C. Coolen

A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet,…

Methodology · Statistics 2024-12-12 Jake Thomas , Jeremie Houssineau