English
Related papers

Related papers: Bayesian Metric Learning for Uncertainty Quantific…

200 papers

We discuss Bayesian methods for learning Bayesian networks when data sets are incomplete. In particular, we examine asymptotic approximations for the marginal likelihood of incomplete data given a Bayesian network. We consider the Laplace…

Machine Learning · Computer Science 2015-05-19 David Maxwell Chickering , David Heckerman

As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing…

Machine Learning · Computer Science 2019-06-14 Melanie F. Pradier , Weiwei Pan , Jiayu Yao , Soumya Ghosh , Finale Doshi-velez

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

Recently, deep metric learning techniques received attention, as the learned distance representations are useful to capture the similarity relationship among samples and further improve the performance of various of supervised or…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Zhiyuan Li , Anca Ralescu

In this paper we study properties of the Laplace approximation of the posterior distribution arising in nonlinear Bayesian inverse problems. Our work is motivated by Schillings et al. (2020), where it is shown that in such a setting the…

Numerical Analysis · Mathematics 2024-04-09 Tapio Helin , Remo Kretschmann

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Some machine learning applications require continual learning - where data comes in a sequence of datasets, each is used for training and then permanently discarded. From a Bayesian perspective, continual learning seems straightforward:…

Machine Learning · Statistics 2019-02-19 Sebastian Farquhar , Yarin Gal

Which neural networks are similar is a fundamental question for both machine learning and neuroscience. Here, it is proposed to base comparisons on the predictive distributions of linear readouts from intermediate representations. In…

Machine Learning · Computer Science 2025-05-27 Heiko H. Schütt

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-29 Laurence Perreault Levasseur , Yashar D. Hezaveh , Risa H. Wechsler

Recent advances in deep learning have led to a paradigm shift in the field of reversible steganography. A fundamental pillar of reversible steganography is predictive modelling which can be realised via deep neural networks. However,…

Machine Learning · Computer Science 2023-03-08 Ching-Chun Chang

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

Machine Learning · Computer Science 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model…

Machine Learning · Computer Science 2019-05-28 Manikanta Srikar Yellapragada , Chandra Prakash Konkimalla

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

Many problems of low-level computer vision and image processing, such as denoising, deconvolution, tomographic reconstruction or super-resolution, can be addressed by maximizing the posterior distribution of a sparse linear model (SLM). We…

Machine Learning · Statistics 2010-08-16 Matthias W. Seeger , Hannes Nickisch

Complex network reconstruction is a hot topic in many fields. Currently, the most popular data-driven reconstruction framework is based on lasso. However, it is found that, in the presence of noise, lasso loses efficiency for weighted…

Machine Learning · Statistics 2020-03-03 Shuang Xu , Chun-Xia Zhang , Pei Wang , Jiangshe Zhang

This paper reviews recent developments in statistical structure learning; namely, Bayesian model reduction. Bayesian model reduction is a method for rapidly computing the evidence and parameters of probabilistic models that differ only in…

Methodology · Statistics 2019-10-15 Karl Friston , Thomas Parr , Peter Zeidman

Due to their intuitive appeal, Bayesian methods of modeling and uncertainty quantification have become popular in modern machine and deep learning. When providing a prior distribution over the parameter space, it is straightforward to…

Machine Learning · Statistics 2025-06-05 Ivan Melev , Goeran Kauermann

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

In this work, we present a new class of models, called uncertain-input models, that allows us to treat system-identification problems in which a linear system is subject to a partially unknown input signal. To encode prior information about…

Systems and Control · Computer Science 2017-09-12 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Characterizing statistical properties of solutions of inverse problems is essential for decision making. Bayesian inversion offers a tractable framework for this purpose, but current approaches are computationally unfeasible for most…

Machine Learning · Statistics 2024-12-18 Jonas Adler , Ozan Öktem