English
Related papers

Related papers: Bayesian Quantification with Black-Box Estimators

200 papers

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

We propose a novel, succinct, and effective approach for distribution prediction to quantify uncertainty in machine learning. It incorporates adaptively flexible distribution prediction of $\mathbb{P}(\mathbf{y}|\mathbf{X}=x)$ in regression…

Machine Learning · Computer Science 2023-06-21 Xing Yan , Yonghua Su , Wenxuan Ma

Autoencoders gained popularity in the deep learning revolution given their ability to compress data and provide dimensionality reduction. Although prominent deep learning methods have been used to enhance autoencoders, the need to provide…

Machine Learning · Computer Science 2022-04-29 Rohitash Chandra , Mahir Jain , Manavendra Maharana , Pavel N. Krivitsky

In statistical inference, uncertainty is unknown and all models are wrong. That is to say, a person who makes a statistical model and a prior distribution is simultaneously aware that both are fictional candidates. To study such cases,…

Machine Learning · Computer Science 2023-02-13 Sumio Watanabe

A key quantity of interest in Bayesian inference are expectations of functions with respect to a posterior distribution. Markov Chain Monte Carlo is a fundamental tool to consistently compute these expectations via averaging samples drawn…

Machine Learning · Statistics 2015-02-10 Heiko Strathmann , Dino Sejdinovic , Mark Girolami

Despite numerous studies of deep autoencoders (AEs) for unsupervised anomaly detection, AEs still lack a way to express uncertainty in their predictions, crucial for ensuring safe and trustworthy machine learning systems in high-stake…

Machine Learning · Computer Science 2022-02-28 Bang Xiang Yong , Alexandra Brintrup

Recent advances in coreset methods have shown that a selection of representative datapoints can replace massive volumes of data for Bayesian inference, preserving the relevant statistical information and significantly accelerating…

Machine Learning · Statistics 2023-01-18 Dionysis Manousakas , Hippolyt Ritter , Theofanis Karaletsos

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric…

Machine Learning · Statistics 2025-09-11 Marzieh Ajirak , Anand Ravishankar , Petar M. Djuric

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

Machine learning (ML) is often viewed as a powerful data analysis tool that is easy to learn because of its black-box nature. Yet this very nature also makes it difficult to quantify confidence in predictions extracted from ML models, and…

Machine Learning · Computer Science 2025-09-30 Paul Patrone , Anthony Kearsley

We present a novel approach to Bayesian inference and general Bayesian computation that is defined through a sequential decision loop. Our method defines a recursive partitioning of the sample space. It neither relies on gradients nor…

Machine Learning · Statistics 2021-06-10 Erik Bodin , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

In the context of some machine learning applications, obtaining data instances is a relatively easy process but labeling them could become quite expensive or tedious. Such scenarios lead to datasets with few labeled instances and a larger…

Machine Learning · Computer Science 2020-07-21 Isel Grau , Dipankar Sengupta , Maria M. Garcia Lorenzo , Ann Nowe

The present paper is motivated by one of the most fundamental challenges in inverse problems, that of quantifying model discrepancies and errors. While significant strides have been made in calibrating model parameters, the overwhelming…

Computational Physics · Physics 2018-03-08 Lukas Bruder , Phaedon-Stelios Koutsourelakis

Interest is in evaluating, by Markov chain Monte Carlo (MCMC) simulation, the expected value of a function with respect to a, possibly unnormalized, probability distribution. A general purpose variance reduction technique for the MCMC…

Computation · Statistics 2012-09-19 Antonietta Mira , Reza Solgi , Daniele Imparato

Although deep neural network (DNN) has achieved many state-of-the-art results, estimating the uncertainty presented in the DNN model and the data is a challenging task. Problems related to uncertainty such as classifying unknown classes…

Machine Learning · Computer Science 2018-05-17 Buu Phan

Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive…

Computation · Statistics 2023-11-16 Michael Stanley , Mikael Kuusela , Brendan Byrne , Junjie Liu

Accurately detecting multiple change-points is critical for various applications, but determining the optimal number of change-points remains a challenge. Existing approaches based on information criteria attempt to balance goodness-of-fit…

Methodology · Statistics 2023-12-19 Hui Chen , Yinxu Jia , Guanghui Wang , Changliang Zou

Modern deterministic retrieval pipelines prioritize achieving state-of-the-art performance but often lack interpretability in decision-making. These models face challenges in assessing uncertainty, leading to overconfident predictions. To…

Information Retrieval · Computer Science 2024-02-06 EuiYul Song , Philhoon Oh , Sangryul Kim , James Thorne

The concept of trustworthy AI has gained widespread attention lately. One of the aspects relevant to trustworthy AI is robustness of ML models. In this study, we show how to probabilistically quantify robustness against naturally occurring…

Machine Learning · Computer Science 2022-11-30 Christoph Schweimer , Sebastian Scher

Estimation of physical quantities is at the core of most scientific research and the use of quantum devices promises to enhance its performances. In real scenarios, it is fundamental to consider that the resources are limited and Bayesian…