English
Related papers

Related papers: Generalised Bayes Updates with $f$-divergences thr…

200 papers

Bayes' rule has enabled innumerable powerful algorithms of statistical signal processing and statistical machine learning. However, when model misspecifications exist in prior and/or data distributions, the direct application of Bayes' rule…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Shixiong Wang

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

Bayesian Federated Learning (BFL) enables uncertainty quantification and robust adaptation in distributed learning. In contrast to the frequentist approach, it estimates the posterior distribution of a global model, offering insights into…

Machine Learning · Computer Science 2025-04-23 Usevalad Milasheuski , Luca Barbieri , Sanaz Kianoush , Monica Nicoli , Stefano Savazzi

Inferential challenges that arise when data are censored have been extensively studied under the classical frameworks. In this paper, we provide an alternative generalized inferential model approach whose output is a data-dependent…

Methodology · Statistics 2021-11-16 Joyce Cahoon , Ryan Martin

Post-data statistical inference concerns making probability statements about model parameters conditional on observed data. When a priori knowledge about parameters is available, post-data inference can be conveniently made from Bayesian…

Statistics Theory · Mathematics 2025-06-05 Yang Liu , Jan Hannig , Alexander C Murph

This paper describes the use of flexible Bayesian regression models for estimating a partially identified probability function. Our approach permits efficient sensitivity analysis concerning the posterior impact of priors on the partially…

Methodology · Statistics 2015-03-10 P. Richard Hahn , Jared S. Murray , Ioanna Manolopoulou

In Bayesian classification, it is important to establish a probabilistic model for each class for likelihood estimation. Most of the previous methods modeled the probability distribution in the whole sample space. However, real-world…

Machine Learning · Computer Science 2018-12-14 Chengsheng Mao , Lijuan Lu , Bin Hu

PAC-Bayesian bounds are known to be tight and informative when studying the generalization ability of randomized classifiers. However, they require a loose and costly derandomization step when applied to some families of deterministic…

Machine Learning · Statistics 2023-09-19 Paul Viallard , Pascal Germain , Amaury Habrard , Emilie Morvant

Standard Bayesian inference is known to be sensitive to model misspecification, leading to unreliable uncertainty quantification and poor predictive performance. However, finding generally applicable and computationally feasible methods for…

Methodology · Statistics 2020-07-31 Jonathan H. Huggins , Jeffrey W. Miller

We introduce a novel uncertainty estimation for classification tasks for Bayesian convolutional neural networks with variational inference. By normalizing the output of a Softplus function in the final layer, we estimate aleatoric and…

Machine Learning · Computer Science 2019-05-15 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

When collaborating with an AI system, we need to assess when to trust its recommendations. If we mistakenly trust it in regions where it is likely to err, catastrophic failures may occur, hence the need for Bayesian approaches for…

Artificial Intelligence · Computer Science 2021-02-23 Federico Cerutti , Lance M. Kaplan , Angelika Kimmig , Murat Sensoy

Statistical models typically capture uncertainties in our knowledge of the corresponding real-world processes, however, it is less common for this uncertainty specification to capture uncertainty surrounding the values of the inputs to the…

Methodology · Statistics 2023-05-10 Samuel E. Jackson , David C. Woods

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

We present a semantics for adding uncertainty to conditional logics for default reasoning and belief revision. We are able to treat conditional sentences as statements of conditional probability, and express rules for revision such as "If A…

Artificial Intelligence · Computer Science 2013-03-08 Craig Boutilier

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen

Generalized linear models (GLMs) are routinely used for modeling relationships between a response variable and a set of covariates. The simple form of a GLM comes with easy interpretability, but also leads to concerns about model…

Methodology · Statistics 2023-11-10 Davide Agnoletto , Tommaso Rigon , David B. Dunson

We propose a generic framework to calibrate accuracy and confidence of a prediction in deep neural networks through stochastic inferences. We interpret stochastic regularization using a Bayesian model, and analyze the relation between…

Machine Learning · Computer Science 2019-04-25 Seonguk Seo , Paul Hongsuck Seo , Bohyung Han

Rigorous statistical methods, including parameter estimation with accompanying uncertainties, underpin the validity of scientific discovery, especially in the natural sciences. With increasingly complex data models such as deep learning…

Machine Learning · Computer Science 2026-02-18 Aurora Grefsrud , Nello Blaser , Trygve Buanes

It is argued that the Calibrated Bayesian (CB) approach to statistical inference capitalizes on the strength of Bayesian and frequentist approaches to statistical inference. In the CB approach, inferences under a particular model are…

Methodology · Statistics 2011-08-10 Roderick Little