English
Related papers

Related papers: Hierarchical Bayesian Modeling for Uncertainty Qua…

200 papers

Quantifying uncertainties for machine learning (ML) models is a foundational challenge in modern data analysis. This challenge is compounded by at least two key aspects of the field: (a) inconsistent terminology surrounding uncertainty and…

Machine Learning · Computer Science 2025-06-04 Shubhendu Trivedi , Brian D. Nord

Parameter estimation and inference from complex survey samples typically focuses on global model parameters whose estimators have asymptotic properties, such as from fixed effects regression models. The central challenge is to both mitigate…

Methodology · Statistics 2026-05-13 Matthew R. Williams , F. Hunter McGuire , Terrance D. Savitsky

Majorization-minimization (MM) is a standard iterative optimization technique which consists in minimizing a sequence of convex surrogate functionals. MM approaches have been particularly successful to tackle inverse problems and…

Applications · Statistics 2018-08-01 Yousra Bekhti , Felix Lucka , Joseph Salmon , Alexandre Gramfort

Accurate prediction of dynamical response of structural system depends on the correct modeling of that system. However, modeling becomes increasingly challenging when there are many candidate models available to describe the system…

Applications · Statistics 2025-10-06 Subhayan De , Tianhao Yu , Patrick T. Brewick , Erik A. Johnson , Steven F. Wojtkiewicz

Uncertainties from model parameters and model discrepancy from small-scale models impact the accuracy and reliability of predictions of large-scale systems. Inadequate representation of these uncertainties may result in inaccurate and…

Methodology · Statistics 2014-12-18 K. Sham Bhat , David S. Mebane , Curtis B. Storlie , Priyadarshi Mahapatra

Modern deterministic retrieval pipelines prioritize achieving state-of-the-art performance but often lack interpretability in decision-making. These models face challenges in assessing uncertainty, leading to overconfident predictions. To…

Information Retrieval · Computer Science 2024-02-06 EuiYul Song , Philhoon Oh , Sangryul Kim , James Thorne

Updating machine learning models with new information usually improves their predictive performance, yet, in many applications, it is also desirable to avoid changing the model predictions too much. This property is called stability. In…

Machine Learning · Computer Science 2024-02-22 Morten Blørstad , Berent Å. S. Lunde , Nello Blaser

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

Configurable software systems are employed in many important application domains. Understanding the performance of the systems under all configurations is critical to prevent potential performance issues caused by misconfiguration. However,…

Software Engineering · Computer Science 2022-12-29 Huong Ha , Zongwen Fan , Hongyu Zhang

We present a Bayesian nonparametric system reliability model which scales well and provides a great deal of flexibility in modeling. The Bayesian approach naturally handles the disparate amounts of component and subsystem data that may…

Methodology · Statistics 2022-03-22 Richard L. Warr , Jeremy M. Meyer , Jackson T. Curtis

In context-specific applications such as robotics, telecommunications, and healthcare, artificial intelligence systems often face the challenge of limited training data. This scarcity introduces epistemic uncertainty, i.e., reducible…

Information Theory · Computer Science 2026-03-17 Osvaldo Simeone , Yaniv Romano

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

On top of machine learning models, uncertainty quantification (UQ) functions as an essential layer of safety assurance that could lead to more principled decision making by enabling sound risk assessment and management. The safety and…

Machine Learning · Computer Science 2024-03-28 Venkat Nemani , Luca Biggio , Xun Huan , Zhen Hu , Olga Fink , Anh Tran , Yan Wang , Xiaoge Zhang , Chao Hu

Bayesian inference is often implemented using approximations, which can yield interval estimates that are too narrow, not fully capturing the uncertainty in the posterior distribution. We address the question of how to adjust these…

Methodology · Statistics 2026-03-23 Tiffany Cai , Philip Greengard , Ben Goodrich , Andrew Gelman

We study the problem of identifying the set of \emph{active} variables, termed in the literature as \emph{variable selection} or \emph{multiple hypothesis testing}, depending on the pursued criteria. For a general \emph{robust setting} of…

Statistics Theory · Mathematics 2021-09-24 Eduard Belitser , Nurzhan Nurushev

Structural health monitoring (SHM) strategies involve the processing of structural response data to indirectly assess an asset's condition. These strategies can be enhanced for a group of structures, especially when they are similar, since…

Bayesian modelling allows for the quantification of predictive uncertainty which is crucial in safety-critical applications. Yet for many machine learning (ML) algorithms, it is difficult to construct or implement their Bayesian…

Machine Learning · Statistics 2024-10-22 Ziyu Wang , Chris Holmes

Uncertainty quantification is a critical yet unsolved challenge for deep learning, especially for the time series imputation with irregularly sampled measurements. To tackle this problem, we propose a novel framework based on the principles…

Machine Learning · Computer Science 2023-06-05 Shweta Dahale , Sai Munikoti , Balasubramaniam Natarajan

Numerical modeling of morphodynamics presents significant challenges in engineering due to uncertainties arising from inaccurate inputs, model errors, and limited computing resources. Accurate results are essential for optimizing strategies…

Computation · Statistics 2026-01-07 Cédric Goeury , Fabien Souillé