English
Related papers

Related papers: A principled framework for uncertainty decompositi…

200 papers

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

In many inverse problems, model parameters cannot be precisely determined from observational data. Bayesian inference provides a mechanism for capturing the resulting parameter uncertainty, but typically at a high computational cost. This…

Computation · Statistics 2019-03-28 Matthew Parno , Tarek Moselhy , Youssef Marzouk

Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov…

Machine Learning · Computer Science 2025-11-11 Di Zhang

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

Bayesian nonparametric (BNP) models provide elegant methods for discovering underlying latent features within a data set, but inference in such models can be slow. We exploit the fact that completely random measures, which commonly used…

Machine Learning · Statistics 2020-07-17 Avinava Dubey , Michael Minyi Zhang , Eric P. Xing , Sinead A. Williamson

Tensor decomposition is an important technique for capturing the high-order interactions among multiway data. Multi-linear tensor composition methods, such as the Tucker decomposition and the CANDECOMP/PARAFAC (CP), assume that the complex…

Machine Learning · Statistics 2016-11-04 Bin Liu , Zenglin Xu , Yingming Li

Interpretability is central for scientific machine learning, as understanding \emph{why} models make predictions enables hypothesis generation and validation. While tabular foundation models show strong performance, existing explanation…

Machine Learning · Computer Science 2026-04-01 Luan Borges Teodoro Reis Sena , Francisco Galuppo Azevedo

This work introduces a new method designed for Bayesian deep learning called scalable Bayesian Monte Carlo (SBMC). The method is comprised of a model and an algorithm. The model interpolates between a point estimator and the posterior. The…

Configurable software systems are employed in many important application domains. Understanding the performance of the systems under all configurations is critical to prevent potential performance issues caused by misconfiguration. However,…

Software Engineering · Computer Science 2022-12-29 Huong Ha , Zongwen Fan , Hongyu Zhang

Bayesian neural networks (BNNs) hold great promise as a flexible and principled solution to deal with uncertainty when learning from finite data. Among approaches to realize probabilistic inference in deep neural networks, variational Bayes…

Reliable uncertainty estimation is crucial for machine learning models, especially in safety-critical domains. While exact Bayesian inference offers a principled approach, it is often computationally infeasible for deep neural networks.…

Machine Learning · Computer Science 2025-12-18 Aslak Djupskås , Alexander Johannes Stasik , Signe Riemer-Sørensen

Bayesian inference for neural networks, or Bayesian deep learning, has the potential to provide well-calibrated predictions with quantified uncertainty and robustness. However, the main hurdle for Bayesian deep learning is its computational…

Machine Learning · Statistics 2023-09-07 Sanket Jantre , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

Geotechnical site characterisation relies on sparse, heterogeneous borehole data, where uncertainty quantification and interpretability matter as much as predictive accuracy. We evaluate TabPFN~\citep{Hollmann2025}, a tabular foundation…

Computational Engineering, Finance, and Science · Computer Science 2026-05-21 Taiga Saito , Yu Otake , Daijiro Mizutani , Stephen Wu

The past decades have seen enormous improvements in computational inference based on statistical models, with continual enhancement in a wide range of computational tools, in competition. In Bayesian inference, first and foremost, MCMC…

Computation · Statistics 2015-05-12 Peter J. Green , Krzysztof Łatuszyński , Marcelo Pereyra , Christian P. Robert

Emerging deep-learning (DL)-based techniques have significant potential to revolutionize biomedical imaging. However, one outstanding challenge is the lack of reliability assessment in the DL predictions, whose errors are commonly revealed…

Image and Video Processing · Electrical Eng. & Systems 2019-05-07 Yujia Xue , Shiyi Cheng , Yunzhe Li , Lei Tian

Missing data is a widespread problem in tabular settings. Existing solutions range from simple averaging to complex generative adversarial networks, but due to each method's large variance in performance across real-world domains and…

Machine Learning · Computer Science 2026-02-18 Jacob Feitelberg , Dwaipayan Saha , Kyuseong Choi , Zaid Ahmad , Anish Agarwal , Raaz Dwivedi

Decomposing prediction uncertainty into aleatoric (irreducible) and epistemic (reducible) components is critical for the reliable deployment of machine learning systems. While the mutual information between the response variable and model…

Machine Learning · Statistics 2026-02-10 Anchit Jain , Stephen Bates

Invariant prediction [Peters et al., 2016] analyzes feature/outcome data from multiple environments to identify invariant features - those with a stable predictive relationship to the outcome. Such features support generalization to new…

Machine Learning · Statistics 2025-07-10 Luhuan Wu , Mingzhang Yin , Yixin Wang , John P. Cunningham , David M. Blei

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos
‹ Prev 1 3 4 5 6 7 10 Next ›