English
Related papers

Related papers: Activation-Space Uncertainty Quantification for Pr…

200 papers

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive…

Computation · Statistics 2023-11-16 Michael Stanley , Mikael Kuusela , Brendan Byrne , Junjie Liu

Uncertainty quantification is an important prerequisite for the deployment of deep learning models in safety-critical areas. Yet, this hinges on the uncertainty estimates being useful to the extent the prediction intervals are…

Machine Learning · Computer Science 2025-07-29 Dharmesh Tailor , Alvaro H. C. Correia , Eric Nalisnick , Christos Louizos

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly.…

Machine Learning · Statistics 2018-10-15 Marko Järvenpää , Michael U. Gutmann , Arijus Pleska , Aki Vehtari , Pekka Marttinen

In classical Hawkes process, the baseline intensity and triggering kernel are assumed to be a constant and parametric function respectively, which limits the model flexibility. To generalize it, we present a fully Bayesian nonparametric…

Machine Learning · Computer Science 2019-10-30 Feng Zhou , Zhidong Li , Xuhui Fan , Yang Wang , Arcot Sowmya , Fang Chen

While backpropagation--reverse-mode automatic differentiation--has been extraordinarily successful in deep learning, it requires two passes (forward and backward) through the neural network and the storage of intermediate activations.…

Machine Learning · Computer Science 2025-11-06 Daniel Wang , Evan Markou , Dylan Campbell

Uncertainty quantification plays an important role in achieving trustworthy and reliable learning-based computational imaging. Recent advances in generative modeling and Bayesian neural networks have enabled the development of…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Canberk Ekmekci , Mujdat Cetin

While uncertainty estimation is a well-studied topic in deep learning, most such work focuses on marginal uncertainty estimates, i.e. the predictive mean and variance at individual input locations. But it is often more useful to estimate…

Machine Learning · Computer Science 2021-03-02 Chaoqi Wang , Shengyang Sun , Roger Grosse

Mode shape information play the essential role in deciding the spatial pattern of vibratory response of a structure. The uncertainty quantification of mode shape, i.e., predicting mode shape variation when the structure is subjected to…

Data Analysis, Statistics and Probability · Physics 2020-02-24 Kai Zhou , Jiong Tang

We consider the accuracy of an approximate posterior distribution in nonparametric regression problems by combining posterior distributions computed on subsets of the data defined by the locations of the independent variables. We show that…

Statistics Theory · Mathematics 2025-04-29 Botond Szabo , Amine Hadji , Aad van der Vaart

This paper presents a hierarchical Bayesian modeling framework for the uncertainty quantification in modal identification of linear dynamical systems using multiple vibration data sets. This novel framework integrates the state-of-the-art…

Methodology · Statistics 2020-05-19 Omid Sedehi , Lambros S. Katafygiotis , Costas Papadimitriou

Substantial research on structured sparsity has contributed to analysis of many different applications. However, there have been few Bayesian procedures among this work. Here, we develop a Bayesian model for structured sparsity that uses a…

Methodology · Statistics 2014-07-09 Barbara E. Engelhardt , Ryan P. Adams

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of…

Materials Science · Physics 2025-03-04 Danny Perez , Aparna P. A. Subramanyam , Ivan Maliyov , Thomas D. Swinburne

Understanding and accounting for uncertainty helps to ensure next-step tokamaks such as SPARC will robustly achieve their goals. While traditional Plasma OPerating CONtour (POPCON) analyses guide design, they often overlook the significant…

Plasma Physics · Physics 2025-06-12 A. Saltzman , P. Rodriguez-Fernandez , T. Body , A. Ho , N. T. Howard

The performance of deep network learning strongly depends on the choice of the non-linear activation function associated with each neuron. However, deciding on the best activation is non-trivial, and the choice depends on the architecture,…

Machine Learning · Computer Science 2020-02-05 Alejandro Molina , Patrick Schramowski , Kristian Kersting

For a theoretical understanding of the reactivity of complex chemical systems, relative energies of stationary points on potential energy hypersurfaces need to be calculated to high accuracy. Due to the large number of intermediates present…

Chemical Physics · Physics 2018-10-30 Gregor N. Simm , Markus Reiher

The current standard Bayesian approach to model calibration, which assigns a Gaussian process prior to the discrepancy term, often suffers from issues of unidentifiability and computational complexity and instability. When the goal is to…

Methodology · Statistics 2019-09-13 Spencer Woody , Novin Ghaffari , Lauren Hund

Estimating posteriors and the associated model evidences, with desired accuracy and affordable computational cost, is a core issue of Bayesian model updating, and can be of great challenge given expensive-to-evaluate models and posteriors…

Computation · Statistics 2026-04-09 Jingwen Song , Pengfei Wei