English
Related papers

Related papers: Uncertainty Quantification for Sparse Deep Learnin…

200 papers

The major goal of this paper is to study the second order frequentist properties of the marginal posterior distribution of the parametric component in semiparametric Bayesian models, in particular, a second order semiparametric…

Statistics Theory · Mathematics 2015-03-17 Yun Yang , Guang Cheng , David B. Dunson

Quantile regression, a robust method for estimating conditional quantiles, has advanced significantly in fields such as econometrics, statistics, and machine learning. In high-dimensional settings, where the number of covariates exceeds…

Machine Learning · Statistics 2024-09-04 The Tien Mai

Conventional uncertainty quantification methods usually lacks the capability of dealing with high-dimensional problems due to the curse of dimensionality. This paper presents a semi-supervised learning framework for dimension reduction and…

Machine Learning · Statistics 2020-06-02 Zequn Wang , Mingyang Li

Bayesian inference and kernel methods are well established in machine learning. The neural network Gaussian process in particular provides a concept to investigate neural networks in the limit of infinitely wide hidden layers by using…

Disordered Systems and Neural Networks · Physics 2023-11-10 Javed Lindner , David Dahmen , Michael Krämer , Moritz Helias

Uncertainty quantification is vital for safety-critical Deep Learning applications like medical image segmentation. We introduce BA U-Net, an uncertainty-aware model for MRI segmentation that integrates Bayesian Neural Networks with…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Lohith Konathala

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

Machine Learning · Statistics 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

In this work, we present a new class of models, called uncertain-input models, that allows us to treat system-identification problems in which a linear system is subject to a partially unknown input signal. To encode prior information about…

Systems and Control · Computer Science 2017-09-12 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Negativities in quasiprobability distributions, a foundational concept originating in quantum optics, serve as a fundamental signature of quantum nonclassicality, with entanglement quasiprobabilities offering a necessary and sufficient…

Quantum Physics · Physics 2026-03-20 Yu-Zhuo Li , Li-Chao Peng , Ke-Mi Xu

The key distinguishing property of a Bayesian approach is marginalization, rather than using a single setting of weights. Bayesian marginalization can particularly improve the accuracy and calibration of modern deep neural networks, which…

Machine Learning · Computer Science 2022-03-31 Andrew Gordon Wilson , Pavel Izmailov

Modern deep learning tools are remarkably effective in addressing intricate problems. However, their operation as black-box models introduces increased uncertainty in predictions. Additionally, they contend with various challenges,…

Machine Learning · Computer Science 2024-04-09 Sourav Ganguly , Saprativa Bhattacharjee

This study proposes a novel approach to quantifying uncertainties of constitutive relations inferred from noisy experimental data using inverse modelling. We focus on electrochemical systems in which charged species (e.g., Lithium ions) are…

Chemical Physics · Physics 2020-03-12 Athinthra Sethurajan , Sergey Krachkovskiy , Gillian Goward , Bartosz Protas

Uncertainty quantification (UQ) plays a pivotal role in reduction of uncertainties during both optimization and decision making processes. It can be applied to solve a variety of real-world applications in science and engineering. Bayesian…

The problem of state estimation for unobservable distribution systems is considered. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning of…

Machine Learning · Statistics 2019-02-26 Kursat Rasim Mestav , Jaime Luengo-Rozas , Lang Tong

Neural network based generative models with discriminative components are a powerful approach for semi-supervised learning. However, these techniques a) cannot account for model uncertainty in the estimation of the model's discriminative…

Machine Learning · Statistics 2017-06-30 Jonathan Gordon , José Miguel Hernández-Lobato

Bayesian deep learning plays an important role especially for its ability evaluating epistemic uncertainty (EU). Due to computational complexity issues, approximation methods such as variational inference (VI) have been used in practice to…

Machine Learning · Statistics 2022-10-12 Futoshi Futami , Tomoharu Iwata , Naonori Ueda , Issei Sato , Masashi Sugiyama

In this work, we investigate the value of uncertainty modeling in 3D super-resolution with convolutional neural networks (CNNs). Deep learning has shown success in a plethora of medical image transformation problems, such as…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Ryutaro Tanno , Daniel E. Worrall , Aurobrata Ghosh , Enrico Kaden , Stamatios N. Sotiropoulos , Antonio Criminisi , Daniel C. Alexander

In this paper we propose a novel method which leverages the uncertainty measures provided by Bayesian deep networks through curriculum learning so that the uncertainty estimates are fed back to the system to resample the training data more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Sora Iwamoto , Bisser Raytchev , Toru Tamaki , Kazufumi Kaneda

A Bernstein-von Mises theorem is derived for general semiparametric functionals. The result is applied to a variety of semiparametric problems in i.i.d. and non-i.i.d. situations. In particular, new tools are developed to handle…

Statistics Theory · Mathematics 2016-08-11 Ismaël Castillo , Judith Rousseau

Reliable MRI is crucial for accurate interpretation in therapeutic and diagnostic tasks. However, undersampling during MRI acquisition as well as the overparameterized and non-transparent nature of deep learning (DL) leaves substantial…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Vineet Edupuganti , Morteza Mardani , Shreyas Vasanawala , John Pauly