English
Related papers

Related papers: Informative Bayesian Neural Network Priors for Wea…

200 papers

Efficiently quantifying predictive uncertainty in medical images remains a challenge. While Bayesian neural networks (BNN) offer predictive uncertainty, they require substantial computational resources to train. Although Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zeinab Abboud , Herve Lombaert , Samuel Kadoury

We propose a framework called HyperVAE for encoding distributions of distributions. When a target distribution is modeled by a VAE, its neural network parameters \theta is drawn from a distribution p(\theta) which is modeled by a…

Machine Learning · Statistics 2022-05-16 Phuoc Nguyen , Truyen Tran , Sunil Gupta , Santu Rana , Hieu-Chi Dam , Svetha Venkatesh

We develop a new Bayesian framework based on deep neural networks to be able to extrapolate in space-time using historical data and to quantify uncertainties arising from both noisy and gappy data in physical problems. Specifically, the…

Machine Learning · Computer Science 2022-03-14 Xuhui Meng , Liu Yang , Zhiping Mao , Jose del Aguila Ferrandis , George Em Karniadakis

Probabilistic neural networks are typically modeled with independent weight priors, which do not capture weight correlations in the prior and do not provide a parsimonious interface to express properties in function space. A desirable class…

Machine Learning · Statistics 2020-02-12 Theofanis Karaletsos , Thang D. Bui

When approaching a novel visual recognition problem in a specialized image domain, a common strategy is to start with a pre-trained deep neural network and fine-tune it to the specialized domain. If the target domain covers a smaller visual…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Frederick Tung , Srikanth Muralidharan , Greg Mori

Machine learning models perform well across domains such as diagnostics, weather forecasting, NLP, and autonomous driving, but their limited uncertainty handling restricts use in safety-critical settings. Traditional neural networks often…

Machine Learning · Computer Science 2025-12-01 Bernhard Klein , Falk Selker , Hendrik Borras , Sophie Steger , Franz Pernkopf , Holger Fröning

Bayesian neural networks have shown great promise in many applications where calibrated uncertainty estimates are crucial and can often also lead to a higher predictive performance. However, it remains challenging to choose a good prior…

Machine Learning · Statistics 2021-05-17 Vincent Fortuin , Adrià Garriga-Alonso , Mark van der Wilk , Laurence Aitchison

Modeling data uncertainty is important for noisy images, but seldom explored for face recognition. The pioneer work, PFE, considers uncertainty by modeling each face image embedding as a Gaussian distribution. It is quite effective.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Jie Chang , Zhonghao Lan , Changmao Cheng , Yichen Wei

We propose a simple algorithm to train stochastic neural networks to draw samples from given target distributions for probabilistic inference. Our method is based on iteratively adjusting the neural network parameters so that the output…

Machine Learning · Statistics 2017-11-01 Yihao Feng , Dilin Wang , Qiang Liu

Bayesian neural networks (BNNs) hold great promise as a flexible and principled solution to deal with uncertainty when learning from finite data. Among approaches to realize probabilistic inference in deep neural networks, variational Bayes…

In recent years, neural networks have revolutionized various domains, yet challenges such as hyperparameter tuning and overfitting remain significant hurdles. Bayesian neural networks offer a framework to address these challenges by…

Machine Learning · Computer Science 2025-12-16 Hayk Amirkhanian , Marco F. Huber

Well-established methods for the solution of stochastic partial differential equations (SPDEs) typically struggle in problems with high-dimensional inputs/outputs. Such difficulties are only amplified in large-scale applications where even…

Machine Learning · Statistics 2019-09-10 Constantin Grigo , Phaedon-Stelios Koutsourelakis

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

Information Theory · Computer Science 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

Scientific machine learning has been successfully applied to inverse problems and PDE discovery in computational physics. One caveat concerning current methods is the need for large amounts of ("clean") data, in order to characterize the…

Numerical Analysis · Mathematics 2021-11-30 Christophe Bonneville , Christopher J. Earls

Normal priors with unknown variance (NUV) have long been known to promote sparsity and to blend well with parameter learning by expectation maximization (EM). In this paper, we advocate this approach for linear state space models for…

Information Theory · Computer Science 2016-02-10 Hans-Andrea Loeliger , Lukas Bruderer , Hampus Malmberg , Federico Wadehn , Nour Zalmai

Neural networks have shown great predictive power when dealing with various unstructured data such as images and natural languages. The Bayesian neural network captures the uncertainty of prediction by putting a prior distribution for the…

Machine Learning · Statistics 2022-11-28 Kyeongwon Lee , Jaeyong Lee

Recommender systems have been studied extensively due to their practical use in many real-world scenarios. Despite this, generating effective recommendations with sparse user ratings remains a challenge. Side information associated with…

Information Retrieval · Computer Science 2018-07-17 Yifan Chen , Maarten de Rijke

Isotropic Gaussian priors are the de facto standard for modern Bayesian neural network inference. However, it is unclear whether these priors accurately reflect our true beliefs about the weight distributions or give optimal performance. To…

Despite the significant advances in domain generalized stereo matching, existing methods still exhibit domain-specific preferences when transferring from synthetic to real domains, hindering their practical applications in complex and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Peng Xu , Zhiyu Xiang , Jingyun Fu , Tianyu Pu , Hanzhi Zhong , Eryun Liu

Variational inference has been widely used in machine learning literature to fit various Bayesian models. In network analysis, this method has been successfully applied to solve the community detection problems. Although these results are…

Machine Learning · Statistics 2024-05-22 Xuezhen Li , Can M. Le