English
Related papers

Related papers: Accelerated Execution of Bayesian Neural Networks …

200 papers

Meta-learning is a framework in which machine learning models train over a set of datasets in order to produce predictions on new datasets at test time. Probabilistic meta-learning has received an abundance of attention from the research…

Machine Learning · Statistics 2023-09-07 Tommy Rochussen

This paper investigates two prominent probabilistic neural modeling paradigms: Bayesian Neural Networks (BNNs) and Mixture Density Networks (MDNs) for uncertainty-aware nonlinear regression. While BNNs incorporate epistemic uncertainty by…

Computation · Statistics 2025-10-30 Riddhi Pratim Ghosh , Ian Barnett

Neural networks (NNs) have demonstrated their potential in a wide range of applications such as image recognition, decision making or recommendation systems. However, standard NNs are unable to capture their model uncertainty which is…

Hardware Architecture · Computer Science 2021-12-02 Hongxiang Fan , Martin Ferianc , Miguel Rodrigues , Hongyu Zhou , Xinyu Niu , Wayne Luk

Quantifying the uncertainty in the output of a neural network is essential for deployment in scientific or engineering applications where decisions must be made under limited or noisy data. Bayesian neural networks (BNNs) provide a…

Machine Learning · Statistics 2026-03-10 Alex Alberts , Ilias Bilionis

We study wide Bayesian neural networks focusing on the rare but statistically dominant fluctuations that govern posterior concentration, beyond Gaussian-process limits. Large-deviation theory provides explicit variational objectives-rate…

Machine Learning · Statistics 2026-02-27 Katerina Papagiannouli , Dario Trevisan , Giuseppe Pio Zitto

Stochastic differential equations are commonly used to describe the evolution of stochastic processes. The state uncertainty of such processes is best represented by the probability density function (PDF), whose evolution is governed by the…

Machine Learning · Computer Science 2026-03-03 Chun-Wei Kong , Luca Laurenti , Jay McMahon , Morteza Lahijanian

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

Traditional neural networks are simple to train but they typically produce overconfident predictions. In contrast, Bayesian neural networks provide good uncertainty quantification but optimizing them is time consuming due to the large…

Machine Learning · Computer Science 2024-11-07 Yadi Wei , Roni Khardon

In multimedia forensics, learning-based methods provide state-of-the-art performance in determining origin and authenticity of images and videos. However, most existing methods are challenged by out-of-distribution data, i.e., with…

Machine Learning · Computer Science 2020-07-29 Anatol Maier , Benedikt Lorch , Christian Riess

In recent years, neural networks (NNs) have become increasingly popular for surrogate modeling tasks in mechanics and materials modeling applications. While traditional NNs are deterministic functions that rely solely on data to learn the…

Machine Learning · Statistics 2025-01-03 Javad Ghorbanian , Nicholas Casaprima , Audrey Olivier

Single-pixel imaging (SPI) has the advantages of high-speed acquisition over a broad wavelength range and system compactness, which are difficult to achieve by conventional imaging sensors. However, a common challenge is low image quality…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Ruibo Shang , Mikaela A. O'Brien , Geoffrey P. Luke

The reliable operation of modern power grids requires probabilistic load forecasts with well-calibrated uncertainty estimates. However, existing deep learning models produce overconfident point predictions that fail catastrophically under…

Machine Learning · Computer Science 2026-03-10 Sajib Debnath , Md. Uzzal Mia

Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of…

Machine Learning · Computer Science 2024-04-15 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi

Despite their compelling theoretical properties, Bayesian neural networks (BNNs) tend to perform worse than frequentist methods in classification-based uncertainty quantification (UQ) tasks such as out-of-distribution (OOD) detection. In…

Machine Learning · Computer Science 2022-02-03 Agustinus Kristiadi , Matthias Hein , Philipp Hennig

Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Kashyap Chitta , Jose M. Alvarez , Adam Lesnikowski

Bayesian networks (BNs) are attractive, because they are graphical and interpretable machine learning models. However, exact inference on BNs is time-consuming, especially for complex problems. To improve the efficiency, we propose a fast…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-14 Jiantong Jiang , Zeyi Wen , Atif Mansoor , Ajmal Mian

As data size and computing power increase, the architectures of deep neural networks (DNNs) have been getting more complex and huge, and thus there is a growing need to simplify such complex and huge DNNs. In this paper, we propose a novel…

Machine Learning · Statistics 2023-05-24 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Yongdai Kim

Deep Learning is considered to be a quite young in the area of machine learning research, found its effectiveness in dealing complex yet high dimensional dataset that includes but limited to images, text and speech etc. with multiple levels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Mrutyunjaya Panda

Deep neural network (DNN) models have achieved state-of-the-art predictive accuracy in a wide range of supervised learning applications. However, accurately quantifying the uncertainty in DNN predictions remains a challenging task. For…

Machine Learning · Computer Science 2022-06-14 Daiwei Zhang , Tianci Liu , Jian Kang

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

Machine Learning · Computer Science 2024-01-24 Sebastian W. Ober