English
Related papers

Related papers: A Bayesian regularization-backpropagation neural n…

200 papers

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

In multimedia forensics, learning-based methods provide state-of-the-art performance in determining origin and authenticity of images and videos. However, most existing methods are challenged by out-of-distribution data, i.e., with…

Machine Learning · Computer Science 2020-07-29 Anatol Maier , Benedikt Lorch , Christian Riess

Neural network pruning is a highly effective technique aimed at reducing the computational and memory demands of large neural networks. In this research paper, we present a novel approach to pruning neural networks utilizing Bayesian…

Machine Learning · Statistics 2023-08-07 Sunil Mathew , Daniel B. Rowe

Significant success has been reported recently using deep neural networks for classification. Such large networks can be computationally intensive, even after training is over. Implementing these trained networks in hardware chips with a…

Machine Learning · Statistics 2013-10-25 Daniel Soudry , Ron Meir

We combine nonlocal effects with Bayesian Neural Network (BNN) methods to enhance the prediction accuracy of $\alpha$ decay half-lives. The results indicate that accounting for nonlocal effects significantly impacts the half-life…

Nuclear Theory · Physics 2025-10-17 Xuanpeng Xiao , Panpan Qi , Gongming Yu , Haitao Yang , Qiang Hu

Recurrent neural networks (RNNs) have shown promising performance for language modeling. However, traditional training of RNNs using back-propagation through time often suffers from overfitting. One reason for this is that stochastic…

Computation and Language · Computer Science 2017-04-25 Zhe Gan , Chunyuan Li , Changyou Chen , Yunchen Pu , Qinliang Su , Lawrence Carin

The prediction of tool wear helps minimize costs and enhance product quality in manufacturing. While existing data-driven models using machine learning and deep learning have contributed to the accurate prediction of tool wear, they often…

Computational Engineering, Finance, and Science · Computer Science 2023-12-01 Tam T. Truong , Jay Airao , Panagiotis Karras , Faramarz Hojati , Bahman Azarhoushang , Ramin Aghababaei

Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still largely solved with hand-crafted solvers. To bridge this gap,…

Machine Learning · Computer Science 2020-07-02 Jonathan Kuck , Shuvam Chakraborty , Hao Tang , Rachel Luo , Jiaming Song , Ashish Sabharwal , Stefano Ermon

The success of deep learning in many real-world tasks has triggered an intense effort to understand the power and limitations of deep learning in the training and generalization of complex tasks, so far with limited progress. In this work,…

Machine Learning · Computer Science 2021-09-22 Qianyi Li , Haim Sompolinsky

Despite its long history, Bayesian neural networks (BNNs) and variational training remain underused in practice: standard Gaussian posteriors misalign with network geometry, KL terms can be brittle in high dimensions, and implementations…

Machine Learning · Computer Science 2025-09-09 Carlos Stein Brito

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

Machine Learning · Computer Science 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

Deep learning has been used to improve photoacoustic (PA) image reconstruction. One major challenge is that errors cannot be quantified to validate predictions when ground truth is unknown. Validation is key to quantitative applications,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Ruibo Shang , Geoffrey P. Luke , Matthew O'Donnell

$\alpha$ decay is an important probe for studying the structure of heavy and superheavy nuclei, in which the $\alpha$-particle preformation ($P_{\alpha}$) is a key physical quantity for describing decay half-lives. This work develops a…

Nuclear Theory · Physics 2026-03-10 Xiao-Yan Zhu , Heng-Jian Si-Tu , Hao Zhang , Wei Gao , Wen-Bin Lin , Xiao-Hua Li

In this work we explore a straightforward variational Bayes scheme for Recurrent Neural Networks. Firstly, we show that a simple adaptation of truncated backpropagation through time can yield good quality uncertainty estimates and superior…

Machine Learning · Computer Science 2019-05-13 Meire Fortunato , Charles Blundell , Oriol Vinyals

A Bayesian Network (BN) is a probabilistic model that represents a set of variables using a directed acyclic graph (DAG). Current algorithms for learning BN structures from data focus on estimating the edges of a specific DAG, and often…

Combinatorics · Mathematics 2022-10-17 Luke Duttweiler , Sally W. Thurston , Anthony Almudevar

Convolutional neural networks (CNNs) have been established as the main workhorse in image data processing; nonetheless, they require large amounts of data to train, often produce overconfident predictions, and frequently lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Sarah Harkins Dayton , Hayden Everett , Ioannis Schizas , David L. Boothe , Vasileios Maroulas

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which…

Instrumentation and Methods for Astrophysics · Physics 2023-06-21 Héctor J. Hortúa , Luz Ángela García , Leonardo Castañeda C

Convolutional neural networks (CNNs) work well on large datasets. But labelled data is hard to collect, and in some applications larger amounts of data are not available. The problem then is how to use CNNs with small data -- as CNNs…

Machine Learning · Statistics 2016-01-19 Yarin Gal , Zoubin Ghahramani

Unfolded proximal neural networks (PNNs) form a family of methods that combines deep learning and proximal optimization approaches. They consist in designing a neural network for a specific task by unrolling a proximal algorithm for a fixed…

Optimization and Control · Mathematics 2024-08-19 Xiaoyu Wang , Martin Benning , Audrey Repetti