English
Related papers

Related papers: Full Bayesian Significance Testing for Neural Netw…

200 papers

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

Network interpretation as an effort to reveal the features learned by a network remains largely visualization-based. In this paper, our goal is to tackle semantic network interpretation at both filter and decision level. For filter-level…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Pei Guo , Ryan Farrell

Functional connectivity fingerprints are among today's best choices to obtain a faithful sampling of an individual's brain and cognition in health and disease. Here we make a case for key advantages of analyzing such connectome profiles…

Methodology · Statistics 2019-09-06 Danilo Bzdok , Dorothea L. Floris , Andre F. Marquand

Network data, characterized by interconnected nodes and edges, is pervasive in various domains and has gained significant popularity in recent years. In network data analysis, testing the presence of community structure in a network is one…

Methodology · Statistics 2023-07-27 Mingao Yuan , Sharmin Hossain , Zuofeng Shang

Modeling natural phenomena with artificial neural networks (ANNs) often provides highly accurate predictions. However, ANNs often suffer from over-parameterization, complicating interpretation and raising uncertainty issues. Bayesian neural…

Machine Learning · Statistics 2025-03-14 Eirik Høyheim , Lars Skaaret-Lund , Solve Sæbø , Aliaksandr Hubin

Bayesian Neural Networks (BNNs) place priors over the parameters in a neural network. Inference in BNNs, however, is difficult; all inference methods for BNNs are approximate. In this work, we empirically compare the quality of predictive…

Machine Learning · Computer Science 2019-06-25 Jiayu Yao , Weiwei Pan , Soumya Ghosh , Finale Doshi-Velez

Recently, several methods have been proposed to explain the predictions of recurrent neural networks (RNNs), in particular of LSTMs. The goal of these methods is to understand the network's decisions by assigning to each input variable,…

Machine Learning · Computer Science 2019-06-05 Leila Arras , Ahmed Osman , Klaus-Robert Müller , Wojciech Samek

Bayesian Flow Networks (BFNs) has been recently proposed as one of the most promising direction to universal generative modelling, having ability to learn any of the data type. Their power comes from the expressiveness of neural networks…

Machine Learning · Computer Science 2023-10-19 Mateusz Pyla , Kamil Deja , Bartłomiej Twardowski , Tomasz Trzciński

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

Machine Learning · Computer Science 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

Various problems in Engineering and Statistics require the computation of the likelihood ratio function of two probability densities. In classical approaches the two densities are assumed known or to belong to some known parametric family.…

Signal Processing · Electrical Eng. & Systems 2019-11-06 George V. Moustakides , Kalliopi Basioti

Deep neural networks (DNNs) have a wide range of applications, and software employing them must be thoroughly tested, especially in safety-critical domains. However, traditional software test coverage metrics cannot be applied directly to…

Machine Learning · Computer Science 2019-04-16 Youcheng Sun , Xiaowei Huang , Daniel Kroening , James Sharp , Matthew Hill , Rob Ashmore

A crucial task in predictive maintenance is estimating the remaining useful life of physical systems. In the last decade, deep learning has improved considerably upon traditional model-based and statistical approaches in terms of predictive…

Machine Learning · Computer Science 2024-02-05 Luca Della Libera , Jacopo Andreoli , Davide Dalle Pezze , Mirco Ravanelli , Gian Antonio Susto

Bayesian Neural Networks (BNNs) offer probability distributions for model parameters, enabling uncertainty quantification in predictions. However, they often underperform compared to deterministic neural networks. Utilizing mutual learning…

Machine Learning · Computer Science 2024-07-04 Cuong Pham , Cuong C. Nguyen , Trung Le , Dinh Phung , Gustavo Carneiro , Thanh-Toan Do

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improving uncertainty…

The key distinguishing property of a Bayesian approach is marginalization, rather than using a single setting of weights. Bayesian marginalization can particularly improve the accuracy and calibration of modern deep neural networks, which…

Machine Learning · Computer Science 2022-03-31 Andrew Gordon Wilson , Pavel Izmailov

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the…

High Energy Physics - Phenomenology · Physics 2022-11-10 Ernesto Arganda , Xabier Marcano , Víctor Martín Lozano , Anibal D. Medina , Andres D. Perez , Manuel Szewc , Alejandro Szynkman

In this paper, we propose a new spectral-based approach to hypothesis testing for populations of networks. The primary goal is to develop a test to determine whether two given samples of networks come from the same random model or…

Methodology · Statistics 2020-11-26 Li Chen , Nathaniel Josephs , Lizhen Lin , Jie Zhou , Eric D. Kolaczyk