English
Related papers

Related papers: Synaptic Sampling of Neural Networks

200 papers

Animals are known to make efficient probabilistic inferences based on uncertain and noisy information from the outside world. Although it is known that generic neural networks can perform near-optimal point estimation by probabilistic…

Neurons and Cognition · Quantitative Biology 2021-11-10 Kohei Ichikawa , Asaki Kataoka

Recent studies have shown that synaptic unreliability is a robust and sufficient mechanism for inducing the stochasticity observed in cortex. Here, we introduce Synaptic Sampling Machines, a class of neural network models that uses synaptic…

Neural and Evolutionary Computing · Computer Science 2016-12-16 Emre O. Neftci , Bruno U. Pedroni , Siddharth Joshi , Maruan Al-Shedivat , Gert Cauwenberghs

Building robust, interpretable, and secure AI system requires quantifying and representing uncertainty under a probabilistic perspective to mimic human cognitive abilities. However, probabilistic computation presents significant challenges…

Machine Learning · Computer Science 2024-01-15 Hengyuan Ma , Yang Qi , Li Zhang , Wenlian Lu , Jianfeng Feng

As deep neural networks (DNNs) are applied to increasingly challenging problems, they will need to be able to represent their own uncertainty. Modeling uncertainty is one of the key features of Bayesian methods. Using Bernoulli dropout with…

Machine Learning · Computer Science 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

This paper investigates the use of probabilistic neural networks (PNNs) to model aleatoric uncertainty, which refers to the inherent variability in the input-output relationships of a system, often characterized by unequal variance or…

Machine Learning · Statistics 2024-02-22 Farhad Pourkamali-Anaraki , Jamal F. Husseini , Scott E. Stapleton

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

In image segmentation, there is often more than one plausible solution for a given input. In medical imaging, for example, experts will often disagree about the exact location of object boundaries. Estimating this inherent uncertainty and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Miguel Monteiro , Loïc Le Folgoc , Daniel Coelho de Castro , Nick Pawlowski , Bernardo Marques , Konstantinos Kamnitsas , Mark van der Wilk , Ben Glocker

Efficient sampling of complex high-dimensional probability distributions is a central task in computational science. Machine learning methods like autoregressive neural networks, used with Markov chain Monte Carlo sampling, provide good…

Statistical Mechanics · Physics 2021-11-11 Dian Wu , Riccardo Rossi , Giuseppe Carleo

Uncertainty estimation in Neural Networks (NNs) is vital in improving reliability and confidence in predictions, particularly in safety-critical applications. Bayesian Neural Networks (BayNNs) with Dropout as an approximation offer a…

Machine Learning · Computer Science 2024-01-12 Soyed Tuhin Ahmed , Kamal Danouchi , Michael Hefenbrock , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Spiking Neural Networks (SNNs) capture some of the efficiency of biological brains for inference and learning via the dynamic, online, event-driven processing of binary time series. Most existing learning algorithms for SNNs are based on…

Machine Learning · Computer Science 2021-01-06 Hyeryung Jang , Osvaldo Simeone

Spiking neural networks (SNNs) have gained attention as models of sparse and event-driven communication of biological neurons, and as such have shown increasing promise for energy-efficient applications in neuromorphic hardware. As with…

Neural and Evolutionary Computing · Computer Science 2023-12-08 Tao Sun , Bojian Yin , Sander Bohte

Sampling complex free energy surfaces is one of the main challenges of modern atomistic simulation methods. The presence of kinetic bottlenecks in such surfaces often renders a direct approach useless. A popular strategy is to identify a…

Computational Physics · Physics 2019-09-25 Luigi Bonati , Yue-Yu Zhang , Michele Parrinello

Conventional Monte Carlo simulations are stochastic in the sense that the acceptance of a trial move is decided by comparing a computed acceptance probability with a random number, uniformly distributed between 0 and 1. Here we consider the…

Statistical Mechanics · Physics 2018-05-24 Daan Frenkel , K. Julian Schrenk , Stefano Martiniani

Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems. Companies incur in high costs for testing DNN with datasets representative of the inputs expected in operation, as these need…

Software Engineering · Computer Science 2024-03-29 Antonio Guerriero , Roberto Pietrantuono , Stefano Russo

Biological neural networks effortlessly tackle complex computational problems and excel at predicting outcomes from noisy, incomplete data, a task that poses significant challenges to traditional processors. Artificial neural networks…

In the field of computational physics and material science, the efficient sampling of rare events occurring at atomic scale is crucial. It aids in understanding mechanisms behind a wide range of important phenomena, including protein…

Machine Learning · Computer Science 2024-01-17 Xinru Hua , Rasool Ahmad , Jose Blanchet , Wei Cai

A data-driven approach called CaNN (Calibration Neural Network) is proposed to calibrate financial asset price models using an Artificial Neural Network (ANN). Determining optimal values of the model parameters is formulated as training…

Computational Finance · Quantitative Finance 2020-02-03 Shuaiqiang Liu , Anastasia Borovykh , Lech A. Grzelak , Cornelis W. Oosterlee

Artificial Neural Networks (ANNs) implement a specific form of multi-variate extrapolation and will generate an output for any input pattern, even when there is no similar training pattern. Extrapolations are not necessarily to be trusted,…

Machine Learning · Statistics 2020-02-27 Neil A. Thacker , Carole J. Twining , Paul D. Tar , Scott Notley , Visvanathan Ramesh
‹ Prev 1 2 3 10 Next ›