English
Related papers

Related papers: Locally Learned Synaptic Dropout for Complete Baye…

200 papers

This paper describes a Bayesian method for learning causal networks using samples that were selected in a non-random manner from a population of interest. Examples of data obtained by non-random sampling include convenience samples and…

Artificial Intelligence · Computer Science 2013-01-18 Gregory F. Cooper

Dropout is one of the key techniques to prevent the learning from overfitting. It is explained that dropout works as a kind of modified L2 regularization. Here, we shed light on the dropout from Bayesian standpoint. Bayesian interpretation…

Machine Learning · Computer Science 2014-12-31 Shin-ichi Maeda

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

Bayesian Networks (BNs) are useful tools giving a natural and compact representation of joint probability distributions. In many applications one needs to learn a Bayesian Network (BN) from data. In this context, it is important to…

Machine Learning · Computer Science 2012-07-02 Or Zuk , Shiri Margel , Eytan Domany

Classical Bayesian persuasion assumes that senders fully understand how receivers form beliefs and make decisions--an assumption that rarely holds when receivers possess private information or exhibit non-Bayesian behavior. In this paper,…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Heeseung Bang , Andreas A. Malikopoulos

Dependency networks (Heckerman et al., 2000) provide a flexible framework for modeling complex systems with many variables by combining independently learned local conditional distributions through pseudo-Gibbs sampling. Despite their…

Machine Learning · Computer Science 2026-04-02 Kazuya Takabatake , Shotaro Akaho

Dropout, a stochastic regularisation technique for training of neural networks, has recently been reinterpreted as a specific type of approximate inference algorithm for Bayesian neural networks. The main contribution of the…

Machine Learning · Statistics 2018-07-06 Jiri Hron , Alexander G. de G. Matthews , Zoubin Ghahramani

Understanding how recurrent neural circuits can learn to implement dynamical systems is a fundamental challenge in neuroscience. The credit assignment problem, i.e. determining the local contribution of each synapse to the network's global…

Neurons and Cognition · Quantitative Biology 2017-08-08 Alireza Alemi , Christian Machens , Sophie Denève , Jean-Jacques Slotine

We revisit empirical Bayes in the absence of a tractable likelihood function, as is typical in scientific domains relying on computer simulations. We investigate how the empirical Bayesian can make use of neural density estimators first to…

Machine Learning · Statistics 2021-03-02 Maxime Vandegar , Michael Kagan , Antoine Wehenkel , Gilles Louppe

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

Machine Learning · Statistics 2013-07-10 Diane Oyen , Terran Lane

Sampling-based planning is the predominant paradigm for motion planning in robotics. Most sampling-based planners use a global random sampling scheme to guarantee probabilistic completeness. However, most schemes are often inefficient as…

Robotics · Computer Science 2020-01-22 Tin Lai , Philippe Morere , Fabio Ramos , Gilad Francis

Bayesian learning provides a unified skeleton to solve the electrophysiological source imaging task. From this perspective, existing source imaging algorithms utilize the Gaussian assumption for the observation noise to build the likelihood…

Machine Learning · Computer Science 2025-08-07 Yuanhao Li , Badong Chen , Zhongxu Hu , Keita Suzuki , Wenjun Bai , Yasuharu Koike , Okito Yamashita

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

While variational dropout approaches have been shown to be effective for network sparsification, they are still suboptimal in the sense that they set the dropout rate for each neuron without consideration of the input data. With such…

Machine Learning · Statistics 2019-03-05 Juho Lee , Saehoon Kim , Jaehong Yoon , Hae Beom Lee , Eunho Yang , Sung Ju Hwang

Recently several researchers have investigated techniques for using data to learn Bayesian networks containing compact representations for the conditional probability distributions (CPDs) stored at each node. The majority of this work has…

Machine Learning · Computer Science 2015-05-19 David Maxwell Chickering , David Heckerman , Christopher Meek

The plasticity of the conduction delay between neurons plays a fundamental role in learning. However, the exact underlying mechanisms in the brain for this modulation is still an open problem. Understanding the precise adjustment of…

Neural and Evolutionary Computing · Computer Science 2020-11-19 Alireza Nadafian , Mohammad Ganjtabesh

In structural brain networks the connections of interest consist of white-matter fibre bundles between spatially segregated brain regions. The presence, location and orientation of these white matter tracts can be derived using diffusion…

Neurons and Cognition · Quantitative Biology 2012-02-09 M. Hinne , T. Heskes , M. A. J. van Gerven

The means by which cortical neural networks are able to efficiently solve inference problems remains an open question in computational neuroscience. Recently, abstract models of Bayesian computation in neural circuits have been proposed,…

Neurons and Cognition · Quantitative Biology 2015-02-24 Dimitri Probst , Mihai A. Petrovici , Ilja Bytschok , Johannes Bill , Dejan Pecevski , Johannes Schemmel , Karlheinz Meier

A central question in computational neuroscience is how structure determines function in neural networks. The emerging high-quality large-scale connectomic datasets raise the question of what general functional principles can be gleaned…

Neurons and Cognition · Quantitative Biology 2022-10-25 Weishun Zhong , Ben Sorscher , Daniel D Lee , Haim Sompolinsky

Real-world data contains aleatoric uncertainty - irreducible noise arising from imperfect measurements or from incomplete knowledge about the data generation process. Mean-variance estimation networks can learn this type of uncertainty but…

Machine Learning · Computer Science 2026-05-29 Jiaxiang Yi , Miguel A. Bessa