English
Related papers

Related papers: Multiplicative versus additive noise in multi-stat…

200 papers

A steadily increasing body of evidence suggests that the brain performs probabilistic inference to interpret and respond to sensory input and that trial-to-trial variability in neural activity plays an important role. The neural sampling…

Neurons and Cognition · Quantitative Biology 2017-07-07 Ilja Bytschok , Dominik Dold , Johannes Schemmel , Karlheinz Meier , Mihai A. Petrovici

Semisupervised learning has emerged as a popular framework for improving modeling accuracy while controlling labeling cost. Based on an extension of stochastic composite likelihood we quantify the asymptotic accuracy of generative…

Machine Learning · Computer Science 2010-03-02 Joshua V Dillon , Krishnakumar Balasubramanian , Guy Lebanon

$\textbf{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Gehua Ma , Rui Yan , Huajin Tang

Leveraging recent advances in neuroscience and control theory, this paper presents a neuromimetic network model with dynamic symmetric connections governed by Hebbian learning rules. Formal analysis grounded in graph theory and classical…

Systems and Control · Electrical Eng. & Systems 2023-10-05 Zexin Sun , John Baillieul

Neurons and networks in the cerebral cortex must operate reliably despite multiple sources of noise. To evaluate the impact of both input and output noise, we determine the robustness of single-neuron stimulus selective responses, as well…

Neurons and Cognition · Quantitative Biology 2018-01-24 Ran Rubin , L. F. Abbott , Haim Sompolinsky

Mechanisms underlying the emergence of orientation selectivity in the primary visual cortex are highly debated. Here we study the contribution of inhibition-dominated random recurrent networks to orientation selectivity, and more generally…

Neurons and Cognition · Quantitative Biology 2014-06-03 Sadra Sadeh , Stefano Cardanobile , Stefan Rotter

We conjecture that the inherent difference in generalisation between adaptive and non-adaptive gradient methods in deep learning stems from the increased estimation noise in the flattest directions of the true loss surface. We demonstrate…

Machine Learning · Statistics 2022-03-17 Diego Granziol , Nicholas Baskerville

An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise…

This work explores the search for heterogeneous approximate multiplier configurations for neural networks that produce high accuracy and low energy consumption. We discuss the validity of additive Gaussian noise added to accurate neural…

Machine Learning · Computer Science 2022-08-16 Elias Trommer , Bernd Waschneck , Akash Kumar

Linear systems with many degrees of freedom containing multiplicative and additive noise are considered. The steady state probability distribution for equations of this kind is examined. With multiplicative white noise it is shown that…

chao-dyn · Physics 2009-10-22 J. M. Deutsch

We propose to address the issue of sample efficiency, in Deep Convolutional Neural Networks (DCNN), with a semi-supervised training strategy that combines Hebbian learning with gradient descent: all internal layers (both convolutional and…

Neural and Evolutionary Computing · Computer Science 2021-09-21 Gabriele Lagani , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

In this paper, we examine the effects of correlated Gaussian noise on a two-dimensional neuronal network that is locally modeled by the Rulkov map. More precisely, we study the effects of the noise correlation on the variations of the mean…

Disordered Systems and Neural Networks · Physics 2010-09-23 Xiaojuan Sun , Matjaz Perc , Qishao Lu , Jürgen Kurths

We study the effect of local unitary noise on the entanglement evolution of a two-qubit system subject to local monitoring and inter-qubit coupling. We construct a stochastic Hamiltonian by incorporating the noise into the…

Quantum Physics · Physics 2024-03-14 Dominic Shea , Alessandro Romito

A stationary state replica analysis for a dual neural network model that interpolates between a fully recurrent symmetric attractor network and a strictly feed-forward layered network, studied by Coolen and Viana, is extended in this work…

Disordered Systems and Neural Networks · Physics 2009-11-11 F. L. Metz , W. K. Theumann

We propose self-adaptive training -- a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost -- to advance both supervised and…

Machine Learning · Computer Science 2022-10-17 Lang Huang , Chao Zhang , Hongyang Zhang

The classic paradigms for learning and memory recall focus on strengths of synaptic couplings and how these can be modulated to encode memories. In a previous paper [A. K. Behera, M. Rao, S. Sastry, and S. Vaikuntanathan, Physical Review X…

Disordered Systems and Neural Networks · Physics 2024-10-10 Agnish Kumar Behera , Matthew Du , Uday Jagadisan , Srikanth Sastry , Madan Rao , Suriyanarayanan Vaikuntanathan

A large variety of microscopic or mesoscopic models lead to generic results that accommodate naturally within Boltzmann-Gibbs statistical mechanics (based on $S_1\equiv -k \int du p(u) \ln p(u)$). Similarly, other classes of models point…

Statistical Mechanics · Physics 2009-11-07 Celia Anteneodo , Constantino Tsallis

We study the quantum dynamics generated by a non-Hermitian Hamiltonian subject to stochastic perturbations in its anti-Hermitian part, describing fluctuating gains and losses. The dynamics averaged over the noise is described by an…

Quantum Physics · Physics 2025-07-09 Pablo Martinez-Azcona , Aritra Kundu , Avadh Saxena , Adolfo del Campo , Aurelia Chenu

Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose a learning rule that takes inspiration from neuroscience and…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Bernd Illing , Jean Ventura , Guillaume Bellec , Wulfram Gerstner

The response of neurons is highly sensitive to the stimulus. The stimulus can be associated with a direct injection in vitro experimentation (e.g., time dependent and independent inputs); or post-synaptic potentials resulting from the…

Neurons and Cognition · Quantitative Biology 2024-01-09 Afifurrahman , Mohd Hafiz Mohd , Farah Aini Abdullah