English
Related papers

Related papers: Maximum memory capacity on neural networks with sh…

200 papers

We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short-time scale compared to that for the neuron dynamics and it produces…

Neurons and Cognition · Quantitative Biology 2007-05-23 J. M. Cortes , J. J. Torres , J. Marro , P. L. Garrido , H. J. Kappen

Attractor neural networks (ANNs) are one of the leading theoretical frameworks for the formation and retrieval of memories in networks of biological neurons. In this framework, a pattern imposed by external inputs to the network is said to…

Biological Physics · Physics 2022-05-25 Yu Feng , Nicolas Brunel

Working memory is a cognitive function involving the storage and manipulation of latent information over brief intervals of time, thus making it crucial for context-dependent computation. Here, we use a top-down modeling approach to examine…

Neurons and Cognition · Quantitative Biology 2021-11-17 Elham Ghazizadeh , ShiNung Ching

The critical state is assumed to be optimal for any computation in recurrent neural networks, because criticality maximizes a number of abstract computational properties. We challenge this assumption by evaluating the performance of a…

Emerging Technologies · Computer Science 2020-11-05 Benjamin Cramer , David Stöckel , Markus Kreft , Michael Wibral , Johannes Schemmel , Karlheinz Meier , Viola Priesemann

Dynamical balance of excitation and inhibition is usually invoked to explain the irregular low firing activity observed in the cortex. We propose a robust nonlinear balancing mechanism for a random network of spiking neurons, which works…

Disordered Systems and Neural Networks · Physics 2025-05-29 Antonio Politi , Alessandro Torcini

Competitive dynamics are thought to occur in many processes of learning involving synaptic plasticity. Here we show, in a game theory-inspired model of synaptic interactions, that the competition between synapses in their weak and strong…

Disordered Systems and Neural Networks · Physics 2015-05-28 Gaurang Mahajan , Anita Mehta

Competition between synapses arises in some forms of correlation-based plasticity. Here we propose a game theory-inspired model of synaptic interactions whose dynamics is driven by competition between synapses in their weak and strong…

Disordered Systems and Neural Networks · Physics 2011-10-19 Ajaz Ahmad Bhat , Gaurang Mahajan , Anita Mehta

We study with numerical simulation the possible limit behaviors of synchronous discrete-time deterministic recurrent neural networks composed of N binary neurons as a function of a network's level of dilution and asymmetry. The network…

Disordered Systems and Neural Networks · Physics 2018-05-11 Viola Folli , Giorgio Gosti , Marco Leonetti , Giancarlo Ruocco

Cortical networks can maintain memories for decades despite the short lifetime of synaptic strength. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of random noise on the stability of…

Neurons and Cognition · Quantitative Biology 2012-06-01 Yi Wei , Alexei A. Koulakov

A model of the columnar functional organization of neocortical association areas is studied. The neuronal network is composed of many Hebbian autoassociators, or modules, each of which interacts with a relatively small number of the others.…

Disordered Systems and Neural Networks · Physics 2020-05-14 Carlo Fulvi Mari

In the context of attractor neural networks, we study how the equilibrium analog neural activities, reached by the network dynamics during memory retrieval, may improve storage performance by reducing the interferences between the recalled…

Condensed Matter · Physics 2009-10-22 Nicolas Brunel , Riccardo Zecchina

Recent biological experimental findings have shown that synaptic plasticity depends on the relative timing of pre- and post-synaptic spikes and this is called spike-timing-dependent plasticity (STDP). Many authors have claimed that a…

Disordered Systems and Neural Networks · Physics 2007-05-23 Narihisa Matsumoto , Masato Okada

The retrieval capabilities of associative neural networks can be impaired by different kinds of noise: the fast noise (which makes neurons more prone to failure), the slow noise (stemming from interference among stored memories), and…

Disordered Systems and Neural Networks · Physics 2020-12-10 Elena Agliari , Giordano De Marzo

Late long-term potentiation (L-LTP) appears essential for the formation of long-term memory, with memories at least partly encoded by patterns of strengthened synapses. How memories are preserved for months or years, despite molecular…

Neurons and Cognition · Quantitative Biology 2015-05-13 Paul Smolen

Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms have allowed reliable learning and recall of an exponential number of patterns. Although these designs correct external errors…

Neural and Evolutionary Computing · Computer Science 2014-03-14 Amin Karbasi , Amir Hesam Salavati , Amin Shokrollahi , Lav R. Varshney

Standard accounts of memory consolidation emphasise the stabilisation of stored representations, but struggle to explain representational drift, semanticisation, or the necessity of offline replay. Here we propose that high-capacity…

Neurons and Cognition · Quantitative Biology 2026-03-06 Zafeirios Fountas , Adnan Oomerjee , Haitham Bou-Ammar , Jun Wang , Neil Burgess

The storage of continuous variables in working memory is hypothesized to be sustained in the brain by the dynamics of recurrent neural networks (RNNs) whose steady states form continuous manifolds. In some cases, it is thought that the…

Neurons and Cognition · Quantitative Biology 2023-10-31 Haggai Agmon , Yoram Burak

Experimental data have revealed that neuronal connection efficacy exhibits two forms of short-term plasticity, namely, short-term depression (STD) and short-term facilitation (STF). They have time constants residing between fast neural…

Neurons and Cognition · Quantitative Biology 2015-03-19 C. C. Alan Fung , K. Y. Michael Wong , He Wang , Si Wu

The memristor can be used as non volatile memory (NVM) and for emulating neuron behavior. It has the ability to switch between low resistance $R_{on}$ and high resistance values $R_{off}$, and exhibit the synaptic dynamic behaviour such as…

Emerging Technologies · Computer Science 2018-09-28 Aidana Irmanova , Grant A. Ellis , Alex Pappachen James

We study a simple extended model of oscillator neural networks capable of storing sparsely coded phase patterns, in which information is encoded both in the mean firing rate and in the timing of spikes. Applying the methods of statistical…

Disordered Systems and Neural Networks · Physics 2009-10-31 Masaki Nomura , Toshio Aoyagi