English
Related papers

Related papers: Associative Memory by Recurrent Neural Networks wi…

200 papers

We study the storage of multiple phase-coded patterns as stable dynamical attractors in recurrent neural networks with sparse connectivity. To determine the synaptic strength of existent connections and store the phase-coded patterns, we…

Neurons and Cognition · Quantitative Biology 2015-05-28 Siliva Scarpetta , Ferdinando Giacco , Antonio de Candia

Attractor neural networks (ANNs) are one of the leading theoretical frameworks for the formation and retrieval of memories in networks of biological neurons. In this framework, a pattern imposed by external inputs to the network is said to…

Biological Physics · Physics 2022-05-25 Yu Feng , Nicolas Brunel

There is a wide range of mathematical models that describe populations of large numbers of neurons. In this article, we focus on nonlinear noisy leaky integrate-and-fire (NNLIF) models that describe neuronal activity at the level of the…

Analysis of PDEs · Mathematics 2024-12-12 María J. Cáceres , José A. Cañizo , Alejandro Ramos-Lora

We show that macro-molecular self-assembly can recognize and classify high-dimensional patterns in the concentrations of $N$ distinct molecular species. Similar to associative neural networks, the recognition here leverages dynamical…

Disordered Systems and Neural Networks · Physics 2017-04-26 Weishun Zhong , David J. Schwab , Arvind Murugan

Learning in neural networks poses peculiar challenges when using discretized rather then continuous synaptic states. The choice of discrete synapses is motivated by biological reasoning and experiments, and possibly by hardware…

Disordered Systems and Neural Networks · Physics 2016-06-01 Carlo Baldassi , Federica Gerace , Carlo Lucibello , Luca Saglietti , Riccardo Zecchina

We study the ability of linear recurrent networks obeying discrete time dynamics to store long temporal sequences that are retrievable from the instantaneous state of the network. We calculate this temporal memory capacity for both…

Disordered Systems and Neural Networks · Physics 2009-11-10 Olivia L. White , Daniel D. Lee , Haim Sompolinsky

We apply a recently proposed method for the analysis of time series from systems with delayed feedback to experimental data generated by a CO_2 laser. The method is able to estimate the delay time with an error of the order of the sampling…

chao-dyn · Physics 2009-10-31 M. J. Bünner , M. Ciofini , A. Giaquinta , R. Hegger , H. Kantz , R. Meucci , A. Politi

We present a neuromorphic spiking neural network, the DELTRON, that can remember and store patterns by changing the delays of every connection as opposed to modifying the weights. The advantage of this architecture over traditional weight…

Neural and Evolutionary Computing · Computer Science 2014-02-28 Shaista Hussain , Arindam Basu , R. Wang , Tara Julia Hamilton

Spiking neural networks (SNNs) are rapidly gaining momentum as an alternative to conventional artificial neural networks in resource constrained edge systems. In this work, we continue a recent research line on recurrent SNNs where axonal…

Neural and Evolutionary Computing · Computer Science 2026-04-20 Lúcio Folly Sanches Zebendo , Eleonora Cicciarella , Michele Rossi

This study investigates the suitability of the annealed approximation in high-dimensional systems characterized by dense networks with quenched link disorder, employing models of coupled oscillators. We demonstrate that dynamic equations…

Statistical Mechanics · Physics 2024-03-25 Jaegon Um , Hyunsuk Hong , Hyunggyu Park

Compartment models with delay terms are widely used across a range of disciplines. The motivation to include delay terms varies across different contexts. In epidemiological and pharmacokinetic models, the delays are often used to represent…

Dynamical Systems · Mathematics 2024-06-26 Christopher N. Angstmann , Anna V. McGann , Zhuang Xu

Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or…

Synaptic delays play a crucial role in biological neuronal networks, where their modulation has been observed in mammalian learning processes. In the realm of neuromorphic computing, although spiking neural networks (SNNs) aim to emulate…

Neural and Evolutionary Computing · Computer Science 2025-06-19 Marissa Dominijanni , Alexander Ororbia , Kenneth W. Regan

Recent advances in learning dynamical systems from data have shown significant promise. However, many existing methods assume access to the full state of the system -- an assumption that is rarely satisfied in practice, where systems are…

Machine Learning · Computer Science 2026-03-10 Thibault Monsel , Onofrio Semeraro , Lionel Mathelin , Guillaume Charpiat

The subject of study is a neural network with binary neurons, randomly diluted synapses and variable pattern activity. We look at the system with parallel updating using a probabilistic approach to solve the one step dynamics with one…

Disordered Systems and Neural Networks · Physics 2009-10-31 Stefan Grosskinsky

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Recent advances have resulted in queue-based algorithms for medium access control which operate in a distributed fashion, and yet achieve the optimal throughput performance of centralized scheduling algorithms. However, fundamental…

Networking and Internet Architecture · Computer Science 2013-05-24 Florian Simatos , Niek Bouman , Sem Borst

Spiking Neural Networks (SNNs) are dynamical systems that operate on spatiotemporal data, yet their learnable parameters are often limited to synaptic weights, contributing little to temporal pattern recognition. Learnable parameters that…

Neural and Evolutionary Computing · Computer Science 2026-02-13 Luke Vassallo , Nima Taherinejad

We study a model of associative memory based on a neural network with small-world structure. The efficacy of the network to retrieve one of the stored patterns exhibits a phase transition at a finite value of the disorder. The more ordered…

Adaptation and Self-Organizing Systems · Physics 2009-11-10 Luis G. Morelli , Guillermo Abramson , Marcelo N. Kuperman

The associative memory model is a typical neural network model, which can store discretely distributed fixed-point attractors as memory patterns. When the network stores the memory patterns extensively, however, the model has other…

Neurons and Cognition · Quantitative Biology 2014-11-27 Shin Murata , Yosuke Otsubo , Kenji Nagata , Masato Okada