English
Related papers

Related papers: Analysis of Oscillator Neural Networks for Sparsel…

200 papers

There is enormous interest -- both mathematically and in diverse applications -- in understanding the dynamics of coupled oscillator networks. The real-world motivation of such networks arises from studies of the brain, the heart, ecology,…

Dynamical Systems · Mathematics 2023-08-22 Stephen Coombes , Mustafa Sayli , Rüdiger Thul , Rachel Nicks , Mason A Porter , Yi Ming Lai

For the retrieval dynamics of sparsely coded attractor associative memory models with synaptic noise the inclusion of a macroscopic time-dependent threshold is studied. It is shown that if the threshold is chosen appropriately as a function…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Bolle' , R. Heylen

Using an asymmetric associative network with synchronous updating, it is possible to recall a sequence of patterns. To obtain a stable sequence generation with a large storage capacity, we introduce a threshold that eliminates the…

comp-gas · Physics 2008-02-03 F. Zertuche , R. López-Peña , H. Waelbroeck

How spiking neuronal networks encode memories in their different time and spatial scales constitute a fundamental topic in neuroscience and neuro-inspired engineering. Much attention has been paid to large networks and long-term memory, for…

Neurons and Cognition · Quantitative Biology 2023-03-23 Fabio Schittler Neves , Marc Timme

We investigate the computational limits of the memory retrieval dynamics of modern Hopfield models from the fine-grained complexity analysis. Our key contribution is the characterization of a phase transition behavior in the efficiency of…

Machine Learning · Computer Science 2024-06-04 Jerry Yao-Chieh Hu , Thomas Lin , Zhao Song , Han Liu

The Little-Hopfield network is an auto-associative computational model of neural memory storage and retrieval. This model is known to robustly store collections of randomly generated binary patterns as stable-states of the network dynamics.…

Neurons and Cognition · Quantitative Biology 2015-04-30 Christopher Hillar , Ngoc Tran , Kilian Koepsell

Introduction. Neural network models of autoassociative, distributed memory allow storage and retrieval of many items (vectors) where the number of stored items can exceed the vector dimension (the number of neurons in the network). This…

Neural and Evolutionary Computing · Computer Science 2017-09-05 V. I. Gritsenko , D. A. Rachkovskij , A. A. Frolov , R. Gayler , D. Kleyko , E. Osipov

Dense Associative Memories are high storage capacity variants of the Hopfield networks that are capable of storing a large number of memory patterns in the weights of the network of a given size. Their common formulations typically require…

Machine Learning · Computer Science 2024-11-01 Benjamin Hoover , Duen Horng Chau , Hendrik Strobelt , Parikshit Ram , Dmitry Krotov

Cortical networks are hypothesized to rely on transient network activity to support short term memory (STM). In this paper we study the capacity of randomly connected recurrent linear networks for performing STM when the input signals are…

Information Theory · Computer Science 2015-03-05 Adam S. Charles , Han Lun Yap , Christopher J. Rozell

This article delves into the Hopfield neural network model, drawing inspiration from biological neural systems. The exploration begins with an overview of the model's foundations, incorporating insights from mechanical statistics to deepen…

Disordered Systems and Neural Networks · Physics 2024-10-29 Matteo Silvestri

We investigate the predictive power of recurrent neural networks for oscillatory systems not only on the attractor, but in its vicinity as well. For this we consider systems perturbed by an external force. This allows us to not merely…

Adaptation and Self-Organizing Systems · Physics 2019-07-02 Rok Cestnik , Markus Abel

We generalize the standard Hopfield model to the case when a weight is assigned to each input pattern. The weight can be interpreted as the frequency of the pattern occurrence at the input of the network. In the framework of the statistical…

Disordered Systems and Neural Networks · Physics 2012-05-07 Iakov Karandashev , Boris Kryzhanovsky , Leonid Litinskii

Attractor neural network is an important theoretical scenario for modeling memory function in the hippocampus and in the cortex. In these models, memories are stored in the plastic recurrent connections of neural populations in the form of…

Neurons and Cognition · Quantitative Biology 2016-01-12 Alireza Alemi

In this work we explore encoding strategies learned by statistical models of sensory coding in noisy spiking networks. Early stages of sensory communication in neural systems can be viewed as encoding channels in the information-theoretic…

Neurons and Cognition · Quantitative Biology 2020-06-30 M. E. Rule , M. Sorbaro , M. H. Hennig

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule,…

Machine Learning · Computer Science 2011-02-22 Vincent Gripon , Claude Berrou

We study the stability and information encoding capacity of synchronized states in a neuronal network model that represents part of thalamic circuitry. Our model neurons have a Hodgkin-Huxley-type low threshold Calcium channel, display post…

Statistical Mechanics · Physics 2007-05-23 P. H. E. Tiesinga , Jorge V. José

A coupled oscillator network may be able to perform an energy-efficient associative memory operation. However, its realization has been difficult because inhomogeneities unavoidably arise among the oscillators during fabrication and lead to…

Mesoscale and Nanoscale Physics · Physics 2024-04-01 Yusuke Imai , Tomohiro Taniguchi

A recurrent neural network model storing multiple spatial maps, or ``charts'', is analyzed. A network of this type has been suggested as a model for the origin of place cells in the hippocampus of rodents. The extremely diluted and fully…

Disordered Systems and Neural Networks · Physics 2009-10-31 Francesco P. Battaglia , Alessandro Treves

We present results for two different kinds of high order connections between neurons acting as corrections to the Hopfield model. Equilibrium properties are analyzed using the replica mean-field theory and compared with numerical…

Condensed Matter · Physics 2009-10-22 J. J. Arenzon , R. M. C. de Almeida

Ensembles of phase-oscillators are known to exhibit a variety of collective regimes. Here, we show that a simple mean-field model involving two heterogenous populations of pulse-coupled oscillators, exhibits, in the strong-coupling limit, a…

Disordered Systems and Neural Networks · Physics 2024-07-12 German Mato , Antonio Politi , Alessandro Torcini
‹ Prev 1 4 5 6 7 8 10 Next ›