English
Related papers

Related papers: Optimal sequence memory in driven random networks

200 papers

Associative memory models such as the Hopfield network and its dense generalizations with higher-order interactions exhibit a "blackout catastrophe" -- a discontinuous transition where stable memory states abruptly vanish when the number of…

Disordered Systems and Neural Networks · Physics 2026-03-24 David G. Clark

The process of training an artificial neural network involves iteratively adapting its parameters so as to minimize the error of the network's prediction, when confronted with a learning task. This iterative change can be naturally…

Machine Learning · Computer Science 2024-04-10 Kaloyan Danovski , Miguel C. Soriano , Lucas Lacasa

Characterizing the emergence of chaotic dynamics of complex networks is an essential task in nonlinear science with potential important applications in many fields such as neural control engineering, microgrid technologies, and ecological…

Adaptation and Self-Organizing Systems · Physics 2024-04-29 Ricardo Chacón , Pedro J. Martínez

Recurrent neural networks (RNNs) are complex dynamical systems, capable of ongoing activity without any driving input. The long-term behavior of free-running RNNs, described by periodic, chaotic and fixed point attractors, is controlled by…

Neurons and Cognition · Quantitative Biology 2021-08-06 Claus Metzner , Patrick Krauss

The use of artificial neural networks as models of chaotic dynamics has been rapidly expanding. Still, a theoretical understanding of how neural networks learn chaos is lacking. Here, we employ a geometric perspective to show that neural…

Machine Learning · Computer Science 2021-07-02 Ziwei Li , Sai Ravela

We examine the one-humped map at the period-doubling transition to chaos, and ask whether its long-term memory is stack-like (last-in, first-out) or queue-like (first-in, first-out). We show that it can be recognized by a real-time…

chao-dyn · Physics 2007-05-23 Cristopher Moore , Porus Lakdawala

Effect of noise in inducing order on various chaotically evolving systems is reviewed, with special emphasis on systems consisting of coupled chaotic elements. In many situations it is observed that the uncoupled elements when driven by…

chao-dyn · Physics 2015-06-24 Manojit Roy , R. E. Amritkar

We investigated how the stability of macroscopic states in the associative memory model is affected by synaptic depression. To this model, we applied the dynamical mean-field theory, which has recently been developed in stochastic neural…

Disordered Systems and Neural Networks · Physics 2010-05-24 Yosuke Otsubo , Kenji Nagata , Masafumi Oizumi , Masato Okada

Fast scrambling, quantified by the exponential initial growth of Out-of-Time-Ordered-Correlators (OTOCs), is the ability to efficiently spread quantum correlations among the degrees of freedom of interacting systems, and constitutes a…

Quantum Physics · Physics 2023-05-04 Felix Meier , Mathias Steinhuber , Juan Diego Urbina , Daniel Waltner , Thomas Guhr

Functional connectivity is a fundamental property of neural networks that quantifies the segregation and integration of information between cortical areas. Due to mathematical complexity, a theory that could explain how the parameters of…

Neurons and Cognition · Quantitative Biology 2016-05-27 Diego Fasoli , Anna Cattani , Stefano Panzeri

Dynamics in biological networks are in general robust against several perturbations. We investigate a coupled map network as a model motivated by gene regulatory networks and design systems which are robust against phenotypic perturbations…

Molecular Networks · Quantitative Biology 2015-03-20 Nen Saito , Macoto Kikuchi

The connectivity of individual neurons of large neural networks determine both the steady state activity of the network and its answer to external stimulus. Highly diluted random networks have zero activity. We show that increasing the…

Condensed Matter · Physics 2008-02-03 Albert-László Barabási

Massively parallel recordings of spiking activity in cortical networks show that covariances vary widely across pairs of neurons. Their low average is well understood, but an explanation for the wide distribution in relation to the static…

Disordered Systems and Neural Networks · Physics 2019-08-13 David Dahmen , Markus Diesmann , Moritz Helias

We study the dynamics of an ensemble of globally coupled chaotic logistic maps under the action of a learning algorithm aimed at driving the system from incoherent collective evolution to a state of spontaneous full synchronization.…

Adaptation and Self-Organizing Systems · Physics 2009-10-31 Luis G. Moyano , Guillermo Abramson , Damian H. Zanette

We studied neural automata -or neurobiologically inspired cellular automata- which exhibits chaotic itinerancy among the different stored patterns or memories. This is a consequence of activity-dependent synaptic fluctuations, which…

Neurons and Cognition · Quantitative Biology 2007-05-23 J. M. Cortes , J. Marro , J. J. Torres

In this article we treat the subject of chaotic environments with few degrees of freedom in quantum communication by investigating a conservative dynamical map as a model of a dephasing quantum channel. When the channel's dynamics is…

Quantum Physics · Physics 2010-06-28 Gabriela Barreto Lemos , Giuliano Benenti

Understanding the memory capacity of neural networks remains a challenging problem in implementing artificial intelligence systems. In this paper, we address the notion of capacity with respect to Hopfield networks and propose a dynamic…

Neural and Evolutionary Computing · Computer Science 2017-09-19 Saarthak Sarup , Mingoo Seok

The effects of disorder in external forces on the dynamical behavior of coupled nonlinear oscillator networks are studied. When driven synchronously, i.e., all driving forces have the same phase, the networks display chaotic dynamics. We…

Chaotic Dynamics · Physics 2009-11-11 Sebastian F. Brandt , Babette K. Dellen , Ralf Wessel

We present a mathematical analysis of the effects of Hebbian learning in random recurrent neural networks, with a generic Hebbian learning rule including passive forgetting and different time scales for neuronal activity and learning…

Chaotic Dynamics · Physics 2008-04-07 Benoit Siri , Hugues Berry , Bruno Cessac , Bruno Delord , Mathias Quoy

We study synchronization of non-diffusively coupled map networks with arbitrary network topologies, where the connections between different units are, in general, not symmetric and can carry both positive and negative weights. We show that,…

Chaotic Dynamics · Physics 2010-02-09 Frank Bauer , Fatihcan M. Atay , Juergen Jost