English
Related papers

Related papers: Dynamical stability for dense patterns in discrete…

200 papers

We construct and analyze a rate-based neural network model in which self-interacting units represent clusters of neurons with strong local connectivity and random inter-unit connections reflect long-range interactions. When sufficiently…

Disordered Systems and Neural Networks · Physics 2015-06-22 Merav Stern , Haim Sompolinsky , L. F. Abbott

We study how the connectivity within a recurrent neural network determines and is determined by the multistable solutions of network activity. To gain analytic tractability we let neural activation be a non-smooth Heaviside step function.…

Neural and Evolutionary Computing · Computer Science 2023-03-09 Magnus Tournoy , Brent Doiron

A novel approach for supervised classification is presented which sits at the intersection of machine learning and dynamical systems theory. At variance with other methodologies that employ ordinary differential equations for classification…

Disordered Systems and Neural Networks · Physics 2024-05-21 Raffaele Marino , Lorenzo Giambagli , Lorenzo Chicchi , Lorenzo Buffoni , Duccio Fanelli

To any inhibition-dominated threshold-linear network (TLN) we can associate a directed graph that captures the pattern of strong and weak inhibition between neurons. Robust motifs are graphs for which the structure of fixed points in the…

Neurons and Cognition · Quantitative Biology 2019-12-18 Carina Curto , Christopher Langdon , Katherine Morrison

A recurrent neural network with noisy input is studied analytically, on the basis of a Discrete Time Master Equation. The latter is derived from a biologically realizable learning rule for the weights of the connections. In a numerical…

Disordered Systems and Neural Networks · Physics 2009-10-31 M. Heerema , W. A. van Leeuwen

We develop a unified matrix-spectral framework for analyzing stability and interpretability in deep neural networks. Representing networks as data-dependent products of linear operators reveals spectral quantities governing sensitivity to…

Machine Learning · Computer Science 2026-02-03 Ronald Katende

We consider stability and network capacity in discrete time queueing systems. Relationships between four common notions of stability are described. Specifically, we consider rate stability, mean rate stability, steady state stability, and…

Networking and Internet Architecture · Computer Science 2010-03-18 Michael J. Neely

We consider the storage properties of temporal patterns, i.e. cycles of finite lengths, in neural networks represented by (generally asymmetric) spin glasses defined on random graphs. Inspired by the observation that dynamics on sparse…

Disordered Systems and Neural Networks · Physics 2020-12-03 Sungmin Hwang , Enrico Lanza , Giorgio Parisi , Jacopo Rocchi , Giancarlo Ruocco , Francesco Zamponi

The microscopic and macroscopic dynamics of random networks is investigated in the strong-dilution limit (i.e. for sparse networks). By simulating chaotic maps, Stuart-Landau oscillators, and leaky integrate-and-fire neurons, we show that a…

Disordered Systems and Neural Networks · Physics 2012-12-24 Stefano Luccioli , Simona Olmi , Antonio Politi , Alessandro Torcini

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

We examine the dynamical properties of a single-layer convolutional recurrent network with a smooth sigmoidal activation function, for small values of the inputs and when the convolution kernel is unitary, so all eigenvalues lie exactly at…

Statistical Mechanics · Physics 2024-05-24 Aditi Chandra , Marcelo O. Magnasco

When neural networks are used to model dynamics, properties such as stability of the dynamics are generally not guaranteed. In contrast, there is a recent method for learning the dynamics of autonomous systems that guarantees global…

Machine Learning · Computer Science 2022-03-21 Kenji Kashima , Ryota Yoshiuchi , Yu Kawano

The human brain is autonomously active. To understand the functional role of this self-sustained neural activity, and its interplay with the sensory data input stream, is an important question in cognitive system research and we review here…

Neurons and Cognition · Quantitative Biology 2009-03-03 Claudius Gros

In this work, we study the dynamical robustness in a system consisting of both active and inactive oscillators. We analytically show that the dynamical robustness of such system is determined by the cross link density between active and…

Adaptation and Self-Organizing Systems · Physics 2017-03-01 Wenwen Huang , Xiyun Zhang , Xin Hu , Zonghua Liu , Shuguang Guan

Deep networks are commonly used to model dynamical systems, predicting how the state of a system will evolve over time (either autonomously or in response to control inputs). Despite the predictive power of these systems, it has been…

Machine Learning · Computer Science 2020-01-20 Gaurav Manek , J. Zico Kolter

We consider a decentralised multi-access algorithm, motivated primarily by the control of transmissions in a wireless network. For a finite single-hop network with arbitrary interference constraints we prove stochastic stability under the…

Information Theory · Computer Science 2019-06-03 Seva Shneer , Alexander Stolyar

We complement our previous work [arxiv: 0707.0565] with the full (non diluted) solution describing the stable states of an attractor network that stores correlated patterns of activity. The new solution provides a good fit of simulations of…

Disordered Systems and Neural Networks · Physics 2007-07-23 Emilio Kropff

The discrete spectrum of complex Jacobi matrices that are compact perturbations of the discrete laplacian is under consideration. The rate of stabilization for the the matrix entries which provides finiteness of the discrete spectrum and is…

Spectral Theory · Mathematics 2007-05-23 I. Egorova , L. Golinskii

We investigate numerically the collective dynamical behavior of pulse-coupled non-leaky integrate-and-fire-neurons that are arranged on a two-dimensional small-world network. To ensure ongoing activity, we impose a probability for…

Computational Physics · Physics 2012-02-15 Alexander Rothkegel , Klaus Lehnertz

In a first step towards the comprehension of neural activity, one should focus on the stability of the various dynamical states. Even the characterization of idealized regimes, such as a perfectly periodic spiking activity, reveals…

Disordered Systems and Neural Networks · Physics 2014-09-08 Simona Olmi , Antonio Politi , Alessandro Torcini