English
Related papers

Related papers: Self-organized transport in noisy dynamic networks

200 papers

Common nonlinear activation functions used in neural networks can cause training difficulties due to the saturation behavior of the activation function, which may hide dependencies that are not visible to vanilla-SGD (using first order…

Machine Learning · Computer Science 2016-04-05 Caglar Gulcehre , Marcin Moczulski , Misha Denil , Yoshua Bengio

The fluctuating dynamics of a network about its stable, noise-free steady state are theoretically investigated. Various causes of non-equilibrium dynamics are identified in terms of the properties and symmetry of the network connections and…

Statistical Mechanics · Physics 2026-04-15 Pik-Yin Lai

Many transport processes on networks depend crucially on the underlying network geometry, although the exact relationship between the structure of the network and the properties of transport processes remain elusive. In this paper we…

Physics and Society · Physics 2015-06-26 Bosiljka Tadic , G. J. Rodgers , Stefan Thurner

Dynamical criticality has been shown to enhance information processing in dynamical systems, and there is evidence for self-organized criticality in neural networks. A plausible mechanism for such self-organization is activity dependent…

Adaptation and Self-Organizing Systems · Physics 2012-09-18 Felix Droste , Anne-Ly Do , Thilo Gross

We study how the connectivity within a recurrent neural network determines and is determined by the multistable solutions of network activity. To gain analytic tractability we let neural activation be a non-smooth Heaviside step function.…

Neural and Evolutionary Computing · Computer Science 2023-03-09 Magnus Tournoy , Brent Doiron

Neural systems process information in a dynamical regime between silence and chaotic dynamics. This has lead to the criticality hypothesis which suggests that neural systems reach such a state by self-organizing towards the critical point…

Disordered Systems and Neural Networks · Physics 2021-03-10 Stefan Landmann , Lorenz Baumgarten , Stefan Bornholdt

A model for traffic flow in street networks or material flows in supply networks is presented, that takes into account the conservation of cars or materials and other significant features of traffic flows such as jam formation, spillovers,…

Fluid Dynamics · Physics 2016-08-14 Dirk Helbing , Jan Siegmeier , Stefan Lämmer

We study the effect of varying wiring in excitable random networks in which connection weights change with activity to mold local resistance or facilitation due to fatigue. Dynamic attractors, corresponding to patterns of activity, are then…

Disordered Systems and Neural Networks · Physics 2009-05-22 Samuel Johnson , J. Marro , Joaquin J. Torres

The dynamics of noise-resilient Boolean networks with majority functions and diverse topologies is investigated. A wide class of possible topological configurations is parametrized as a stochastic blockmodel. For this class of networks, the…

Disordered Systems and Neural Networks · Physics 2012-01-11 Tiago P. Peixoto

Reconstructing noise-driven nonlinear networks from time series of output variables is a challenging problem, which turns to be very difficult when nonlinearity of dynamics, strong noise impacts and low measurement frequencies jointly…

Statistical Mechanics · Physics 2017-10-20 Rundong Shi , Gang Hu , Shihong Wang

In this thesis we aim to analyze and quantify the energetic and information contents that can be extracted from a dynamical system subject to the external environment. The latter is usually assumed to be deleterious for the feasibility of…

Quantum Physics · Physics 2018-05-07 Stefano Gherardini

Flow networks are essential for both living organisms and enginneered systems. These networks often present complex dynamics controlled, at least in part, by their topology. Previous works have shown that topologically complex networks…

Soft Condensed Matter · Physics 2020-03-24 Miguel Ruiz-Garcia , Eleni Katifori

We consider the multitasking associative network in the low-storage limit and we study its phase diagram with respect to the noise level $T$ and the degree $d$ of dilution in pattern entries. We find that the system is characterized by a…

Disordered Systems and Neural Networks · Physics 2013-04-17 Elena Agliari , Adriano Barra , Andrea Galluzzi , Marco Isopi

Self-organization and pattern formation in network-organized systems emerges from the collective activation and interaction of many interconnected units. A striking feature of these non-equilibrium structures is that they are often…

Physics and Society · Physics 2016-02-23 Christos Nicolaides , Ruben Juanes , Luis Cueto-Felgueroso

We reveal the intricate impact of nonlinearity and disorder on the thermal conductivity of acoustic chains. Disorder induces mobility edges and allows to control the amount of extended modes which are the ballistic channels for energy…

Disordered Systems and Neural Networks · Physics 2010-09-20 M. V. Ivanchenko , S. Flach

Motivated by a stochastic differential equation describing the dynamics of interfaces, we study the bifurcation behavior of a more general class of such equations. These equations are characterized by a 2-dimensional phase space (describing…

Chaotic Dynamics · Physics 2012-04-11 Stewart E. Barnes , Jean-Pierre Eckmann , Thierry Giamarchi , Vivien Lecomte

This work concerns a many-body deterministic model that displays life-like properties as emergence, complexity, self-organization, spontaneous compartmentalization, and self-regulation. The model portraits the dynamics of an ensemble of…

Adaptation and Self-Organizing Systems · Physics 2023-07-11 Alessandro Scirè , Valerio Annovazzi-Lodi

Much recent research has dealt with the identifiability of a dynamical network in which the node signals are connected by causal linear time-invariant transfer functions and are possibly excited by known external excitation signals and/or…

Optimization and Control · Mathematics 2017-09-14 Alexandre S. Bazanella , Michel Gevers , Julien M. Hendrickx , Adriane Parraga

Biological systems rely on robust internal information processing: Survival depends on highly reproducible dynamics of regulatory processes. Biological information processing elements, however, are intrinsically noisy (genetic switches,…

Molecular Networks · Quantitative Biology 2009-11-10 Konstantin Klemm , Stefan Bornholdt

The behavior of the network and its stability are governed by both dynamics of individual nodes as well as their topological interconnections. Attention mechanism as an integral part of neural network models was initially designed for…

Machine Learning · Computer Science 2022-12-20 Nooshin Bahador , Milad Lankarany