English
Related papers

Related papers: Echo State Condition at the Critical Point

200 papers

The dynamical organization in the presence of noise of a Boolean neural network with random connections is analyzed. For low levels of noise, the system reaches a stationary state in which the majority of its elements acquire the same…

Disordered Systems and Neural Networks · Physics 2007-05-23 Cristian Huepe , Maximino Aldana

Lipschitz continuity is a crucial functional property of any predictive model, that naturally governs its robustness, generalisation, as well as adversarial vulnerability. Contrary to other works that focus on obtaining tighter bounds and…

Machine Learning · Computer Science 2024-05-16 Grigory Khromov , Sidak Pal Singh

The optimal performance of a communication network is limited not only by the quality of point-to-point channels, but by the efficacy of its constituent technologies. Understanding the limits of quantum networks requires an understanding of…

Quantum Physics · Physics 2022-07-13 Cillian Harney , Stefano Pirandola

We study diffusion in a network which is governed by non-autonomous Kirchhoff conditions at the vertices of the graph. Also the diffusion coefficients may depend on time. We prove at first a result on existence and uniqueness using form…

Analysis of PDEs · Mathematics 2014-03-12 Wolfgang Arendt , Dominik Dier , Marjeta Kramar Fijavž

Supralinear and sublinear pre-synaptic and dendritic integration is considered to be responsible for nonlinear computation power of biological neurons, emphasizing the role of nonlinear integration as opposed to nonlinear output…

Neural and Evolutionary Computing · Computer Science 2015-04-28 Alireza Goudarzi , Alireza Shabani , Darko Stefanovic

A crucial property for achieving secure, trustworthy and interpretable deep learning systems is their robustness: small changes to a system's inputs should not result in large changes to its outputs. Mathematically, this means one strives…

Machine Learning · Computer Science 2024-06-04 Bernd Prach , Christoph H. Lampert

In this paper, we analyze various critical transmitting/sensing ranges for connectivity and coverage in three-dimensional sensor networks. As in other large-scale complex systems, many global parameters of sensor networks undergo phase…

Data Structures and Algorithms · Computer Science 2007-05-23 Vlady Ravelomanana

In self-organized criticality (SOC) models, as well as in standard phase transitions, criticality is only present for vanishing external fields $h \to 0$. Considering that this is rarely the case for natural systems, such a restriction…

Adaptation and Self-Organizing Systems · Physics 2022-02-14 Gustavo Menesse , Bóris Marin , Mauricio Girardi-Schappo , Osame Kinouchi

Link failures repeatedly induce large-scale outages in power grids and other supply networks. Yet, it is still not well understood, which links are particularly prone to inducing such outages. Here we analyze how the nature and location of…

Physics and Society · Physics 2016-04-06 Dirk Witthaut , Martin Rohden , Xiaozhu Zhang , Sarah Hallerberg , Marc Timme

In networked control, a fundamental problem is to determine the smallest capacity of a communication channel between a dynamical system and a controller above which a prescribed control objective can be achieved. Often, a preliminary task…

Dynamical Systems · Mathematics 2018-10-24 Sigurdur Hafstein , Christoph Kawan

We view a neural network as a distributed system of which neurons can fail independently, and we evaluate its robustness in the absence of any (recovery) learning phase. We give tight bounds on the number of neurons that can fail without…

Machine Learning · Statistics 2017-06-28 El Mahdi El Mhamdi , Rachid Guerraoui

Network science is a rapidly expanding field, with a large and growing body of work on network-based dynamical processes. Most theoretical results in this area rely on the so-called \emph{locally tree-like approximation}. This is, however,…

Physics and Society · Physics 2020-07-01 Sarthak Chandra , Edward Ott , Michelle Girvan

This work considers a communication scenario where the transmitter chooses a list of size K from a total of M messages to send over a noisy communication channel, the receiver generates a list of size L and communication is considered…

Information Theory · Computer Science 2014-10-14 Mustafa Anil Kocak , Elza Erkip

While criticality is widely observed in neural networks, its underlying neural mechanism is not known well. We consider a network of $N$ excitatory leaky integrated and fire (LIF) neurons that reside on a regular lattice with periodic…

Adaptation and Self-Organizing Systems · Physics 2020-11-11 Nahid Safari , Farhad Shahbazi , Mohammad Dehghani-Habibabadi , Moein Esghaei , Marzieh Zare

An approach to the time-accurate prediction of chaotic solutions is by learning temporal patterns from data. Echo State Networks (ESNs), which are a class of Reservoir Computing, can accurately predict the chaotic dynamics well beyond the…

Machine Learning · Computer Science 2021-03-16 Alberto Racca , Luca Magri

Disordered fibrous networks are ubiquitous in nature as major structural components of living cells and tissues. The mechanical stability of networks generally depends on the degree of connectivity: only when the average number of…

Biological Physics · Physics 2016-06-22 A. Sharma , A. J. Licup , R. Rens , M. Sheinman , K. A. Jansen , G. H. Koenderink , F. C. MacKintosh

An upper bound on the feedback capacity of unifilar finite-state channels (FSCs) is derived. A new technique, called the $Q$-contexts, is based on a construction of a directed graph that is used to quantize recursively the receiver's output…

Information Theory · Computer Science 2016-04-08 Oron Sabag , Haim H. Permuter , Henry D. Pfister

The ability to achieve coordinated behavior -- engineered or emergent -- on networked systems has attracted widespread interest over several fields. This interest has led to remarkable advances in developing a theoretical understanding of…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Hancheng Min , Richard Pates , Enrique Mallada

As a function of connectivity, spring networks exhibit a critical transition between floppy and rigid phases at an isostatic threshold. For connectivity below this threshold, fiber networks were recently shown theoretically to exhibit a…

Soft Condensed Matter · Physics 2019-05-15 Jordan Shivers , Sadjad Arzash , Abhinav Sharma , Fred C. MacKintosh

Motivated by fading channels and erasure channels, the problem of reliable communication over deterministic relay networks is studied, in which relay nodes receive a function of the incoming signals and a random network state. An achievable…

Information Theory · Computer Science 2016-11-17 Sung Hoon Lim , Young-Han Kim , Sae-Young Chung