English
Related papers

Related papers: Functional differentiations in evolutionary reserv…

200 papers

Reservoir Computing (RC) is a well-known strategy for designing Recurrent Neural Networks featured by striking efficiency of training. The crucial aspect of RC is to properly instantiate the hidden recurrent layer that serves as dynamical…

Machine Learning · Computer Science 2020-06-05 Claudio Gallicchio

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep…

Machine Learning · Statistics 2021-02-18 Jonathan Dong , Ruben Ohana , Mushegh Rafayelyan , Florent Krzakala

Reservoir computing is a machine learning approach that can generate a surrogate model of a dynamical system. It can learn the underlying dynamical system using fewer trainable parameters and hence smaller training data sets than competing…

Machine Learning · Computer Science 2022-11-23 Daniel J. Gauthier , Ingo Fischer , André Röhm

Elucidating the neurophysiological mechanisms underlying neural pattern formation remains an outstanding challenge in Computational Neuroscience. In this paper, we address the issue of understanding the emergence of neural patterns by…

Neurons and Cognition · Quantitative Biology 2024-06-04 Gregory Dumont , Carmen Oana Tarniceriu

Neurons in the brain are often finely tuned for specific task variables. Moreover, such disentangled representations are highly sought after in machine learning. Here we mathematically prove that simple biological constraints on neurons,…

Neurons and Cognition · Quantitative Biology 2023-04-04 James C. R. Whittington , Will Dorrell , Surya Ganguli , Timothy E. J. Behrens

Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing…

Reservoir computing is a machine learning framework where the readouts from a nonlinear system (the reservoir) are trained so that the output from the reservoir, when forced with an input signal, reproduces a desired output signal. A common…

Neural and Evolutionary Computing · Computer Science 2023-12-21 Lauren A. Hurley , Juan G. Restrepo , Sean E. Shaheen

Neural circuits are able to perform computations under very diverse conditions and requirements. The required computations impose clear constraints on their fine-tuning: a rapid and maximally informative response to stimuli in general…

Neurons and Cognition · Quantitative Biology 2019-10-22 Jens Wilting , Jonas Dehning , Joao Pinheiro Neto , Lucas Rudelt , Michael Wibral , Johannes Zierenberg , Viola Priesemann

Functional networks provide a topological description of activity patterns in the brain, as they stem from the propagation of neural activity on the underlying anatomical or structural network of synaptic connections. This latter is well…

Disordered Systems and Neural Networks · Physics 2021-02-11 Ali Safari , Paolo Moretti , Ibai Diez , Jesus M. Cortes , Miguel Ángel Muñoz

Reservoir Computing is an emerging machine learning framework which is a versatile option for utilising physical systems for computation. In this paper, we demonstrate how a single node reservoir, made of a simple electronic circuit, can be…

Machine Learning · Computer Science 2022-12-23 N. Rasha Shanaz , K. Murali , P. Muruganandam

Closed-loop neurotechnology requires the capability to predict the state evolution and its regulation under (possibly) partial measurements. There is evidence that neurophysiological dynamics can be modeled by fractional-order dynamical…

Optimization and Control · Mathematics 2019-03-05 Sarthak Chatterjee , Orlando Romero , Sérgio Pequito

We formulate a novel technique for the detection of functional clusters in discrete event data. The advantage of this algorithm is that no prior knowledge of the number of functional groups is needed, as our procedure progressively combines…

Neurons and Cognition · Quantitative Biology 2015-05-13 S. Feldt , J. Waddell , V. L. Hetrick , J. D. Berke , M. Zochowski

There is a growing interest in the development of artificial neural networks that are implemented in a physical system. A major challenge in this context is that these networks are difficult to train since training here would require a…

Emerging Technologies · Computer Science 2026-01-22 Michael te Vrugt

Partial differential equation (PDE) models and their associated variational energy formulations are often rotationally invariant by design. This ensures that a rotation of the input results in a corresponding rotation of the output, which…

Machine Learning · Computer Science 2022-03-21 Tobias Alt , Karl Schrader , Joachim Weickert , Pascal Peter , Matthias Augustin

Learning a task induces connectivity changes in neural circuits, thereby changing their dynamics. To elucidate task related neural dynamics we study trained Recurrent Neural Networks. We develop a Mean Field Theory for Reservoir Computing…

Neurons and Cognition · Quantitative Biology 2017-06-28 Alexander Rivkind , Omri Barak

The processing of information is an indispensable property of living systems realized by networks of active processes with enormous complexity. They have inspired many variants of modern machine learning one of them being reservoir…

Soft Condensed Matter · Physics 2023-07-28 Xiangzun Wang , Frank Cichos

It is well-known that population structure is a catalyst for the evolution of cooperation since individuals can reciprocate with their neighbors through local interactions defined by network structures. Previous research typically relies on…

Physics and Society · Physics 2021-12-16 Anzhi Sheng , Aming Li , Long Wang

Reservoir computing is a powerful framework for real-time information processing, characterized by its high computational ability and quick learning, with applications ranging from machine learning to biological systems. In this paper, we…

Disordered Systems and Neural Networks · Physics 2025-10-24 Shotaro Takasu , Toshio Aoyagi

Advances in materials science have led to physical instantiations of self-assembled networks of memristive devices and demonstrations of their computational capability through reservoir computing. Reservoir computing is an approach that…

Emerging Technologies · Computer Science 2015-04-28 Jens Bürger , Alireza Goudarzi , Darko Stefanovic , Christof Teuscher

The Reservoir Computing (RC) paradigm utilizes a dynamical system, i.e., a reservoir, and a linear classifier, i.e., a read-out layer, to process data from sequential classification tasks. In this paper the usage of Cellular Automata (CA)…

Emerging Technologies · Computer Science 2017-02-14 Stefano Nichele , Magnus S. Gundersen