English
Related papers

Related papers: Exploring the limits of multifunctionality across …

200 papers

Recurrent neural networks (RNN) are powerful tools to explain how attractors may emerge from noisy, high-dimensional dynamics. We study here how to learn the ~N^(2) pairwise interactions in a RNN with N neurons to embed L manifolds of…

Disordered Systems and Neural Networks · Physics 2020-02-05 Aldo Battista , Rémi Monasson

Changes in an animal's behavioral state, such as arousal and movements, induce {complex modulations of the baseline input currents to sensory areas, eliciting sensory modality-specific effects. A simple computational principle explaining…

Neurons and Cognition · Quantitative Biology 2023-06-06 Shun Ogawa , Francesco Fumarola , Luca Mazzucato

This paper extends the notion of information processing capacity for non-independent input signals in the context of reservoir computing (RC). The presence of input autocorrelation makes worthwhile the treatment of forecasting and filtering…

Emerging Technologies · Computer Science 2015-10-08 Lyudmila Grigoryeva , Julie Henriques , Juan-Pablo Ortega

Reservoir Computing is a machine learning approach that uses the rich repertoire of complex system dynamics for function approximation. Current approaches to reservoir computing use a network of coupled integrating neurons that require a…

Neural and Evolutionary Computing · Computer Science 2025-07-30 Alexander Yeung , Peter DelMastro , Arjun Karuvally , Hava Siegelmann , Edward Rietman , Hananel Hazan

The brain in conjunction with the body is able to adapt to new environments and perform multiple behaviors through reuse of neural resources and transfer of existing behavioral traits. Although mechanisms that underlie this ability are not…

Neural and Evolutionary Computing · Computer Science 2018-05-17 Madhavun Candadai , Eduardo Izquierdo

Artificial Intelligence has advanced significantly in recent years thanks to innovations in the design and training of artificial neural networks (ANNs). Despite these advancements, we still understand relatively little about how elementary…

Dynamical Systems · Mathematics 2025-08-05 Jack O'Hagan , Andrew Keane , Andrew Flynn

An emerging computing paradigm, so-called next-generation reservoir computing (NG-RC) is investigated. True to its namesake, NG-RC requires no actual reservoirs for input data mixing but rather computing the polynomial terms directly from…

Machine Learning · Computer Science 2025-12-16 Ken-ichi Kitayama

Two potential bottlenecks on the expressiveness of recurrent neural networks (RNNs) are their ability to store information about the task in their parameters, and to store information about the input history in their units. We show…

Machine Learning · Statistics 2017-03-06 Jasmine Collins , Jascha Sohl-Dickstein , David Sussillo

Reservoir computers (RC) are randomized recurrent neural networks well adapted to process time series, performing tasks such as nonlinear distortion compensation or prediction of chaotic dynamics. Deep reservoir computers (deep-RC), in…

Emerging Technologies · Computer Science 2024-01-01 Alessandro Lupo , Enrico Picco , Marina Zajnulina , Serge Massar

Animals often demonstrate a remarkable ability to adapt to their environments during their lifetime. They do so partly due to the evolution of morphological and neural structures. These structures capture features of environments shared…

Machine Learning · Computer Science 2024-01-30 Corentin Léger , Gautier Hamon , Eleni Nisioti , Xavier Hinaut , Clément Moulin-Frier

Reservoir computing has proven effective for tasks such as time-series prediction, particularly in the context of chaotic systems. However, conventional reservoir computing frameworks often face challenges in achieving high prediction…

Chaotic Dynamics · Physics 2025-05-28 Felix Köster , Kazutaka Kanno , Atsushi Uchida

Reservoir computing can embed attractors into random neural networks (RNNs), generating a ``mirror'' of a target attractor because of its inherent symmetrical constraints. In these RNNs, we report that an attractor-merging crisis…

Chaotic Dynamics · Physics 2025-09-19 Tempei Kabayama , Motomasa Komuro , Yasuo Kuniyoshi , Kazuyuki Aihara , Kohei Nakajima

Reservoir computing is a promising approach for harnessing the computational power of recurrent neural networks while dramatically simplifying training. This paper investigates the application of integrate-and-fire neurons within reservoir…

Neural and Evolutionary Computing · Computer Science 2024-07-31 Samip Karki , Diego Chavez Arana , Andrew Sornborger , Francesco Caravelli

The Reservoir Computing (RC) framework states that any non-linear, input-driven dynamical system (the reservoir) exhibiting properties such as a fading memory and input separability can be trained to perform computational tasks. This broad…

Emerging Technologies · Computer Science 2019-06-20 Matthew Dale , Julian F. Miller , Susan Stepney , Martin A. Trefzer

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

Spiking activity of neurons engaged in learning and performing a task show complex spatiotemporal dynamics. While the output of recurrent network models can learn to perform various tasks, the possible range of recurrent dynamics that…

Neurons and Cognition · Quantitative Biology 2018-08-21 Christopher Kim , Carson Chow

Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through devising recurrent units and architectures with the…

Machine Learning · Statistics 2017-03-06 Yacine Jernite , Edouard Grave , Armand Joulin , Tomas Mikolov

Reservoir computing (RC) is known as a powerful machine learning approach for learning complex dynamics from limited data. Here, we use RC to predict highly stochastic dynamics of cell shapes. We find that RC is able to predict the steady…

Biological Physics · Physics 2024-09-17 Hoony Kang , Keshav Srinivasan , Wolfgang Losert

A reservoir computer is a complex nonlinear dynamical system that has been shown to be useful for solving certain problems, such as prediction of chaotic signals, speech recognition or control of robotic systems. Typically a reservoir…

Emerging Technologies · Computer Science 2019-08-30 Thomas L. Carroll , Louis M. Pecora

We study the propagation and distribution of information-carrying signals injected in dynamical systems serving as a reservoir computers. A multivariate correlation analysis in tailored replica tests reveals consistency spectra and…

Disordered Systems and Neural Networks · Physics 2021-05-31 Thomas Jüngling , Thomas Lymburn , Michael Small