English
Related papers

Related papers: Learn to Synchronize, Synchronize to Learn

200 papers

This paper extends the notion of information processing capacity for non-independent input signals in the context of reservoir computing (RC). The presence of input autocorrelation makes worthwhile the treatment of forecasting and filtering…

Emerging Technologies · Computer Science 2015-10-08 Lyudmila Grigoryeva , Julie Henriques , Juan-Pablo Ortega

Reservoir Computing (RC) is a popular methodology for the efficient design of Recurrent Neural Networks (RNNs). Recently, the advantages of the RC approach have been extended to the context of multi-layered RNNs, with the introduction of…

Machine Learning · Computer Science 2019-09-25 Claudio Gallicchio , Alessio Micheli

Recurrent neural networks (RNNs) are known to be universal approximators of dynamic systems under fairly mild and general assumptions. However, RNNs usually suffer from the issues of vanishing and exploding gradients in standard RNN…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Shashank Jere , Lizhong Zheng , Karim Said , Lingjia Liu

We attempt to achieve isochronal synchronization between a drive system unidirectionally coupled to a response system, under the assumption that limited knowledge on the states of the drive is available at the response. Machine learning…

Adaptation and Self-Organizing Systems · Physics 2023-10-17 Amirhossein Nazerian , Chad Nathe , Joseph D. Hart , Francesco Sorrentino

Machine learning approaches have recently been leveraged as a substitute or an aid for physical/mathematical modeling approaches to dynamical systems. To develop an efficient machine learning method dedicated to modeling and prediction of…

Machine Learning · Computer Science 2022-08-01 Gouhei Tanaka , Tadayoshi Matsumori , Hiroaki Yoshida , Kazuyuki Aihara

Reservoir computation models form a subclass of recurrent neural networks with fixed non-trainable input and dynamic coupling weights. Only the static readout from the state space (reservoir) is trainable, thus avoiding the known problems…

Neural and Evolutionary Computing · Computer Science 2024-06-06 Boyu Li , Robert Simon Fong , Peter Tiňo

Forecasting high-dimensional spatiotemporal systems remains computationally challenging for recurrent neural networks (RNNs) and long short-term memory (LSTM) models due to gradient-based training and memory bottlenecks. Reservoir Computing…

Machine Learning · Computer Science 2026-01-05 Ata Akbari Asanjan , Filip Wudarski , Daniel O'Connor , Shaun Geaney , Elena Strbac , P. Aaron Lott , Davide Venturelli

Reservoir Computing (RC) is a powerful computational paradigm that allows high versatility with cheap learning. While other artificial intelligence approaches need exhaustive resources to specify their inner workings, RC is based on a…

Adaptation and Self-Organizing Systems · Physics 2018-11-26 Luís F Seoane

The increasing popularity of machine learning solutions puts increasing restrictions on this field if it is to penetrate more aspects of life. In particular, energy efficiency and speed of operation is crucial, inter alia in portable…

Emerging Technologies · Computer Science 2020-01-14 Dawid Przyczyna , Sébastien Pecqueur , Dominique Vuillaume , Konrad Szaciłowski

Model-based reinforcement learning (RL) enjoys several benefits, such as data-efficiency and planning, by learning a model of the environment's dynamics. However, learning a global model that can generalize across different dynamics is a…

Machine Learning · Computer Science 2020-06-30 Kimin Lee , Younggyo Seo , Seunghyun Lee , Honglak Lee , Jinwoo Shin

In the last decade, a new computational paradigm was introduced in the field of Machine Learning, under the name of Reservoir Computing (RC). RC models are neural networks which a recurrent part (the reservoir) that does not participate in…

Neural and Evolutionary Computing · Computer Science 2013-04-08 Sebastián Basterrech , Gerardo Rubino

Generalized synchronization between coupled dynamical systems is a phenomenon of relevance in applications that range from secure communications to physiological modelling. Here we test the capabilities of reservoir computing and, in…

Chaotic Dynamics · Physics 2018-04-18 D Ibanez-Soria , J Garcia-Ojalvo , A Soria-Frisch , G Ruffini

Systematic Generalization refers to a learning algorithm's ability to extrapolate learned behavior to unseen situations that are distinct but semantically similar to its training data. As shown in recent work, state-of-the-art deep learning…

Artificial Intelligence · Computer Science 2020-10-06 Tong Gao , Qi Huang , Raymond J. Mooney

Reservoir computing (RC) is known as a powerful machine learning approach for learning complex dynamics from limited data. Here, we use RC to predict highly stochastic dynamics of cell shapes. We find that RC is able to predict the steady…

Biological Physics · Physics 2024-09-17 Hoony Kang , Keshav Srinivasan , Wolfgang Losert

In applications of dynamical systems, situations can arise where it is desired to predict the onset of synchronization as it can lead to characteristic and significant changes in the system performance and behaviors, for better or worse. In…

Adaptation and Self-Organizing Systems · Physics 2021-06-30 Huawei Fan , Ling-Wei Kong , Ying-Cheng Lai , Xingang Wang

Controlling nonlinear dynamical systems using machine learning allows to not only drive systems into simple behavior like periodicity but also to more complex arbitrary dynamics. For this, it is crucial that a machine learning system can be…

Machine Learning · Computer Science 2023-07-17 Alexander Haluszczynski , Daniel Köglmayr , Christoph Räth

Reservoir computing is a popular approach to design recurrent neural networks, due to its training simplicity and approximation performance. The recurrent part of these networks is not trained (e.g., via gradient descent), making them…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Pietro Verzelli , Cesare Alippi , Lorenzo Livi , Peter Tino

We consider problems of making sequences of decisions to accomplish tasks, interacting via the medium of language. These problems are often tackled with reinforcement learning approaches. We find that these models do not generalize well…

Computation and Language · Computer Science 2020-10-07 Xusen Yin , Ralph Weischedel , Jonathan May

This paper introduces a novel approach to predicting periodic time series using reservoir computing. The model is tailored to deliver precise forecasts of rhythms, a crucial aspect for tasks such as generating musical rhythm. Leveraging…

Neural and Evolutionary Computing · Computer Science 2025-01-23 Zhongju Yuan , Geraint Wiggins , Dick Botteldooren

Neural networks are very powerful learning systems, but they do not readily generalize from one task to the other. This is partly due to the fact that they do not learn in a compositional way, that is, by discovering skills that are shared…

Artificial Intelligence · Computer Science 2018-07-27 Adam Liška , Germán Kruszewski , Marco Baroni