English
Related papers

Related papers: Pre-trainable Reservoir Computing with Recursive N…

200 papers

Echo-State Networks (ESNs) distil a key neurobiological insight: richly recurrent but fixed circuitry combined with adaptive linear read-outs can transform temporal streams with remarkable efficiency. Yet fundamental questions about…

Neural and Evolutionary Computing · Computer Science 2025-07-25 Pradeep Singh , Lavanya Sankaranarayanan , Balasubramanian Raman

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

Echo State Network (ESN) presents a distinguished kind of recurrent neural networks. It is built upon a sparse, random and large hidden infrastructure called reservoir. ESNs have succeeded in dealing with several non-linear problems such as…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

Deep learning has seen a rapid adoption in a variety of wireless communications applications, including at the physical layer. While it has delivered impressive performance in tasks such as channel equalization and receive processing/symbol…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Shashank Jere , Karim Said , Lizhong Zheng , Lingjia Liu

The Echo State Network (ESN) is a specific recurrent network, which has gained popularity during the last years. The model has a recurrent network named reservoir, that is fixed during the learning process. The reservoir is used for…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Sebastián Basterrech

Echo State Networks (ESNs) are simplified recurrent neural network models composed of a reservoir and a linear, trainable readout layer. The reservoir is tunable by some hyper-parameters that control the network behaviour. ESNs are known to…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Pietro Verzelli , Lorenzo Livi , Cesare Alippi

We propose a novel algorithm for performing federated learning with Echo State Networks (ESNs) in a client-server scenario. In particular, our proposal focuses on the adaptation of reservoirs by combining Intrinsic Plasticity with Federated…

Neural and Evolutionary Computing · Computer Science 2022-06-23 Valerio De Caro , Claudio Gallicchio , Davide Bacciu

Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces…

Chaotic Dynamics · Physics 2020-05-19 Allen G Hart , James L Hook , Jonathan H P Dawes

Recent advancements in artificial neural networks have enabled impressive tasks on classical computers, but they demand significant computational resources. While quantum computing offers potential beyond classical systems, the advantages…

Quantum Physics · Physics 2024-12-12 Erik Connerty , Ethan Evans , Gerasimos Angelatos , Vignesh Narayanan

Reinforcement learning (RL) policies trained in simulation often suffer from severe performance degradation when deployed in real-world environments due to non-stationary dynamics. While Domain Randomization (DR) and meta-RL have been…

Machine Learning · Computer Science 2026-02-09 Aoi Yoshimura , Gouhei Tanaka

We propose an experimental comparison between Deep Echo State Networks (DeepESNs) and gated Recurrent Neural Networks (RNNs) on multivariate time-series prediction tasks. In particular, we compare reservoir and fully-trained RNNs able to…

Machine Learning · Computer Science 2019-11-21 Claudio Gallicchio , Alessio Micheli , Luca Pedrelli

Reservoir computing is a recent trend in neural networks which uses the dynamical perturbations on the phase space of a system to compute a desired target function. We present how one can formulate an expectation of system performance in a…

Neural and Evolutionary Computing · Computer Science 2014-09-02 Alireza Goudarzi , Darko Stefanovic

The echo state network (ESN) is a special type of recurrent neural networks for processing the time-series dataset. However, limited by the strong correlation among sequential samples of the agent, ESN-based policy control algorithms are…

Machine Learning · Computer Science 2022-01-14 Chunyuan Zhang , Chao Liu , Qi Song , Jie Zhao

We investigate the ability of an ensemble reservoir computing approach to predict the long-term behaviour of the phase-space region in which the motion of charged particles in hadron storage rings is bounded, the so-called dynamic aperture.…

Accelerator Physics · Physics 2023-01-18 Maxime Casanova , Barbara Dalena , Luca Bonaventura , Massimo Giovannozzi

Machine learning has become a widely popular and successful paradigm, including in data-driven science and engineering. A major application problem is data-driven forecasting of future states from a complex dynamical. Artificial neural…

Data Analysis, Statistics and Probability · Physics 2021-03-19 Erik Bollt

This article introduces a robust hybrid method for solving supervised learning tasks, which uses the Echo State Network (ESN) model and the Particle Swarm Optimization (PSO) algorithm. An ESN is a Recurrent Neural Network with the…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Sebastián Basterrech , Enrique Alba , Václav Snášel

In recent years, Neural Turing Machines have gathered attention by joining the flexibility of neural networks with the computational capabilities of Turing machines. However, Neural Turing Machines are notoriously hard to train, which…

Machine Learning · Computer Science 2020-03-11 Benjamin Paassen , Alexander Schulz

Recurrent Neural Networks (RNN) are extensively employed for processing sequential data such as time series. Reservoir computing (RC) has drawn attention as an RNN framework due to its fixed network that does not require training, making it…

Emerging Technologies · Computer Science 2025-09-19 T. M. Kamsma , J. J. Teijema , R. van Roij , C. Spitoni

We introduce a novel class of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) paradigm, called Residual Reservoir Memory Networks (ResRMNs). ResRMN combines a linear memory reservoir with a non-linear…

Machine Learning · Computer Science 2026-02-02 Matteo Pinna , Andrea Ceni , Claudio Gallicchio

A recurrent neural network (RNN) possesses the echo state property (ESP) if, for a given input sequence, it ``forgets'' any internal states of the driven (nonautonomous) system and asymptotically follows a unique, possibly complex…

Dynamical Systems · Mathematics 2020-06-26 Andrea Ceni , Peter Ashwin , Lorenzo Livi , Claire Postlethwaite