English
Related papers

Related papers: Minimal Deterministic Echo State Networks Outperfo…

200 papers

Echo State Networks (ESN) are a class of Recurrent Neural Networks (RNN) that has gained substantial popularity due to their effectiveness, ease of use and potential for compact hardware implementation. An ESN contains the three network…

Machine Learning · Computer Science 2018-07-26 Luca Carcano , Emanuele Plebani , Danilo Pietro Pau , Marco Piastra

We propose a physics-informed machine learning method to predict the time average of a chaotic attractor. The method is based on the hybrid echo state network (hESN). We assume that the system is ergodic, so the time average is equal to the…

Machine Learning · Computer Science 2020-04-08 Francisco Huhn , Luca Magri

Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces…

Chaotic Dynamics · Physics 2020-05-19 Allen G Hart , James L Hook , Jonathan H P Dawes

Recurrent Neural Networks (RNNs) have demonstrated their outstanding ability in sequence tasks and have achieved state-of-the-art in wide range of applications, such as industrial, medical, economic and linguistic. Echo State Network (ESN)…

Machine Learning · Computer Science 2020-12-08 Chenxi Sun , Moxian Song , Shenda Hong , Hongyan Li

The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo state network (ESN) is a class of recurrent neural networks…

Machine Learning · Computer Science 2025-03-04 Abdullah M. Zyarah , Alaa M. Abdul-Hadi , Dhireesha Kudithipudi

Temporal data modelling techniques with neural networks are useful in many domain applications, including time-series forecasting and control engineering. This paper aims at developing a recurrent version of stochastic configuration…

Machine Learning · Computer Science 2025-04-03 Dianhui Wang , Gang Dang

Neuro-inspired recurrent neural network algorithms, such as echo state networks, are computationally lightweight and thereby map well onto untethered devices. The baseline echo state network algorithms are shown to be efficient in solving…

Machine Learning · Computer Science 2019-03-27 Zachariah Carmichael , Humza Syed , Stuart Burtner , Dhireesha Kudithipudi

Echo State Networks (ESNs) are a class of single-layer recurrent neural networks with randomly generated internal weights, and a single layer of tuneable outer weights, which are usually trained by regularised linear least squares…

Machine Learning · Computer Science 2021-04-07 Allen G Hart , James L Hook , Jonathan H P Dawes

An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate…

Dynamical Systems · Mathematics 2021-06-28 Allen G. Hart , Kevin R. Olding , A. M. G. Cox , Olga Isupova , J. H. P. Dawes

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of…

Machine Learning · Computer Science 2022-05-11 Peter Steiner , Azarakhsh Jalalvand , Peter Birkholz

We extend the Physics-Informed Echo State Network (PI-ESN) framework to reconstruct the evolution of an unmeasured state (hidden state) in a chaotic system. The PI-ESN is trained by using (i) data, which contains no information on the…

Signal Processing · Electrical Eng. & Systems 2020-04-08 Nguyen Anh Khoa Doan , Wolfgang Polifke , Luca Magri

Echo State Networks (ESNs) are simplified recurrent neural network models composed of a reservoir and a linear, trainable readout layer. The reservoir is tunable by some hyper-parameters that control the network behaviour. ESNs are known to…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Pietro Verzelli , Lorenzo Livi , Cesare Alippi

Echo state networks are powerful recurrent neural networks. However, they are often unstable and shaky, making the process of finding an good ESN for a specific dataset quite hard. Obtaining a superb accuracy by using the Echo State Network…

Machine Learning · Statistics 2018-02-22 Qiuyi Wu , Ernest Fokoue , Dhireesha Kudithipudi

In reservoir computing, an input sequence is processed by a recurrent neural network, the reservoir, which transforms it into a spatial pattern that a shallow readout network can then exploit for tasks such as memorization and time-series…

Neural and Evolutionary Computing · Computer Science 2025-12-30 Denis Kleyko , Christopher J. Kymn , E. Paxon Frady , Amy Loutfi , Friedrich T. Sommer

We propose Echo State Networks (ESNs) to predict the statistics of extreme events in a turbulent flow. We train the ESNs on small datasets that lack information about the extreme events. We asses whether the networks are able to extrapolate…

Fluid Dynamics · Physics 2022-04-13 Alberto Racca , Luca Magri

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tasks. To understand the success and limitations of RNNs, it is…

Information Theory · Computer Science 2017-01-30 Adam Charles , Dong Yin , Christopher Rozell

Echo State Networks (ESNs) are a particular type of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) framework, popular for their fast and efficient learning. However, traditional ESNs often struggle with…

Machine Learning · Computer Science 2026-01-30 Matteo Pinna , Andrea Ceni , Claudio Gallicchio

Model predictive control (MPC) is an industry standard control technique that iteratively solves an open-loop optimization problem to guide a system towards a desired state or trajectory. Consequently, an accurate forward model of system…

Systems and Control · Electrical Eng. & Systems 2024-11-11 Jan P. Williams , J. Nathan Kutz , Krithika Manohar

The echo state network (ESN) is a special type of recurrent neural networks for processing the time-series dataset. However, limited by the strong correlation among sequential samples of the agent, ESN-based policy control algorithms are…

Machine Learning · Computer Science 2022-01-14 Chunyuan Zhang , Chao Liu , Qi Song , Jie Zhao