English
Related papers

Related papers: Echo State Networks: analysis, training and predic…

200 papers

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

The echo state network (ESN) is a special type of recurrent neural networks for processing the time-series dataset. However, limited by the strong correlation among sequential samples of the agent, ESN-based policy control algorithms are…

Machine Learning · Computer Science 2022-01-14 Chunyuan Zhang , Chao Liu , Qi Song , Jie Zhao

This article introduces a robust hybrid method for solving supervised learning tasks, which uses the Echo State Network (ESN) model and the Particle Swarm Optimization (PSO) algorithm. An ESN is a Recurrent Neural Network with the…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Sebastián Basterrech , Enrique Alba , Václav Snášel

Echo state networks (ESNs) are a powerful form of reservoir computing that only require training of linear output weights whilst the internal reservoir is formed of fixed randomly connected neurons. With a correctly scaled connectivity…

Machine Learning · Computer Science 2021-08-03 Luca Manneschi , Matthew O. A. Ellis , Guido Gigante , Andrew C. Lin , Paolo Del Giudice , Eleni Vasilaki

At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences? While deep learning has brought notable progress,…

Machine Learning · Computer Science 2025-11-18 Hongbo Liu , Jia Xu

We propose automatic speech recognition (ASR) models inspired by echo state network (ESN), in which a subset of recurrent neural networks (RNN) layers in the models are randomly initialized and untrained. Our study focuses on RNN-T and…

Computation and Language · Computer Science 2021-02-19 Harsh Shrivastava , Ankush Garg , Yuan Cao , Yu Zhang , Tara Sainath

In this paper we introduce a new framework to train an Echo State Network to predict real valued time-series. The method consists in projecting the output of the internal layer of the network on a space with lower dimensionality, before…

Neural and Evolutionary Computing · Computer Science 2017-01-10 Sigurd Løkse , Filippo Maria Bianchi , Robert Jenssen

Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of…

Machine Learning · Computer Science 2022-05-11 Peter Steiner , Azarakhsh Jalalvand , Peter Birkholz

A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained. In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and…

Dynamical Systems · Mathematics 2021-12-28 Allen G Hart

Recurrent neural networks (RNNs) have drawn interest from machine learning researchers because of their effectiveness at preserving past inputs for time-varying data processing tasks. To understand the success and limitations of RNNs, it is…

Information Theory · Computer Science 2017-01-30 Adam Charles , Dong Yin , Christopher Rozell

Extreme event are sudden large-amplitude changes in the state or observables of chaotic nonlinear systems, which characterize many scientific phenomena. Because of their violent nature, extreme events typically have adverse consequences,…

Machine Learning · Computer Science 2023-08-08 Alberto Racca , Luca Magri

Stock return prediction is a problem that has received much attention in the finance literature. In recent years, sophisticated machine learning methods have been shown to perform significantly better than ''classical'' prediction…

Computational Finance · Quantitative Finance 2025-04-29 Giovanni Ballarin , Jacopo Capra , Petros Dellaportas

Recognising previously visited locations is an important, but unsolved, task in autonomous navigation. Current visual place recognition (VPR) benchmarks typically challenge models to recover the position of a query image (or images) from…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Anil Ozdemir , Mark Scerri , Andrew B. Barron , Andrew Philippides , Michael Mangan , Eleni Vasilaki , Luca Manneschi

Echo state networks are a recently developed type of recurrent neural network where the internal layer is fixed with random weights, and only the output layer is trained on specific data. Echo state networks are increasingly being used to…

Neural and Evolutionary Computing · Computer Science 2018-02-06 Ashley Prater

This paper investigates the performance of Echo State Networks (ESNs) for univariate time series forecasting using a subset of the M4 Forecasting Competition dataset. Focusing on monthly and quarterly time series, we evaluate whether a…

Machine Learning · Computer Science 2026-04-08 Alexander Häußer

Recurrent neural networks (RNNs) can be interpreted as discrete-time state-space models, where the state evolution corresponds to an infinite-impulse-response (IIR) filtering operation governed by both feedforward weights and recurrent…

Machine Learning · Computer Science 2026-02-26 Alexander Morgan , Ummay Sumaya Khan , Lingjia Liu , Lizhong Zheng

Machine learning (ML) is widely used to model chaotic systems. Among ML approaches, echo state networks (ESNs) have received considerable attention due to their simple construction and fast training. However, ESN performance is highly…

Chaotic Dynamics · Physics 2025-07-09 Francesco Martinuzzi

We extend the Physics-Informed Echo State Network (PI-ESN) framework to reconstruct the evolution of an unmeasured state (hidden state) in a chaotic system. The PI-ESN is trained by using (i) data, which contains no information on the…

Signal Processing · Electrical Eng. & Systems 2020-04-08 Nguyen Anh Khoa Doan , Wolfgang Polifke , Luca Magri

Many natural and physical processes can be understood by analyzing multiple system variables evolving, forming a multivariate time series. Predicting such time series is challenging due to the inherent noise and interdependencies among…

Chaotic Dynamics · Physics 2025-12-11 S. Hariharan , R. Suresh , V. K. Chandrasekar

Neural network controllers have become popular in control tasks thanks to their flexibility and expressivity. Stability is a crucial property for safety-critical dynamical systems, while stabilization of partially observed systems, in many…

Systems and Control · Electrical Eng. & Systems 2021-12-08 Fangda Gu , He Yin , Laurent El Ghaoui , Murat Arcak , Peter Seiler , Ming Jin