English
Related papers

Related papers: Echo State Networks as State-Space Models: A Syste…

200 papers

This paper proposes a novel and interpretable recurrent neural-network structure using the echo-state network (ESN) paradigm for time-series prediction. While the traditional ESNs perform well for dynamical systems prediction, it needs a…

Machine Learning · Computer Science 2024-04-01 Debdipta Goswami

Echo-State Networks (ESNs) distil a key neurobiological insight: richly recurrent but fixed circuitry combined with adaptive linear read-outs can transform temporal streams with remarkable efficiency. Yet fundamental questions about…

Neural and Evolutionary Computing · Computer Science 2025-07-25 Pradeep Singh , Lavanya Sankaranarayanan , Balasubramanian Raman

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

Statistical Mechanics · Physics 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

Among the various architectures of Recurrent Neural Networks, Echo State Networks (ESNs) emerged due to their simplified and inexpensive training procedure. These networks are known to be sensitive to the setting of hyper-parameters, which…

Neural and Evolutionary Computing · Computer Science 2019-09-23 Pietro Verzelli , Cesare Alippi , Lorenzo Livi

In reservoir computing, an input sequence is processed by a recurrent neural network, the reservoir, which transforms it into a spatial pattern that a shallow readout network can then exploit for tasks such as memorization and time-series…

Neural and Evolutionary Computing · Computer Science 2025-12-30 Denis Kleyko , Christopher J. Kymn , E. Paxon Frady , Amy Loutfi , Friedrich T. Sommer

It is a widely accepted fact that data representations intervene noticeably in machine learning tools. The more they are well defined the better the performance results are. Feature extraction-based methods such as autoencoders are…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

The goal of this paper is to investigate the theoretical properties, the training algorithm, and the predictive control applications of Echo State Networks (ESNs), a particular kind of Recurrent Neural Networks. First, a condition…

Systems and Control · Computer Science 2019-02-06 Luca Bugliari Armenio , Enrico Terzi , Marcello Farina , Riccardo Scattolini

Recurrent Neural Networks (RNNs) have demonstrated their outstanding ability in sequence tasks and have achieved state-of-the-art in wide range of applications, such as industrial, medical, economic and linguistic. Echo State Network (ESN)…

Machine Learning · Computer Science 2020-12-08 Chenxi Sun , Moxian Song , Shenda Hong , Hongyan Li

We propose an innovative design for an optical Echo State Network (ESN), an advanced type of reservoir computer known for its universal computational capabilities. Our design enables an optical implementation of arbitrary ESNs, featuring…

Optics · Physics 2025-11-17 Ishwar S Kaushik , Peter J Ehlers , Daniel Soh

Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces…

Chaotic Dynamics · Physics 2020-05-19 Allen G Hart , James L Hook , Jonathan H P Dawes

Reservoir computing, using nonlinear dynamical systems, offers a cost-effective alternative to neural networks for complex tasks involving processing of sequential data, time series modeling, and system identification. Echo state networks…

Machine Learning · Computer Science 2025-01-14 Peter J. Ehlers , Hendra I. Nurdin , Daniel Soh

An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate…

Dynamical Systems · Mathematics 2021-06-28 Allen G. Hart , Kevin R. Olding , A. M. G. Cox , Olga Isupova , J. H. P. Dawes

Echo state networks (ESNs) are a powerful form of reservoir computing that only require training of linear output weights whilst the internal reservoir is formed of fixed randomly connected neurons. With a correctly scaled connectivity…

Machine Learning · Computer Science 2021-08-03 Luca Manneschi , Matthew O. A. Ellis , Guido Gigante , Andrew C. Lin , Paolo Del Giudice , Eleni Vasilaki

As one of the most important paradigms of recurrent neural networks, the echo state network (ESN) has been applied to a wide range of fields, from robotics to medicine, finance, and language processing. A key feature of the ESN paradigm is…

Machine Learning · Computer Science 2020-02-26 Pau Vilimelis Aceituno , Yan Gang , Yang-Yu Liu

The Echo State Network (ESN) is a class of Recurrent Neural Network with a large number of hidden-hidden weights (in the so-called reservoir). Canonical ESN and its variations have recently received significant attention due to their…

Neural and Evolutionary Computing · Computer Science 2022-09-30 Sebastian Basterrech , Gerardo Rubino

At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences? While deep learning has brought notable progress,…

Machine Learning · Computer Science 2025-11-18 Hongbo Liu , Jia Xu

Echo state networks are powerful recurrent neural networks. However, they are often unstable and shaky, making the process of finding an good ESN for a specific dataset quite hard. Obtaining a superb accuracy by using the Echo State Network…

Machine Learning · Statistics 2018-02-22 Qiuyi Wu , Ernest Fokoue , Dhireesha Kudithipudi

What is a neural model with minimum architectural complexity that exhibits reasonable language learning capability? To explore such a simple but sufficient neural language model, we revisit a basic reservoir computing (RC) model, Echo State…

Computation and Language · Computer Science 2025-03-04 Ryo Ueda , Tatsuki Kuribayashi , Shunsuke Kando , Kentaro Inui

The Echo State Network (ESN) is a specific recurrent network, which has gained popularity during the last years. The model has a recurrent network named reservoir, that is fixed during the learning process. The reservoir is used for…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Sebastián Basterrech
‹ Prev 1 2 3 10 Next ›