English
Related papers

Related papers: Efficient Optimization of Echo State Networks for …

200 papers

Echo state networks (ESNs) are a class of recurrent neural networks in which only the readout layer is trainable, while the recurrent and input layers are fixed. This architectural constraint enables computationally efficient processing of…

Machine Learning · Computer Science 2025-07-31 Taiki Yamada , Yuichi Katori , Kantaro Fujiwara

Neuro-inspired recurrent neural network algorithms, such as echo state networks, are computationally lightweight and thereby map well onto untethered devices. The baseline echo state network algorithms are shown to be efficient in solving…

Machine Learning · Computer Science 2019-03-27 Zachariah Carmichael , Humza Syed , Stuart Burtner , Dhireesha Kudithipudi

As an efficient recurrent neural network (RNN) model, reservoir computing (RC) models, such as Echo State Networks, have attracted widespread attention in the last decade. However, while they have had great success with time series data…

Machine Learning · Computer Science 2017-11-16 Qianli Ma , Lifeng Shen , Garrison W. Cottrell

Long-lead forecasting for spatio-temporal systems can often entail complex nonlinear dynamics that are difficult to specify it a priori. Current statistical methodologies for modeling these processes are often highly parameterized and thus,…

Machine Learning · Statistics 2018-09-05 Patrick L. McDermott , Christopher K. Wikle

Forecasting stock and cryptocurrency prices is challenging due to high volatility and non-stationarity, influenced by factors like economic changes and market sentiment. Previous research shows that Echo State Networks (ESNs) can…

Machine Learning · Computer Science 2025-08-08 Mansi Sharma , Enrico Sartor , Marc Cavazza , Helmut Prendinger

Modeling the dynamics of the formation and evolution of protostellar disks as well as the history of stellar mass accretion typically involve the numerical solution of complex systems of coupled differential equations. The resulting mass…

Solar and Stellar Astrophysics · Physics 2023-04-18 Gianfranco Bino , Shantanu Basu , Ramit Dey , Sayantan Auddy , Lyle Muller , Eduard I. Vorobyov

Echo State Networks (ESNs) are a particular type of untrained Recurrent Neural Networks (RNNs) within the Reservoir Computing (RC) framework, popular for their fast and efficient learning. However, traditional ESNs often struggle with…

Machine Learning · Computer Science 2026-01-30 Matteo Pinna , Andrea Ceni , Claudio Gallicchio

We propose an approximation of Echo State Networks (ESN) that can be efficiently implemented on digital hardware based on the mathematics of hyperdimensional computing. The reservoir of the proposed integer Echo State Network (intESN) is a…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Denis Kleyko , E. Paxon Frady , Mansour Kheffache , Evgeny Osipov

The Echo State Network (ESN) is a class of Recurrent Neural Network with a large number of hidden-hidden weights (in the so-called reservoir). Canonical ESN and its variations have recently received significant attention due to their…

Neural and Evolutionary Computing · Computer Science 2022-09-30 Sebastian Basterrech , Gerardo Rubino

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

Statistical Mechanics · Physics 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

Recognising previously visited locations is an important, but unsolved, task in autonomous navigation. Current visual place recognition (VPR) benchmarks typically challenge models to recover the position of a query image (or images) from…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Anil Ozdemir , Mark Scerri , Andrew B. Barron , Andrew Philippides , Michael Mangan , Eleni Vasilaki , Luca Manneschi

Echo-State Networks (ESNs) distil a key neurobiological insight: richly recurrent but fixed circuitry combined with adaptive linear read-outs can transform temporal streams with remarkable efficiency. Yet fundamental questions about…

Neural and Evolutionary Computing · Computer Science 2025-07-25 Pradeep Singh , Lavanya Sankaranarayanan , Balasubramanian Raman

This article introduces a robust hybrid method for solving supervised learning tasks, which uses the Echo State Network (ESN) model and the Particle Swarm Optimization (PSO) algorithm. An ESN is a Recurrent Neural Network with the…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Sebastián Basterrech , Enrique Alba , Václav Snášel

Echo state networks (ESN), a type of reservoir computing (RC) architecture, are efficient and accurate artificial neural systems for time series processing and learning. An ESN consists of a core of recurrent neural networks, called a…

Neural and Evolutionary Computing · Computer Science 2015-04-28 Alireza Goudarzi , Alireza Shabani , Darko Stefanovic

In reservoir computing, an input sequence is processed by a recurrent neural network, the reservoir, which transforms it into a spatial pattern that a shallow readout network can then exploit for tasks such as memorization and time-series…

Neural and Evolutionary Computing · Computer Science 2025-12-30 Denis Kleyko , Christopher J. Kymn , E. Paxon Frady , Amy Loutfi , Friedrich T. Sommer

An Echo State Network (ESN) is a type of single-layer recurrent neural network with randomly-chosen internal weights and a trainable output layer. We prove under mild conditions that a sufficiently large Echo State Network can approximate…

Dynamical Systems · Mathematics 2021-06-28 Allen G. Hart , Kevin R. Olding , A. M. G. Cox , Olga Isupova , J. H. P. Dawes

Echo State Networks (ESNs) are recurrent neural networks usually employed for modeling nonlinear dynamic systems with relatively ease of training. By incorporating physical laws into the training of ESNs, Physics-Informed ESNs (PI-ESNs)…

Machine Learning · Computer Science 2025-02-05 Eric Mochiutti , Eric Aislan Antonelo , Eduardo Camponogara

Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of…

Machine Learning · Computer Science 2022-05-11 Peter Steiner , Azarakhsh Jalalvand , Peter Birkholz

Echo State Networks (ESNs) are a class of single-layer recurrent neural networks with randomly generated internal weights, and a single layer of tuneable outer weights, which are usually trained by regularised linear least squares…

Machine Learning · Computer Science 2021-04-07 Allen G Hart , James L Hook , Jonathan H P Dawes

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio