English
Related papers

Related papers: Improving the Performance of Echo State Networks T…

200 papers

The prefrontal cortex is known to be involved in many high-level cognitive functions, in particular, working memory. Here, we study to what extent a group of randomly connected units (namely an Echo State Network, ESN) can store and…

Neurons and Cognition · Quantitative Biology 2018-06-19 Anthony Strock , Nicolas Rougier , Xavier Hinaut

Echo state networks are computationally lightweight reservoir models inspired by the random projections observed in cortical circuitry. As interest in reservoir computing has grown, networks have become deeper and more intricate. While…

Signal Processing · Electrical Eng. & Systems 2019-08-23 Zachariah Carmichael , Humza Syed , Dhireesha Kudithipudi

Macroeconomic forecasting has recently started embracing techniques that can deal with large-scale datasets and series with unequal release periods. MIxed-DAta Sampling (MIDAS) and Dynamic Factor Models (DFM) are the two main…

Reservoir computers (RCs) provide a computationally efficient alternative to deep learning while also offering a framework for incorporating brain-inspired computational principles. By using an internal neural network with random, fixed…

Neural and Evolutionary Computing · Computer Science 2025-04-18 Keshav Srinivasan , Dietmar Plenz , Michelle Girvan

We investigate the ability of an ensemble reservoir computing approach to predict the long-term behaviour of the phase-space region in which the motion of charged particles in hadron storage rings is bounded, the so-called dynamic aperture.…

Accelerator Physics · Physics 2023-01-18 Maxime Casanova , Barbara Dalena , Luca Bonaventura , Massimo Giovannozzi

A recurrent neural network (RNN) possesses the echo state property (ESP) if, for a given input sequence, it ``forgets'' any internal states of the driven (nonautonomous) system and asymptotically follows a unique, possibly complex…

Dynamical Systems · Mathematics 2020-06-26 Andrea Ceni , Peter Ashwin , Lorenzo Livi , Claire Postlethwaite

Supralinear and sublinear pre-synaptic and dendritic integration is considered to be responsible for nonlinear computation power of biological neurons, emphasizing the role of nonlinear integration as opposed to nonlinear output…

Neural and Evolutionary Computing · Computer Science 2015-04-28 Alireza Goudarzi , Alireza Shabani , Darko Stefanovic

Reservoir Computing has found many potential applications in the field of complex dynamics. In this article, we exploit the exceptional capability of the echo-state network (ESN) model to make it learn a unidirectional coupling scheme from…

Machine Learning · Computer Science 2023-06-21 Swarnendu Mandal , Manish Dev Shrimali

Echo-State Networks and Reservoir Computing have been studied for more than a decade. They provide a simpler yet powerful alternative to Recurrent Neural Networks, every internal weight is fixed and only the last linear layer is trained.…

Emerging Technologies · Computer Science 2018-09-25 Jonathan Dong , Sylvain Gigan , Florent Krzakala , Gilles Wainrib

Neuro-inspired recurrent neural network algorithms, such as echo state networks, are computationally lightweight and thereby map well onto untethered devices. The baseline echo state network algorithms are shown to be efficient in solving…

Machine Learning · Computer Science 2019-03-27 Zachariah Carmichael , Humza Syed , Stuart Burtner , Dhireesha Kudithipudi

Spatio-temporal data and processes are prevalent across a wide variety of scientific disciplines. These processes are often characterized by nonlinear time dynamics that include interactions across multiple scales of spatial and temporal…

Machine Learning · Statistics 2017-08-18 Patrick L. McDermott , Christopher K. Wikle

The echo state network (ESN) is a special type of recurrent neural networks for processing the time-series dataset. However, limited by the strong correlation among sequential samples of the agent, ESN-based policy control algorithms are…

Machine Learning · Computer Science 2022-01-14 Chunyuan Zhang , Chao Liu , Qi Song , Jie Zhao

This article introduces a robust hybrid method for solving supervised learning tasks, which uses the Echo State Network (ESN) model and the Particle Swarm Optimization (PSO) algorithm. An ESN is a Recurrent Neural Network with the…

Neural and Evolutionary Computing · Computer Science 2015-01-05 Sebastián Basterrech , Enrique Alba , Václav Snášel

We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks while ensuring that their…

Machine Learning · Computer Science 2020-11-05 Nguyen Anh Khoa Doan , Wolfgang Polifke , Luca Magri

The echo state property (ESP) represents a fundamental concept in the reservoir computing (RC) framework that ensures output-only training of reservoir networks by being agnostic to the initial states and far past inputs. However, the…

Quantum Physics · Physics 2024-09-04 Shumpei Kobayashi , Quoc Hoan Tran , Kohei Nakajima

Since their inception, learning techniques under the Reservoir Computing paradigm have shown a great modeling capability for recurrent systems without the computing overheads required for other approaches. Among them, different flavors of…

Machine Learning · Computer Science 2021-02-18 Alejandro Barredo Arrieta , Sergio Gil-Lopez , Ibai Laña , Miren Nekane Bilbao , Javier Del Ser

Reservoir computing offers an energy-efficient alternative to deep neural networks (DNNs) by replacing complex hidden layers with a fixed nonlinear system and training only the final layer. This work investigates nanoelectromechanical…

Applied Physics · Physics 2024-09-26 Enise Kartal , Yunus Selcuk , Batuhan E. Kaynak , M. Taha Yildiz , Cenk Yanik , M. Selim Hanay

Machine learning (ML) is widely used to model chaotic systems. Among ML approaches, echo state networks (ESNs) have received considerable attention due to their simple construction and fast training. However, ESN performance is highly…

Chaotic Dynamics · Physics 2025-07-09 Francesco Martinuzzi

Reservoir Computing (RC) is an appealing approach in Machine Learning that combines the high computational capabilities of Recurrent Neural Networks with a fast and easy training method. Likewise, successful implementation of neuro-inspired…

Adaptation and Self-Organizing Systems · Physics 2021-07-13 Guillermo B. Morales , Claudio R. Mirasso , Miguel C. Soriano

Reservoir computing is a form of machine learning that utilizes nonlinear dynamical systems to perform complex tasks in a cost-effective manner when compared to typical neural networks. Many recent advancements in reservoir computing, in…

Machine Learning · Computer Science 2025-04-03 Peter J. Ehlers , Hendra I. Nurdin , Daniel Soh