English
Related papers

Related papers: Improving the Performance of Echo State Networks T…

200 papers

In this paper we introduce a new framework to train an Echo State Network to predict real valued time-series. The method consists in projecting the output of the internal layer of the network on a space with lower dimensionality, before…

Neural and Evolutionary Computing · Computer Science 2017-01-10 Sigurd Løkse , Filippo Maria Bianchi , Robert Jenssen

Recurrent stochastic configuration networks (RSCNs) have shown promise in modelling nonlinear dynamic systems with order uncertainty due to their advantages of easy implementation, less human intervention, and strong approximation…

Machine Learning · Computer Science 2024-11-19 Gang Dang , Dainhui Wang

In this paper we demonstrate that reservoir computing can be used to learn the dynamics of the shallow-water equations. In particular, while most previous applications of reservoir computing have required training on a particular trajectory…

Machine Learning · Computer Science 2022-11-10 Xiaoqian Chen , Balasubramanya T. Nadiga , Ilya Timofeyev

The operating point of a power system may change due to slow enough variations of the power injections. Rotating machines in the bulk system can absorb smooth changes in the dynamic states of the system. In this context, we present a novel…

Optimization and Control · Mathematics 2024-01-22 Gabriel Intriago , Holger Cevallos , Yu Zhang

Reservoir computing (RC) is a machine learning algorithm that can learn complex time series from data very rapidly based on the use of high-dimensional dynamical systems, such as random networks of neurons, called "reservoirs." To implement…

Machine Learning · Computer Science 2020-12-29 Yusuke Sakemi , Kai Morino , Timothée Leleu , Kazuyuki Aihara

Reservoir computers are a type of neuromorphic computer that may be built a an analog system, potentially creating powerful computers that are small, light and consume little power. Typically a reservoir computer is build by connecting…

Neural and Evolutionary Computing · Computer Science 2021-02-03 Thomas L. Carroll

Parameterized state space models in the form of recurrent networks are often used in machine learning to learn from data streams exhibiting temporal dependencies. To break the black box nature of such models it is important to understand…

Machine Learning · Computer Science 2020-02-18 Peter Tino

In recent years, Neural Turing Machines have gathered attention by joining the flexibility of neural networks with the computational capabilities of Turing machines. However, Neural Turing Machines are notoriously hard to train, which…

Machine Learning · Computer Science 2020-03-11 Benjamin Paassen , Alexander Schulz

Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a "next-generation"…

Machine Learning · Computer Science 2023-03-28 Sarah E. Marzen , Paul M. Riechers , James P. Crutchfield

Recurrent Neural Networks (RNNs) are becoming increasingly important for time series-related applications which require efficient and real-time implementations. The two major types are Long Short-Term Memory (LSTM) and Gated Recurrent Unit…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Zhe Li , Caiwen Ding , Siyue Wang , Wujie Wen , Youwei Zhuo , Chang Liu , Qinru Qiu , Wenyao Xu , Xue Lin , Xuehai Qian , Yanzhi Wang

Spiking Neural Networks (SNNs) have recently become more popular as a biologically plausible substitute for traditional Artificial Neural Networks (ANNs). SNNs are cost-efficient and deployment-friendly because they process input in both…

Neural and Evolutionary Computing · Computer Science 2023-10-03 Yuhang Li , Tamar Geller , Youngeun Kim , Priyadarshini Panda

Recently, spiking neural networks (SNNs) have demonstrated substantial potential in computer vision tasks. In this paper, we present an Efficient Spiking Deraining Network, called ESDNet. Our work is motivated by the observation that rain…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Tianyu Song , Guiyue Jin , Pengpeng Li , Kui Jiang , Xiang Chen , Jiyu Jin

A reservoir computer is a complex nonlinear dynamical system that has been shown to be useful for solving certain problems, such as prediction of chaotic signals, speech recognition or control of robotic systems. Typically a reservoir…

Emerging Technologies · Computer Science 2019-08-30 Thomas L. Carroll , Louis M. Pecora

Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing…

Echo-state networks are simple models of discrete dynamical systems driven by a time series. By selecting network parameters such that the dynamics of the network is contractive, characterized by a negative maximal Lyapunov exponent, the…

Machine Learning · Computer Science 2022-12-06 L. Storm , K. Gustavsson , B. Mehlig

Recurrent Neural Networks (RNN) are extensively employed for processing sequential data such as time series. Reservoir computing (RC) has drawn attention as an RNN framework due to its fixed network that does not require training, making it…

Emerging Technologies · Computer Science 2025-09-19 T. M. Kamsma , J. J. Teijema , R. van Roij , C. Spitoni

In this paper, we propose a novel lightweight learning from demonstration (LfD) model based on reservoir computing that can learn and generate multiple movement trajectories with prediction intervals, which we call as Context-based Echo…

Robotics · Computer Science 2024-12-03 Negin Amirshirzad , Mehmet Arda Eren , Erhan Oztop

Echo State Networks are efficient time-series predictors, which highly depend on the value of the spectral radius of the reservoir connectivity matrix. Based on recent results on the mean field theory of driven random recurrent neural…

Chaotic Dynamics · Physics 2015-05-26 Mathieu Galtier , Gilles Wainrib

The well-known generalization problem hinders the application of artificial neural networks in continuous-time prediction tasks with varying latent dynamics. In sharp contrast, biological systems can neatly adapt to evolving environments…

Machine Learning · Computer Science 2025-03-10 Jindou Jia , Zihan Yang , Meng Wang , Kexin Guo , Jianfei Yang , Xiang Yu , Lei Guo

Continuous Time Echo State Networks (CTESNs) are a promising yet under-explored surrogate modeling technique for dynamical systems, particularly those governed by stiff Ordinary Differential Equations (ODEs). A key determinant of the…

Computational Engineering, Finance, and Science · Computer Science 2024-01-25 Saakaar Bhatnagar