English
Related papers

Related papers: Deep-ESN: A Multiple Projection-encoding Hierarchi…

200 papers

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

Statistical Mechanics · Physics 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

In the last decade, a new computational paradigm was introduced in the field of Machine Learning, under the name of Reservoir Computing (RC). RC models are neural networks which a recurrent part (the reservoir) that does not participate in…

Neural and Evolutionary Computing · Computer Science 2013-04-08 Sebastián Basterrech , Gerardo Rubino

A reservoir computer is a special type of neural network, where most of the weights are randomly fixed and only a subset are trained. In this thesis we prove results about reservoir computers trained on deterministic dynamical systems, and…

Dynamical Systems · Mathematics 2021-12-28 Allen G Hart

Echo state networks are computationally lightweight reservoir models inspired by the random projections observed in cortical circuitry. As interest in reservoir computing has grown, networks have become deeper and more intricate. While…

Signal Processing · Electrical Eng. & Systems 2019-08-23 Zachariah Carmichael , Humza Syed , Dhireesha Kudithipudi

Reservoir computing (RC) is a novel approach to time series prediction using recurrent neural networks. In RC, an input signal perturbs the intrinsic dynamics of a medium called a reservoir. A readout layer is then trained to reconstruct a…

Neural and Evolutionary Computing · Computer Science 2014-01-13 Alireza Goudarzi , Peter Banda , Matthew R. Lakin , Christof Teuscher , Darko Stefanovic

Background/introduction: Cross-Validation (CV) is still uncommon in time series modeling. Echo State Networks (ESNs), as a prime example of Reservoir Computing (RC) models, are known for their fast and precise one-shot learning, that often…

Machine Learning · Computer Science 2021-03-05 Mantas Lukoševičius , Arnas Uselis

Echo State Networks (ESN) are a class of Recurrent Neural Networks (RNN) that has gained substantial popularity due to their effectiveness, ease of use and potential for compact hardware implementation. An ESN contains the three network…

Machine Learning · Computer Science 2018-07-26 Luca Carcano , Emanuele Plebani , Danilo Pietro Pau , Marco Piastra

Echo State Networks (ESNs) are time-series processing models working under the Echo State Property (ESP) principle. The ESP is a notion of stability that imposes an asymptotic fading of the memory of the input. On the other hand, the…

Machine Learning · Computer Science 2023-09-06 Andrea Ceni , Claudio Gallicchio

Macroeconomic forecasting has recently started embracing techniques that can deal with large-scale datasets and series with unequal release periods. MIxed-DAta Sampling (MIDAS) and Dynamic Factor Models (DFM) are the two main…

Reservoir Computing (RC) refers to a Recurrent Neural Networks (RNNs) framework, frequently used for sequence learning and time series prediction. The RC system consists of a random fixed-weight RNN (the input-hidden reservoir layer) and a…

Machine Learning · Computer Science 2017-06-27 M. Andrecut

We propose an innovative design for an optical Echo State Network (ESN), an advanced type of reservoir computer known for its universal computational capabilities. Our design enables an optical implementation of arbitrary ESNs, featuring…

Optics · Physics 2025-11-17 Ishwar S Kaushik , Peter J Ehlers , Daniel Soh

We investigate the ability of an ensemble reservoir computing approach to predict the long-term behaviour of the phase-space region in which the motion of charged particles in hadron storage rings is bounded, the so-called dynamic aperture.…

Accelerator Physics · Physics 2023-01-18 Maxime Casanova , Barbara Dalena , Luca Bonaventura , Massimo Giovannozzi

Prediction based on Irregularly Sampled Time Series (ISTS) is of wide concern in the real-world applications. For more accurate prediction, the methods had better grasp more data characteristics. Different from ordinary time series, ISTS is…

Machine Learning · Computer Science 2021-05-04 Chenxi Sun , Shenda Hong , Moxian Song , Yanxiu Zhou , Yongyue Sun , Derun Cai , Hongyan Li

Neuro-inspired recurrent neural network algorithms, such as echo state networks, are computationally lightweight and thereby map well onto untethered devices. The baseline echo state network algorithms are shown to be efficient in solving…

Machine Learning · Computer Science 2019-03-27 Zachariah Carmichael , Humza Syed , Stuart Burtner , Dhireesha Kudithipudi

The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo state network (ESN) is a class of recurrent neural networks…

Machine Learning · Computer Science 2025-03-04 Abdullah M. Zyarah , Alaa M. Abdul-Hadi , Dhireesha Kudithipudi

Deep Echo State Networks (DeepESNs) recently extended the applicability of Reservoir Computing (RC) methods towards the field of deep learning. In this paper we study the impact of constrained reservoir topologies in the architectural…

Machine Learning · Computer Science 2019-09-25 Claudio Gallicchio , Alessio Micheli

Reservoir computing (RC) offers efficient temporal data processing with a low training cost by separating recurrent neural networks into a fixed network with recurrent connections and a trainable linear network. The quality of the fixed…

Emerging Technologies · Computer Science 2021-05-17 John Moon , Wei D. Lu

Echo State Networks (ESNs) are typically presented as efficient, readout-trained recurrent models, yet their dynamics and design are often guided by heuristics rather than first principles. We recast ESNs explicitly as state-space models…

Machine Learning · Computer Science 2025-09-05 Pradeep Singh , Balasubramanian Raman

Over the last decade, deep-learning methods have been gradually incorporated into conventional automatic speech recognition (ASR) frameworks to create acoustic, pronunciation, and language models. Although it led to significant improvements…

Sound · Computer Science 2022-05-26 Zohreh Ansari , Farzin Pourhoseini , Fatemeh Hadaeghi

Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic…

Machine Learning · Computer Science 2024-10-29 Gang Dang , Dianhui Wang