English
Related papers

Related papers: Tailoring Artificial Neural Networks for Optimal L…

200 papers

Reservoir computing is a recent trend in neural networks which uses the dynamical perturbations on the phase space of a system to compute a desired target function. We present how one can formulate an expectation of system performance in a…

Neural and Evolutionary Computing · Computer Science 2014-09-02 Alireza Goudarzi , Darko Stefanovic

In many real-world applications, fully-differentiable RNNs such as LSTMs and GRUs have been widely deployed to solve time series learning tasks. These networks train via Backpropagation Through Time, which can work well in practice but…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Matthew Evanusa , Snehesh Shrestha , Michelle Girvan , Cornelia Fermüller , Yiannis Aloimonos

Reservoir Computing (RC) is a popular methodology for the efficient design of Recurrent Neural Networks (RNNs). Recently, the advantages of the RC approach have been extended to the context of multi-layered RNNs, with the introduction of…

Machine Learning · Computer Science 2019-09-25 Claudio Gallicchio , Alessio Micheli

Echo State Networks (ESNs) are a reservoir computing framework widely used for nonlinear time-series prediction. However, despite their effectiveness, randomly initialized reservoirs often contain redundant nodes, leading to unnecessary…

Machine Learning · Computer Science 2026-05-07 Sudip Laudari

Supralinear and sublinear pre-synaptic and dendritic integration is considered to be responsible for nonlinear computation power of biological neurons, emphasizing the role of nonlinear integration as opposed to nonlinear output…

Neural and Evolutionary Computing · Computer Science 2015-04-28 Alireza Goudarzi , Alireza Shabani , Darko Stefanovic

Echo State Networks (ESNs) are widely-used Recurrent Neural Networks. They are dynamical systems including, in state-space form, a nonlinear state equation and a linear output transformation. The common procedure to train ESNs is to…

Systems and Control · Electrical Eng. & Systems 2019-12-05 Luca Bugliari Armenio , Lorenzo Fagiano , Enrico Terzi , Marcello Farina , Riccardo Scattolini

Echo state networks (ESNs) are a class of recurrent neural networks in which only the readout layer is trainable, while the recurrent and input layers are fixed. This architectural constraint enables computationally efficient processing of…

Machine Learning · Computer Science 2025-07-31 Taiki Yamada , Yuichi Katori , Kantaro Fujiwara

Echo State Networks (ESNs) are a class of single layer recurrent neural networks that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a series of measurements of an invertible dynamical system, induces…

Chaotic Dynamics · Physics 2020-05-19 Allen G Hart , James L Hook , Jonathan H P Dawes

Echo State Networks (ESN) are versatile recurrent neural network models in which the hidden layer remains unaltered during training. Interactions among nodes of this static backbone produce diverse representations of the given stimuli that…

Machine Learning · Computer Science 2022-05-25 Kayson Fakhar , Fatemeh Hadaeghi , Claus C. Hilgetag

We investigate the ability of an ensemble reservoir computing approach to predict the long-term behaviour of the phase-space region in which the motion of charged particles in hadron storage rings is bounded, the so-called dynamic aperture.…

Accelerator Physics · Physics 2023-01-18 Maxime Casanova , Barbara Dalena , Luca Bonaventura , Massimo Giovannozzi

Echo State Networks (ESNs) are a special type of the temporally deep network model, the Recurrent Neural Network (RNN), where the recurrent matrix is carefully designed and both the recurrent and input matrices are fixed. An ESN uses the…

Machine Learning · Computer Science 2013-11-14 Hamid Palangi , Li Deng , Rabab K Ward

Machine learning has become a widely popular and successful paradigm, including in data-driven science and engineering. A major application problem is data-driven forecasting of future states from a complex dynamical. Artificial neural…

Data Analysis, Statistics and Probability · Physics 2021-03-19 Erik Bollt

For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network…

Neural and Evolutionary Computing · Computer Science 2022-11-14 Sebastián Basterrech , Tarun Kumar Sharma

Reservoir computing (RC) is a novel approach to time series prediction using recurrent neural networks. In RC, an input signal perturbs the intrinsic dynamics of a medium called a reservoir. A readout layer is then trained to reconstruct a…

Neural and Evolutionary Computing · Computer Science 2014-01-13 Alireza Goudarzi , Peter Banda , Matthew R. Lakin , Christof Teuscher , Darko Stefanovic

Artificial neural networks (ANNs) are known to be powerful methods for many hard problems (e.g. image classification, speech recognition or time series prediction). However, these models tend to produce black-box results and are often…

Machine Learning · Computer Science 2022-11-17 Marco Landt-Hayen , Peer Kröger , Martin Claus , Willi Rath

A particular case of Recurrent Neural Network (RNN) was introduced at the beginning of the 2000s under the name of Echo State Networks (ESNs). The ESN model overcomes the limitations during the training of the RNNs while introducing no…

Machine Learning · Computer Science 2015-01-06 Sebastián Basterrech

The echo state network (ESN) is a special type of recurrent neural networks for processing the time-series dataset. However, limited by the strong correlation among sequential samples of the agent, ESN-based policy control algorithms are…

Machine Learning · Computer Science 2022-01-14 Chunyuan Zhang , Chao Liu , Qi Song , Jie Zhao

Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of…

Machine Learning · Computer Science 2022-05-11 Peter Steiner , Azarakhsh Jalalvand , Peter Birkholz

Recent advancements in artificial neural networks have enabled impressive tasks on classical computers, but they demand significant computational resources. While quantum computing offers potential beyond classical systems, the advantages…

Quantum Physics · Physics 2024-12-12 Erik Connerty , Ethan Evans , Gerasimos Angelatos , Vignesh Narayanan

Deep learning has seen a rapid adoption in a variety of wireless communications applications, including at the physical layer. While it has delivered impressive performance in tasks such as channel equalization and receive processing/symbol…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Shashank Jere , Karim Said , Lizhong Zheng , Lingjia Liu