English
Related papers

Related papers: Echo State network for coarsening dynamics of char…

200 papers

Reservoir Computing has found many potential applications in the field of complex dynamics. In this article, we exploit the exceptional capability of the echo-state network (ESN) model to make it learn a unidirectional coupling scheme from…

Machine Learning · Computer Science 2023-06-21 Swarnendu Mandal , Manish Dev Shrimali

Continual Learning (CL) refers to a learning setup where data is non stationary and the model has to learn without forgetting existing knowledge. The study of CL for sequential patterns revolves around trained recurrent networks. In this…

Machine Learning · Computer Science 2021-08-18 Andrea Cossu , Davide Bacciu , Antonio Carta , Claudio Gallicchio , Vincenzo Lomonaco

Echo State Networks (ESNs) are widely-used Recurrent Neural Networks. They are dynamical systems including, in state-space form, a nonlinear state equation and a linear output transformation. The common procedure to train ESNs is to…

Systems and Control · Electrical Eng. & Systems 2019-12-05 Luca Bugliari Armenio , Lorenzo Fagiano , Enrico Terzi , Marcello Farina , Riccardo Scattolini

Echo state network (ESN), a kind of recurrent neural networks, consists of a fixed reservoir in which neurons are connected randomly and recursively and obtains the desired output only by training output connection weights. First-order…

Machine Learning · Computer Science 2024-01-22 Yansong Li , Kai Hu , Kohei Nakajima , Yongping Pan

Echo state networks are a recently developed type of recurrent neural network where the internal layer is fixed with random weights, and only the output layer is trained on specific data. Echo state networks are increasingly being used to…

Neural and Evolutionary Computing · Computer Science 2018-02-06 Ashley Prater

A particular case of Recurrent Neural Network (RNN) was introduced at the beginning of the 2000s under the name of Echo State Networks (ESNs). The ESN model overcomes the limitations during the training of the RNNs while introducing no…

Machine Learning · Computer Science 2015-01-06 Sebastián Basterrech

Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of…

Machine Learning · Computer Science 2022-05-11 Peter Steiner , Azarakhsh Jalalvand , Peter Birkholz

Artificial neural networks (ANNs) are known to be powerful methods for many hard problems (e.g. image classification, speech recognition or time series prediction). However, these models tend to produce black-box results and are often…

Machine Learning · Computer Science 2022-11-17 Marco Landt-Hayen , Peer Kröger , Martin Claus , Willi Rath

Deep learning has seen a rapid adoption in a variety of wireless communications applications, including at the physical layer. While it has delivered impressive performance in tasks such as channel equalization and receive processing/symbol…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Shashank Jere , Karim Said , Lizhong Zheng , Lingjia Liu

Background/introduction: Cross-Validation (CV) is still uncommon in time series modeling. Echo State Networks (ESNs), as a prime example of Reservoir Computing (RC) models, are known for their fast and precise one-shot learning, that often…

Machine Learning · Computer Science 2021-03-05 Mantas Lukoševičius , Arnas Uselis

This paper explores the problem of training a recurrent neural network from noisy data. While neural network based dynamic predictors perform well with noise-free training data, prediction with noisy inputs during training phase poses a…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Debdipta Goswami

The Echo State Network (ESN) is a specific recurrent network, which has gained popularity during the last years. The model has a recurrent network named reservoir, that is fixed during the learning process. The reservoir is used for…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Sebastián Basterrech

Modeling the dynamics of the formation and evolution of protostellar disks as well as the history of stellar mass accretion typically involve the numerical solution of complex systems of coupled differential equations. The resulting mass…

Solar and Stellar Astrophysics · Physics 2023-04-18 Gianfranco Bino , Shantanu Basu , Ramit Dey , Sayantan Auddy , Lyle Muller , Eduard I. Vorobyov

In the last decade, a new computational paradigm was introduced in the field of Machine Learning, under the name of Reservoir Computing (RC). RC models are neural networks which a recurrent part (the reservoir) that does not participate in…

Neural and Evolutionary Computing · Computer Science 2013-04-08 Sebastián Basterrech , Gerardo Rubino

This paper investigates the performance of Echo State Networks (ESNs) for univariate time series forecasting using a subset of the M4 Forecasting Competition dataset. Focusing on monthly and quarterly time series, we evaluate whether a…

Machine Learning · Computer Science 2026-04-08 Alexander Häußer

Echo state networks are computationally lightweight reservoir models inspired by the random projections observed in cortical circuitry. As interest in reservoir computing has grown, networks have become deeper and more intricate. While…

Signal Processing · Electrical Eng. & Systems 2019-08-23 Zachariah Carmichael , Humza Syed , Dhireesha Kudithipudi

Echo state network (ESN) is viewed as a temporal non-orthogonal expansion with pseudo-random parameters. Such expansions naturally give rise to regressors of various relevance to a teacher output. We illustrate that often only a certain…

Machine Learning · Statistics 2012-07-03 Ján Dolinský , Kei Hirose , Sadanori Konishi

In this study, we propose a novel approach, namely the combined Convolutional Deep Autoencoder Echo State Network (CDAE ESN) model, for the analysis and forecasting of dynamics and low order statistics in coupled turbulent channel porous…

Fluid Dynamics · Physics 2023-12-06 Xu Chu , Sandeep Pandey , Yanchao Liu , Bernhard Weigand

Echo-State Networks and Reservoir Computing have been studied for more than a decade. They provide a simpler yet powerful alternative to Recurrent Neural Networks, every internal weight is fixed and only the last linear layer is trained.…

Emerging Technologies · Computer Science 2018-09-25 Jonathan Dong , Sylvain Gigan , Florent Krzakala , Gilles Wainrib

In this paper, the problem of proactive caching is studied for cloud radio access networks (CRANs). In the studied model, the baseband units (BBUs) can predict the content request distribution and mobility pattern of each user, determine…

Information Theory · Computer Science 2017-04-04 Mingzhe Chen , Walid Saad , Changchuan Yin , Mérouane Debbah