English
Related papers

Related papers: Recurrent Stochastic Configuration Networks for Te…

200 papers

Echo state networks (ESN), a type of reservoir computing (RC) architecture, are efficient and accurate artificial neural systems for time series processing and learning. An ESN consists of a core of recurrent neural networks, called a…

Neural and Evolutionary Computing · Computer Science 2015-04-28 Alireza Goudarzi , Alireza Shabani , Darko Stefanovic

Recurrent Neural Networks (RNNs) have demonstrated their outstanding ability in sequence tasks and have achieved state-of-the-art in wide range of applications, such as industrial, medical, economic and linguistic. Echo State Network (ESN)…

Machine Learning · Computer Science 2020-12-08 Chenxi Sun , Moxian Song , Shenda Hong , Hongyan Li

Echo state networks (ESNs) are a powerful form of reservoir computing that only require training of linear output weights whilst the internal reservoir is formed of fixed randomly connected neurons. With a correctly scaled connectivity…

Machine Learning · Computer Science 2021-08-03 Luca Manneschi , Matthew O. A. Ellis , Guido Gigante , Andrew C. Lin , Paolo Del Giudice , Eleni Vasilaki

In this paper, we present a recurrent neural system named Long Short-term Cognitive Networks (LSTCNs) as a generalization of the Short-term Cognitive Network (STCN) model. Such a generalization is motivated by the difficulty of forecasting…

Machine Learning · Computer Science 2021-09-20 Gonzalo Nápoles , Isel Grau , Agnieszka Jastrzebska , Yamisleydi Salgueiro

It is a widely accepted fact that data representations intervene noticeably in machine learning tools. The more they are well defined the better the performance results are. Feature extraction-based methods such as autoencoders are…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

The goal of this paper is to investigate the theoretical properties, the training algorithm, and the predictive control applications of Echo State Networks (ESNs), a particular kind of Recurrent Neural Networks. First, a condition…

Systems and Control · Computer Science 2019-02-06 Luca Bugliari Armenio , Enrico Terzi , Marcello Farina , Riccardo Scattolini

The key component in forecasting demand and consumption of resources in a supply network is an accurate prediction of real-valued time series. Indeed, both service interruptions and resource waste can be reduced with the implementation of…

Neural and Evolutionary Computing · Computer Science 2018-07-24 Filippo Maria Bianchi , Enrico Maiorino , Michael C. Kampffmeyer , Antonello Rizzi , Robert Jenssen

Echo State Networks (ESNs) are a special type of the temporally deep network model, the Recurrent Neural Network (RNN), where the recurrent matrix is carefully designed and both the recurrent and input matrices are fixed. An ESN uses the…

Machine Learning · Computer Science 2013-11-14 Hamid Palangi , Li Deng , Rabab K Ward

The Echo State Network (ESN) is a class of Recurrent Neural Network with a large number of hidden-hidden weights (in the so-called reservoir). Canonical ESN and its variations have recently received significant attention due to their…

Neural and Evolutionary Computing · Computer Science 2022-09-30 Sebastian Basterrech , Gerardo Rubino

As a surrogate for computationally intensive meso-scale simulation of woven composites, this article presents Recurrent Neural Network (RNN) models. Leveraging the power of transfer learning, the initialization challenges and sparse data…

Materials Science · Physics 2024-07-08 Ehsan Ghane , Martin Fagerström , Mohsen Mirkhalaf

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

Statistical Mechanics · Physics 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

Echo State Networks (ESN) are a class of Recurrent Neural Networks (RNN) that has gained substantial popularity due to their effectiveness, ease of use and potential for compact hardware implementation. An ESN contains the three network…

Machine Learning · Computer Science 2018-07-26 Luca Carcano , Emanuele Plebani , Danilo Pietro Pau , Marco Piastra

Temporal models based on recurrent neural networks have proven to be quite powerful in a wide variety of applications. However, training these models often relies on back-propagation through time, which entails unfolding the network over…

Neural and Evolutionary Computing · Computer Science 2019-08-13 Alexander Ororbia , Ankur Mali , C. Lee Giles , Daniel Kifer

Spatio-temporal data and processes are prevalent across a wide variety of scientific disciplines. These processes are often characterized by nonlinear time dynamics that include interactions across multiple scales of spatial and temporal…

Machine Learning · Statistics 2017-08-18 Patrick L. McDermott , Christopher K. Wikle

This paper presents a novel approach to advancing artificial intelligence (AI) through the development of the Complex Recurrent Spectral Network ($\mathbb{C}$-RSN), an innovative variant of the Recurrent Spectral Network (RSN) model. The…

Machine Learning · Computer Science 2023-12-13 Lorenzo Chicchi , Lorenzo Giambagli , Lorenzo Buffoni , Raffaele Marino , Duccio Fanelli

Echo-State Networks (ESNs) distil a key neurobiological insight: richly recurrent but fixed circuitry combined with adaptive linear read-outs can transform temporal streams with remarkable efficiency. Yet fundamental questions about…

Neural and Evolutionary Computing · Computer Science 2025-07-25 Pradeep Singh , Lavanya Sankaranarayanan , Balasubramanian Raman

Despite the superiority of convolutional neural networks demonstrated in time series modeling and forecasting, it has not been fully explored on the design of the neural network architecture and the tuning of the hyper-parameters. Inspired…

Machine Learning · Computer Science 2022-02-14 Xinze Zhang , Kun He , Yukun Bao

Stochastic configuration networks (SCNs) as a class of randomized learner model have been successfully employed in data analytics due to its universal approximation capability and fast modelling property. The technical essence lies in…

Machine Learning · Computer Science 2018-09-07 Ming Li , Dianhui Wang

As an efficient recurrent neural network (RNN) model, reservoir computing (RC) models, such as Echo State Networks, have attracted widespread attention in the last decade. However, while they have had great success with time series data…

Machine Learning · Computer Science 2017-11-16 Qianli Ma , Lifeng Shen , Garrison W. Cottrell

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio