English
Related papers

Related papers: Scaling up Echo-State Networks with multiple light…

200 papers

Deep neural networks have achieved remarkable breakthroughs by leveraging multiple layers of data processing to extract hidden representations, albeit at the cost of large electronic computing power. To enhance energy efficiency and speed,…

Echo State Networks are efficient time-series predictors, which highly depend on the value of the spectral radius of the reservoir connectivity matrix. Based on recent results on the mean field theory of driven random recurrent neural…

Chaotic Dynamics · Physics 2015-05-26 Mathieu Galtier , Gilles Wainrib

An approach to the time-accurate prediction of chaotic solutions is by learning temporal patterns from data. Echo State Networks (ESNs), which are a class of Reservoir Computing, can accurately predict the chaotic dynamics well beyond the…

Machine Learning · Computer Science 2021-03-16 Alberto Racca , Luca Magri

Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a "next-generation"…

Machine Learning · Computer Science 2023-03-28 Sarah E. Marzen , Paul M. Riechers , James P. Crutchfield

The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo state network (ESN) is a class of recurrent neural networks…

Machine Learning · Computer Science 2025-03-04 Abdullah M. Zyarah , Alaa M. Abdul-Hadi , Dhireesha Kudithipudi

Reservoir computing systems, a class of recurrent neural networks, have recently been exploited for model-free, data-based prediction of the state evolution of a variety of chaotic dynamical systems. The prediction horizon demonstrated has…

Machine Learning · Computer Science 2020-04-06 Huawei Fan , Junjie Jiang , Chun Zhang , Xingang Wang , Ying-Cheng Lai

Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input…

Emerging Technologies · Computer Science 2012-07-06 Yvan Paquot , François Duport , Anteo Smerieri , Joni Dambre , Benjamin Schrauwen , Marc Haelterman , Serge Massar

This work introduces a tensor-based method to perform supervised classification on spatiotemporal data processed in an echo state network. Typically when performing supervised classification tasks on data processed in an echo state network,…

Machine Learning · Computer Science 2017-08-25 Ashley Prater

This paper introduces the NK Echo State Network. The problem of learning in the NK Echo State Network is reduced to the problem of optimizing a special form of a Spin Glass Problem known as an NK Landscape. No weight adjustment is used; all…

Neural and Evolutionary Computing · Computer Science 2015-05-11 Darrell Whitley , Renato Tinós , Francisco Chicano

Echo State Networks (ESNs) are simplified recurrent neural network models composed of a reservoir and a linear, trainable readout layer. The reservoir is tunable by some hyper-parameters that control the network behaviour. ESNs are known to…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Pietro Verzelli , Lorenzo Livi , Cesare Alippi

As one of the most important paradigms of recurrent neural networks, the echo state network (ESN) has been applied to a wide range of fields, from robotics to medicine, finance, and language processing. A key feature of the ESN paradigm is…

Machine Learning · Computer Science 2020-02-26 Pau Vilimelis Aceituno , Yan Gang , Yang-Yu Liu

Artificial neural networks (ANNs) are known to be powerful methods for many hard problems (e.g. image classification, speech recognition or time series prediction). However, these models tend to produce black-box results and are often…

Machine Learning · Computer Science 2022-11-17 Marco Landt-Hayen , Peer Kröger , Martin Claus , Willi Rath

Recurrent Neural Networks (RNNs) have been a prominent concept within artificial intelligence. They are inspired by Biological Neural Networks (BNNs) and provide an intuitive and abstract representation of how BNNs work. Derived from the…

Neural and Evolutionary Computing · Computer Science 2017-03-09 Stefano Nichele , Andreas Molund

Reservoir Computing (RC) is a popular methodology for the efficient design of Recurrent Neural Networks (RNNs). Recently, the advantages of the RC approach have been extended to the context of multi-layered RNNs, with the introduction of…

Machine Learning · Computer Science 2019-09-25 Claudio Gallicchio , Alessio Micheli

In the last decade, a new computational paradigm was introduced in the field of Machine Learning, under the name of Reservoir Computing (RC). RC models are neural networks which a recurrent part (the reservoir) that does not participate in…

Neural and Evolutionary Computing · Computer Science 2013-04-08 Sebastián Basterrech , Gerardo Rubino

The paper introduces concentric Echo State Network, an approach to design reservoir topologies that tries to bridge the gap between deterministically constructed simple cycle models and deep reservoir computing approaches. We show how to…

Neural and Evolutionary Computing · Computer Science 2018-05-24 Davide Bacciu , Andrea Bongiorno

Reservoir computing (RC) is a novel approach to time series prediction using recurrent neural networks. In RC, an input signal perturbs the intrinsic dynamics of a medium called a reservoir. A readout layer is then trained to reconstruct a…

Neural and Evolutionary Computing · Computer Science 2014-01-13 Alireza Goudarzi , Peter Banda , Matthew R. Lakin , Christof Teuscher , Darko Stefanovic

The operating point of a power system may change due to slow enough variations of the power injections. Rotating machines in the bulk system can absorb smooth changes in the dynamic states of the system. In this context, we present a novel…

Optimization and Control · Mathematics 2024-01-22 Gabriel Intriago , Holger Cevallos , Yu Zhang

The study of deep recurrent neural networks (RNNs) and, in particular, of deep Reservoir Computing (RC) is gaining an increasing research attention in the neural networks community. The recently introduced Deep Echo State Network (DeepESN)…

Machine Learning · Computer Science 2020-09-28 Claudio Gallicchio , Alessio Micheli

Heterogeneous materials such as biological tissue scatter light in random, yet deterministic, ways. Wavefront shaping can reverse the effects of scattering to enable deep-tissue microscopy. Such methods require either invasive access to the…

Computational Physics · Physics 2024-08-12 Laurynas Valantinas , Tom Vettenburg