English
Related papers

Related papers: Product Reservoir Computing: Time-Series Computati…

200 papers

It is a widely accepted fact that data representations intervene noticeably in machine learning tools. The more they are well defined the better the performance results are. Feature extraction-based methods such as autoencoders are…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

In this paper, we introduce a paradigm for reservoir computing (RC) that leverages a pool of cultured biological neurons as the reservoir substrate, creating a biological reservoir computing (BRC). This system operates similarly to an echo…

Background/introduction: Cross-Validation (CV) is still uncommon in time series modeling. Echo State Networks (ESNs), as a prime example of Reservoir Computing (RC) models, are known for their fast and precise one-shot learning, that often…

Machine Learning · Computer Science 2021-03-05 Mantas Lukoševičius , Arnas Uselis

We propose an approximation of Echo State Networks (ESN) that can be efficiently implemented on digital hardware based on the mathematics of hyperdimensional computing. The reservoir of the proposed integer Echo State Network (intESN) is a…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Denis Kleyko , E. Paxon Frady , Mansour Kheffache , Evgeny Osipov

Model predictive control (MPC) is an industry standard control technique that iteratively solves an open-loop optimization problem to guide a system towards a desired state or trajectory. Consequently, an accurate forward model of system…

Systems and Control · Electrical Eng. & Systems 2024-11-11 Jan P. Williams , J. Nathan Kutz , Krithika Manohar

Reservoir computing (RC), first applied to temporal signal processing, is a recurrent neural network in which neurons are randomly connected. Once initialized, the connection strengths remain unchanged. Such a simple structure turns RC into…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Heng Zhang , Danilo Vasconcellos Vargas

The study of deep recurrent neural networks (RNNs) and, in particular, of deep Reservoir Computing (RC) is gaining an increasing research attention in the neural networks community. The recently introduced Deep Echo State Network (DeepESN)…

Machine Learning · Computer Science 2020-09-28 Claudio Gallicchio , Alessio Micheli

Echo State Networks (ESNs) are simplified recurrent neural network models composed of a reservoir and a linear, trainable readout layer. The reservoir is tunable by some hyper-parameters that control the network behaviour. ESNs are known to…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Pietro Verzelli , Lorenzo Livi , Cesare Alippi

In this paper, the echo state network (ESN) memory capacity, which represents the amount of input data an ESN can store, is analyzed for a new type of deep ESNs. In particular, two deep ESN architectures are studied. First, a parallel deep…

Machine Learning · Computer Science 2019-08-21 Xuanlin Liu , Mingzhe Chen , Changchuan Yin , Walid Saad

Reservoir Computing (RC) has established itself as an efficient paradigm for temporal processing. However, its scalability remains severely constrained by (i) the necessity of processing temporal data sequentially and (ii) the prohibitive…

Machine Learning · Computer Science 2026-02-02 Matteo Pinna , Giacomo Lagomarsini , Andrea Ceni , Claudio Gallicchio

Reservoir computing is a recent trend in neural networks which uses the dynamical perturbations on the phase space of a system to compute a desired target function. We present how one can formulate an expectation of system performance in a…

Neural and Evolutionary Computing · Computer Science 2014-09-02 Alireza Goudarzi , Darko Stefanovic

Temporal data modelling techniques with neural networks are useful in many domain applications, including time-series forecasting and control engineering. This paper aims at developing a recurrent version of stochastic configuration…

Machine Learning · Computer Science 2025-04-03 Dianhui Wang , Gang Dang

In many real-world applications, fully-differentiable RNNs such as LSTMs and GRUs have been widely deployed to solve time series learning tasks. These networks train via Backpropagation Through Time, which can work well in practice but…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Matthew Evanusa , Snehesh Shrestha , Michelle Girvan , Cornelia Fermüller , Yiannis Aloimonos

Inspired by the numerical solution of ordinary differential equations, in this paper we propose a novel Reservoir Computing (RC) model, called the Euler State Network (EuSN). The presented approach makes use of forward Euler discretization…

Machine Learning · Computer Science 2023-03-27 Claudio Gallicchio

In this paper, we elaborate over the well-known interpretability issue in echo state networks. The idea is to investigate the dynamics of reservoir neurons with time-series analysis techniques taken from research on complex systems.…

Data Analysis, Statistics and Probability · Physics 2016-11-21 Filippo Maria Bianchi , Lorenzo Livi , Cesare Alippi

An echo state network (ESN) is a type of reservoir computer that uses a recurrent neural network with a sparsely connected hidden layer. Compared with other recurrent neural networks, one great advantage of ESN is the simplicity of its…

Statistical Mechanics · Physics 2024-12-17 Clement Dinh , Yunhao Fan , Gia-Wei Chern

In the framework of physical reservoir computing (RC), machine learning algorithms designed for digital computers are executed using analog computer-like nonlinear physical systems that can provide energy-efficient computational power for…

Fluid Dynamics · Physics 2022-04-27 Ivan S. Maksymov , Andrey Pototsky , Sergey A. Suslov

At the heart of time-series forecasting (TSF) lies a fundamental challenge: how can models efficiently and effectively capture long-range temporal dependencies across ever-growing sequences? While deep learning has brought notable progress,…

Machine Learning · Computer Science 2025-11-18 Hongbo Liu , Jia Xu

We investigate the ability of an ensemble reservoir computing approach to predict the long-term behaviour of the phase-space region in which the motion of charged particles in hadron storage rings is bounded, the so-called dynamic aperture.…

Accelerator Physics · Physics 2023-01-18 Maxime Casanova , Barbara Dalena , Luca Bonaventura , Massimo Giovannozzi

The prefrontal cortex is known to be involved in many high-level cognitive functions, in particular, working memory. Here, we study to what extent a group of randomly connected units (namely an Echo State Network, ESN) can store and…

Neurons and Cognition · Quantitative Biology 2018-06-19 Anthony Strock , Nicolas Rougier , Xavier Hinaut