English
Related papers

Related papers: RcTorch: a PyTorch Reservoir Computing Package wit…

200 papers

Reservoir computing (RC) can efficiently process time-series data by transferring the input signal to randomly connected recurrent neural networks (RNNs), which are referred to as a reservoir. The high-dimensional representation of…

Machine Learning · Computer Science 2023-01-24 Yusuke Sakemi , Sou Nobukawa , Toshitaka Matsuki , Takashi Morie , Kazuyuki Aihara

Reservoir Computing (RC) is a simple and efficient model-free framework for forecasting the behavior of nonlinear dynamical systems from data. Here, we show that there exist commonly-studied systems for which leading RC frameworks struggle…

Machine Learning · Computer Science 2023-09-27 Yuanzhao Zhang , Sean P. Cornelius

Recurrent neural networks (RNNs) are known to be universal approximators of dynamic systems under fairly mild and general assumptions. However, RNNs usually suffer from the issues of vanishing and exploding gradients in standard RNN…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Shashank Jere , Lizhong Zheng , Karim Said , Lingjia Liu

For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network…

Neural and Evolutionary Computing · Computer Science 2022-11-14 Sebastián Basterrech , Tarun Kumar Sharma

Physical Reservoir Computing (PRC) is a recently developed variant of Neuromorphic Computing, where a pertinent physical system effectively projects information encoded in the input signal into a higher-dimensional space. While various…

Reservoir computers (RC) are a form of recurrent neural network (RNN) used for forecasting timeseries data. As with all RNNs, selecting the hyperparameters presents a challenge when training onnew inputs. We present a method based on…

Computational Physics · Physics 2022-01-05 Jason A. Platt , Adrian S. Wong , Randall Clark , Stephen G. Penny , Henry D. I. Abarbanel

Reservoir computing (RC) is a novel approach to time series prediction using recurrent neural networks. In RC, an input signal perturbs the intrinsic dynamics of a medium called a reservoir. A readout layer is then trained to reconstruct a…

Neural and Evolutionary Computing · Computer Science 2014-01-13 Alireza Goudarzi , Peter Banda , Matthew R. Lakin , Christof Teuscher , Darko Stefanovic

Reservoir computing is a best-in-class machine learning algorithm for processing information generated by dynamical systems using observed time-series data. Importantly, it requires very small training data sets, uses linear optimization,…

Machine Learning · Computer Science 2021-09-22 Daniel J. Gauthier , Erik Bollt , Aaron Griffith , Wendson A. S. Barbosa

Reservoir computing (RC) is an emerging recurrent neural network architecture that has attracted growing attention for its low training cost and modest hardware requirements. Memristor-based circuits are particularly promising for RC, as…

Neural and Evolutionary Computing · Computer Science 2026-04-24 Rishona Daniels , Duna Wattad , Ronny Ronen , David Saad , Shahar Kvatinsky

Reservoir Computing (RC) has become popular in recent years thanks to its fast and efficient computational capabilities. Standard RC has been shown to be equivalent in the asymptotic limit to Recurrent Kernels, which helps in analyzing its…

Machine Learning · Computer Science 2024-10-07 Giuseppe Alessio D'Inverno , Jonathan Dong

This paper presents the design, implementation, and evaluation of the PyTorch distributed data parallel module. PyTorch is a widely-adopted scientific computing package used in deep learning research and applications. Recent advances in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-30 Shen Li , Yanli Zhao , Rohan Varma , Omkar Salpekar , Pieter Noordhuis , Teng Li , Adam Paszke , Jeff Smith , Brian Vaughan , Pritam Damania , Soumith Chintala

Classification of multivariate time series (MTS) has been tackled with a large variety of methodologies and applied to a wide range of scenarios. Reservoir Computing (RC) provides efficient tools to generate a vectorial, fixed-size…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Filippo Maria Bianchi , Simone Scardapane , Sigurd Løkse , Robert Jenssen

Recent developments in quantum computing and machine learning have propelled the interdisciplinary study of quantum machine learning. Sequential modeling is an important task with high scientific and commercial value. Existing VQC or…

Neural and Evolutionary Computing · Computer Science 2022-11-07 Samuel Yen-Chi Chen , Daniel Fry , Amol Deshmukh , Vladimir Rastunkov , Charlee Stefanski

In this work, we present a general purpose deep neural network package for representing energies, forces, dipole moments, and polarizabilities of atomistic systems. This so-called recursively embedded atom neural network model takes both…

Chemical Physics · Physics 2022-04-06 Yaolong Zhang , Junfan Xia , Bin Jiang

We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Pantelis R. Vlachas , Jaideep Pathak , Brian R. Hunt , Themistoklis P. Sapsis , Michelle Girvan , Edward Ott , Petros Koumoutsakos

Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a "next-generation"…

Machine Learning · Computer Science 2023-03-28 Sarah E. Marzen , Paul M. Riechers , James P. Crutchfield

Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing…

Machine learning applications are computationally demanding and power intensive. Hardware acceleration of these software tools is a natural step being explored using various technologies. A recurrent processing unit (RPU) is fast and…

Emerging Technologies · Computer Science 2019-12-17 Heidi Komkov , Alessandro Restelli , Brian Hunt , Liam Shaughnessy , Itamar Shani , Daniel P. Lathrop

Reservoir computing (RC), a particular form of recurrent neural network, is under explosive development due to its exceptional efficacy and high performance in reconstruction or/and prediction of complex physical systems. However, the…

Machine Learning · Computer Science 2023-05-10 Xing-Yue Duan , Xiong Ying , Si-Yang Leng , Jürgen Kurths , Wei Lin , Huan-Fei Ma

OpenReservoirComputing (ORC) is a Python library for reservoir computing (RC) written in JAX (Bradbury et al. 2018) and Equinox (Kidger and Garcia 2021). JAX is a Python library for high-performance numerical computing that enables…

Machine Learning · Computer Science 2026-03-17 Jan Williams , Dima Tretiak , Steven L. Brunton , J. Nathan Kutz , Krithika Manohar