English
Related papers

Related papers: Performance boost of time-delay reservoir computin…

200 papers

An information engine based on a two level system in contact with a thermal reservoir is studied analytically. The model incorporates delay time between the measurement of the state of the system and the feedback. The engine efficiency and…

Statistical Mechanics · Physics 2023-12-27 Kiran V , Toby Joseph

Nonlinear photonic delay systems present interesting implementation platforms for machine learning models. They can be extremely fast, offer great degrees of parallelism and potentially consume far less power than digital processors. So far…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Michiel Hermans , Miguel Soriano , Joni Dambre , Peter Bienstman , Ingo Fischer

A reservoir computer (RC) is a type of simplified recurrent neural network architecture that has demonstrated success in the prediction of spatiotemporally chaotic dynamical systems. A further advantage of RC is that it reproduces intrinsic…

Neural and Evolutionary Computing · Computer Science 2022-01-25 Jason A. Platt , Stephen G. Penny , Timothy A. Smith , Tse-Chun Chen , Henry D. I. Abarbanel

This paper investigates in detail the effects of noise on the performance of reservoir computing. We focus on an application in which reservoir computers are used to learn the relationship between different state variables of a chaotic…

Neural and Evolutionary Computing · Computer Science 2023-05-10 Chad Nathe , Chandra Pappu , Nicholas A. Mecholsky , Joseph D. Hart , Thomas Carroll , Francesco Sorrentino

We present a systematic approach to reveal the correspondence between time delay dynamics and networks of coupled oscillators. After early demonstrations of the usefulness of spatio-temporal representations of time-delay system dynamics,…

Adaptation and Self-Organizing Systems · Physics 2023-04-17 Joseph D. Hart , Laurent Larger , Thomas E. Murphy , Rajarshi Roy

The production process of integrated electronic circuitry inherently leads to large heterogeneities on the component level. For electronic clock networks this implies detuned intrinsic frequencies and differences in coupling strength and…

Adaptation and Self-Organizing Systems · Physics 2019-09-04 Nirmal Punetha , Lucas Wetzel

Machine learning approaches have recently been leveraged as a substitute or an aid for physical/mathematical modeling approaches to dynamical systems. To develop an efficient machine learning method dedicated to modeling and prediction of…

Machine Learning · Computer Science 2022-08-01 Gouhei Tanaka , Tadayoshi Matsumori , Hiroaki Yoshida , Kazuyuki Aihara

Reservoir computing, a recurrent neural network paradigm in which only the output layer is trained, has demonstrated remarkable performance on tasks such as prediction and control of nonlinear systems. Recently, it was demonstrated that…

Machine Learning · Computer Science 2023-04-27 Joseph D. Hart , Francesco Sorrentino , Thomas L. Carroll

We demonstrate that transformers obtain impressive performance even when some of the layers are randomly initialized and never updated. Inspired by old and well-established ideas in machine learning, we explore a variety of non-linear…

Computation and Language · Computer Science 2021-06-03 Sheng Shen , Alexei Baevski , Ari S. Morcos , Kurt Keutzer , Michael Auli , Douwe Kiela

We study the impact of competing time delays in coupled stochastic synchronization and coordination problems. We consider two types of delays: transmission delays between interacting elements and processing, cognitive, or execution delays…

Statistical Mechanics · Physics 2011-01-12 D. Hunt , G. Korniss , B. K. Szymanski

This paper extends the notion of information processing capacity for non-independent input signals in the context of reservoir computing (RC). The presence of input autocorrelation makes worthwhile the treatment of forecasting and filtering…

Emerging Technologies · Computer Science 2015-10-08 Lyudmila Grigoryeva , Julie Henriques , Juan-Pablo Ortega

The authors demonstrate the use of a propagating spin waves for implementing a reservoir computing architecture. The proposed concept utilises an active ring resonator comprising a magnetic thin film delay line integrated into a feedback…

Applied Physics · Physics 2020-04-01 Stuart Watt , Mikhail Kostylev

Molecular communication is set to play an important role in the design of complex biological and chemical systems. An important class of molecular communication systems is based on the timing channel, where information is encoded in the…

Information Theory · Computer Science 2014-10-22 Malcolm Egan , Yansha Deng , Maged Elkashlan , Trung Q. Duong

Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input…

Emerging Technologies · Computer Science 2012-07-06 Yvan Paquot , François Duport , Anteo Smerieri , Joni Dambre , Benjamin Schrauwen , Marc Haelterman , Serge Massar

The reservoir computing scheme is a machine learning mechanism which utilizes the naturally occuring computational capabilities of dynamical systems. One important subset of systems that has proven powerful both in experiments and theory…

Neural and Evolutionary Computing · Computer Science 2021-08-09 André Röhm , Kathy Lüdge

Nonlinear photonic sources including semiconductor lasers have recently been utilized as ideal computation elements for information processing. They supply energy-efficient way and rich dynamics for classification and recognition tasks. In…

Optics · Physics 2023-06-27 T. Wang , C. Jiang , Q. Fang , X. Guo , Y. Zhang , C. Jin , S. Xiang

Reservoir computing is a neural network approach for processing time-dependent signals that has seen rapid development in recent years. Physical implementations of the technique using optical reservoirs have demonstrated remarkable accuracy…

Machine Learning · Computer Science 2019-01-30 Daniel Canaday , Aaron Griffith , Daniel Gauthier

We investigate the computational potential and limitations of a passive linear optical reservoir with a photodetector at the optical-to-electrical interface as the sole source of nonlinearity. In contrast to conventional nonlinear…

Chaotic Dynamics · Physics 2026-05-06 Elias R. Koch , Julien Javaloyes , Svetlana V. Gurevich , Lina Jaurigue

Reservoir computing has emerged as a powerful framework for time series modelling and forecasting including the prediction of discontinuous transitions. However, the mechanism behind its success is not yet fully understood. This letter…

Chaotic Dynamics · Physics 2025-10-16 Dishant Sisodia , Sarika Jalan

We show that connectivity within the high-dimensional recurrent layer of a reservoir network is crucial for its performance. To this end, we systematically investigate the impact of network connectivity on its performance, i.e., we examine…

Neural and Evolutionary Computing · Computer Science 2025-12-01 Shailendra K. Rathor , Martin Ziegler , Jörg Schumacher