English
Related papers

Related papers: Nonlinear Neural Dynamics and Classification Accur…

200 papers

We investigate a phase transition from linear to nonlinear information processing in echo state networks, a widely used framework in reservoir computing. The network consists of randomly connected recurrent nodes perturbed by a noise and…

Disordered Systems and Neural Networks · Physics 2025-11-25 Masaya Matsumura , Taiki Haga

This work studies approximation based on single-hidden-layer feedforward and recurrent neural networks with randomly generated internal weights. These methods, in which only the last layer of weights and a few hyperparameters are optimized,…

Probability · Mathematics 2021-02-17 Lukas Gonon , Lyudmila Grigoryeva , Juan-Pablo Ortega

The Reservoir Computing (RC) framework states that any non-linear, input-driven dynamical system (the reservoir) exhibiting properties such as a fading memory and input separability can be trained to perform computational tasks. This broad…

Emerging Technologies · Computer Science 2019-06-20 Matthew Dale , Julian F. Miller , Susan Stepney , Martin A. Trefzer

Shedding light onto how biological systems represent, process and store information in noisy environments is a key and challenging goal. A stimulating, though controversial, hypothesis poses that operating in dynamical regimes near the edge…

Disordered Systems and Neural Networks · Physics 2021-07-14 Guillermo B. Morales , Miguel A. Muñoz

Reservoir computing with optical devices offers an energy-efficient approach for time-series forecasting. Quantum dot lasers with feedback are modelled in this paper to explore the extent to which increased complexity in the charge carrier…

Computational Physics · Physics 2024-11-05 Huifang Dong , Lina Jaurigue , Kathy Lüdge

We demonstrate reservoir computing with a physical system using a single autonomous Boolean logic element with time-delay feedback. The system generates a chaotic transient with a window of consistency lasting between 30 and 300 ns, which…

Emerging Technologies · Computer Science 2016-02-09 Nicholas D. Haynes , Miguel C. Soriano , David P. Rosin , Ingo Fischer , Daniel J. Gauthier

Some applications of deep learning require not only to provide accurate results but also to quantify the amount of confidence in their prediction. The management of an electric power grid is one of these cases: to avoid risky scenarios,…

Machine Learning · Computer Science 2023-08-25 Michele Guerra , Simone Scardapane , Filippo Maria Bianchi

Reservoir computers (RC) have proven useful as surrogate models in forecasting and replicating systems of chaotic dynamics. The quality of surrogate models based on RCs is crucially dependent on their optimal implementation that involves…

Machine Learning · Computer Science 2022-12-19 Pauliina Kärkkäinen , Riku Linna

We study the propagation and distribution of information-carrying signals injected in dynamical systems serving as a reservoir computers. A multivariate correlation analysis in tailored replica tests reveals consistency spectra and…

Disordered Systems and Neural Networks · Physics 2021-05-31 Thomas Jüngling , Thomas Lymburn , Michael Small

Efficient and accurate prediction of physical systems is important even when the rules of those systems cannot be easily learned. Reservoir computing, a type of recurrent neural network with fixed nonlinear units, is one such prediction…

Neural and Evolutionary Computing · Computer Science 2024-08-20 Nicholas W. Landry , Beckett R. Hyde , Jake C. Perez , Sean E. Shaheen , Juan G. Restrepo

We study the problem of predicting rare critical transition events for a class of slow-fast nonlinear dynamical systems. The state of the system of interest is described by a slow process, whereas a faster process drives its evolution and…

Computational Physics · Physics 2020-12-14 Soon Hoe Lim , Ludovico Theo Giorgini , Woosok Moon , J. S. Wettlaufer

We investigate the computational potential and limitations of a passive linear optical reservoir with a photodetector at the optical-to-electrical interface as the sole source of nonlinearity. In contrast to conventional nonlinear…

Chaotic Dynamics · Physics 2026-05-06 Elias R. Koch , Julien Javaloyes , Svetlana V. Gurevich , Lina Jaurigue

Reservoir Computing was shown in recent years to be useful as efficient to learn networks in the field of time series tasks. Their randomized initialization, a computational benefit, results in drawbacks in theoretical analysis of large…

Machine Learning · Computer Science 2025-03-21 Johannes Viehweg , Constanze Poll , Patrick Mäder

Although individual neurons and neural populations exhibit the phenomenon of representational drift, perceptual and behavioral outputs of many neural circuits can remain stable across time scales over which representational drift is…

Reservoir computing, a recurrent neural network paradigm in which only the output layer is trained, has demonstrated remarkable performance on tasks such as prediction and control of nonlinear systems. Recently, it was demonstrated that…

Machine Learning · Computer Science 2023-04-27 Joseph D. Hart , Francesco Sorrentino , Thomas L. Carroll

Reservoir computing is a powerful tool for forecasting turbulence because its simple architecture has the computational efficiency to handle large systems. Its implementation, however, often requires full state-vector measurements and…

Fluid Dynamics · Physics 2022-12-02 Vikrant Gupta , Larry K. B. Li , Shiyi Chen , Minping Wan

This paper investigates in detail the effects of noise on the performance of reservoir computing. We focus on an application in which reservoir computers are used to learn the relationship between different state variables of a chaotic…

Neural and Evolutionary Computing · Computer Science 2023-05-10 Chad Nathe , Chandra Pappu , Nicholas A. Mecholsky , Joseph D. Hart , Thomas Carroll , Francesco Sorrentino

It is widely accepted that the complex dynamics characteristic of recurrent neural circuits contributes in a fundamental manner to brain function. Progress has been slow in understanding and exploiting the computational power of recurrent…

Chaotic Dynamics · Physics 2013-07-18 Rodrigo Laje , Dean V. Buonomano

Driven by the remarkable breakthroughs during the past decade, photonics neural networks have experienced a revival. Here, we provide a general overview of progress over the past decade, and sketch a roadmap of important future…

Emerging Technologies · Computer Science 2021-07-20 Daniel Brunner , Laurent Larger , Miguel C. Soriano

There is a growing interest in the development of artificial neural networks that are implemented in a physical system. A major challenge in this context is that these networks are difficult to train since training here would require a…

Emerging Technologies · Computer Science 2026-01-22 Michael te Vrugt