English
Related papers

Related papers: Reducing network size and improving prediction sta…

200 papers

Recurrent networks are trained to memorize their input better, often in the hopes that such training will increase the ability of the network to predict. We show that networks designed to memorize input can be arbitrarily bad at prediction.…

Machine Learning · Computer Science 2017-09-20 Sarah Marzen

Reservoir computing is a machine learning approach that can generate a surrogate model of a dynamical system. It can learn the underlying dynamical system using fewer trainable parameters and hence smaller training data sets than competing…

Machine Learning · Computer Science 2022-11-23 Daniel J. Gauthier , Ingo Fischer , André Röhm

Reservoir Computing (RC) with physical systems requires an understanding of the underlying structure and internal dynamics of the specific physical reservoir. In this study, physical nano-electronic networks with neuromorphic dynamics are…

Emerging Technologies · Computer Science 2025-11-20 Yinhao Xu , Georg A. Gottwald , Zdenka Kuncic

A reservoir computer is a way of using a high dimensional dynamical system for computation. One way to construct a reservoir computer is by connecting a set of nonlinear nodes into a network. Because the network creates feedback between…

Neural and Evolutionary Computing · Computer Science 2022-03-02 Thomas L. Carroll

Some applications of deep learning require not only to provide accurate results but also to quantify the amount of confidence in their prediction. The management of an electric power grid is one of these cases: to avoid risky scenarios,…

Machine Learning · Computer Science 2023-08-25 Michele Guerra , Simone Scardapane , Filippo Maria Bianchi

The implementation of artificial neural networks in hardware substrates is a major interdisciplinary enterprise. Well suited candidates for physical implementations must combine nonlinear neurons with dedicated and efficient hardware…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Xavier Porte , Louis Andreoli , Maxime Jacquot , Laurent Larger , Daniel Brunner

Advances in artificial intelligence are driven by technologies inspired by the brain, but these technologies are orders of magnitude less powerful and energy efficient than biological systems. Inspired by the nonlinear dynamics of neural…

We propose a new reservoir computing method for forecasting high-resolution spatiotemporal datasets. By combining multi-resolution inputs from coarser to finer layers, our architecture better captures both local and global dynamics. Applied…

Machine Learning · Computer Science 2025-10-14 Nicola Alboré , Gabriele Di Antonio , Fabrizio Coccetti , Andrea Gabrielli

We scrutinize the use of machine learning, based on reservoir computing, to build data-driven effective models of multiscale chaotic systems. We show that, for a wide scale separation, machine learning generates effective models akin to…

Adaptation and Self-Organizing Systems · Physics 2020-11-11 Francesco Borra , Angelo Vulpiani , Massimo Cencini

Quantum reservoir computing has emerged as a promising paradigm for harnessing quantum systems to process temporal data efficiently by bypassing the costly training of gradient-based learning methods. Here, we demonstrate the capability of…

Quantum Physics · Physics 2026-03-20 Qingyu Li , Chiranjib Mukhopadhyay , Ludovico Minati , Abolfazl Bayat

Reservoir computing is a well-established approach for processing data with a much lower complexity compared to traditional neural networks. Despite two decades of experimental progress, the core properties of reservoir computing (namely…

Optimization and Control · Mathematics 2026-03-20 Anh-Tuan Clabaut , Jean Auriol , Islam Boussaada , Guilherme Mazanti

For a reservoir computer composed of a single nonlinear node and delay line, we show that after a finite period of discrete time, the distance between two reservoir outputs is bounded above by a constant multiple of the distance between…

Dynamical Systems · Mathematics 2015-10-14 Claudio A. DiMarco

Biological neural networks can perform complex computations to predict their environment, far above the limited predictive capabilities of individual neurons. While conventional approaches to understanding these computations often focus on…

Neurons and Cognition · Quantitative Biology 2024-06-28 Hanna M. Tolle , Andrea I Luppi , Anil K. Seth , Pedro A. M. Mediano

Reservoir Computing (RC) is an appealing approach in Machine Learning that combines the high computational capabilities of Recurrent Neural Networks with a fast and easy training method. Likewise, successful implementation of neuro-inspired…

Adaptation and Self-Organizing Systems · Physics 2021-07-13 Guillermo B. Morales , Claudio R. Mirasso , Miguel C. Soriano

Reservoir computing is a machine learning algorithm that excels at predicting the evolution of time series, in particular, dynamical systems. Moreover, it has also shown superb performance at solving partial differential equations. In this…

Quantum Physics · Physics 2024-06-19 L. Domingo , J. Borondo , F. Borondo

Reservoir computing typically relies on large, randomly generated reservoirs, enabling simple, often linear readouts. Over the past two decades, most constructions have exploited the freedom to select the reservoir, constrained primarily by…

Dynamical Systems · Mathematics 2026-05-26 G Manjunath , Juan-Pablo Ortega , Alma van der Merwe

This paper extends the notion of information processing capacity for non-independent input signals in the context of reservoir computing (RC). The presence of input autocorrelation makes worthwhile the treatment of forecasting and filtering…

Emerging Technologies · Computer Science 2015-10-08 Lyudmila Grigoryeva , Julie Henriques , Juan-Pablo Ortega

Reservoir computers (RCs) are powerful machine learning architectures for time series prediction. Recently, next generation reservoir computers (NGRCs) have been introduced, offering distinct advantages over RCs, such as reduced…

Machine Learning · Computer Science 2024-06-07 Ravi Chepuri , Dael Amzalag , Thomas Antonsen , Michelle Girvan

Forecasting high-dimensional spatiotemporal systems remains computationally challenging for recurrent neural networks (RNNs) and long short-term memory (LSTM) models due to gradient-based training and memory bottlenecks. Reservoir Computing…

Machine Learning · Computer Science 2026-01-05 Ata Akbari Asanjan , Filip Wudarski , Daniel O'Connor , Shaun Geaney , Elena Strbac , P. Aaron Lott , Davide Venturelli

Coupled networks of mass-spring resonators have attracted growing attention across multiple fundamental and applied research directions, including reservoir computing for artificial intelligence. This has led to the exploration of platforms…

Mesoscale and Nanoscale Physics · Physics 2026-01-08 Andrea Grimaldi , Davi R. Rodrigues , Andrea Meo , Francesca Garescì , Giovanni Finocchio