English
Related papers

Related papers: Sparsity in Reservoir Computing Neural Networks

200 papers

Reservoir computing (RC), first applied to temporal signal processing, is a recurrent neural network in which neurons are randomly connected. Once initialized, the connection strengths remain unchanged. Such a simple structure turns RC into…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Heng Zhang , Danilo Vasconcellos Vargas

Reservoir computing (RC) offers efficient temporal data processing with a low training cost by separating recurrent neural networks into a fixed network with recurrent connections and a trainable linear network. The quality of the fixed…

Emerging Technologies · Computer Science 2021-05-17 John Moon , Wei D. Lu

Reservoir Computing (RC) has become popular in recent years thanks to its fast and efficient computational capabilities. Standard RC has been shown to be equivalent in the asymptotic limit to Recurrent Kernels, which helps in analyzing its…

Machine Learning · Computer Science 2024-10-07 Giuseppe Alessio D'Inverno , Jonathan Dong

Reservoir Computing (RC) refers to a Recurrent Neural Networks (RNNs) framework, frequently used for sequence learning and time series prediction. The RC system consists of a random fixed-weight RNN (the input-hidden reservoir layer) and a…

Machine Learning · Computer Science 2017-06-27 M. Andrecut

Reservoir computing (RC), a particular form of recurrent neural network, is under explosive development due to its exceptional efficacy and high performance in reconstruction or/and prediction of complex physical systems. However, the…

Machine Learning · Computer Science 2023-05-10 Xing-Yue Duan , Xiong Ying , Si-Yang Leng , Jürgen Kurths , Wei Lin , Huan-Fei Ma

Reservoir computing (RC) is a novel approach to time series prediction using recurrent neural networks. In RC, an input signal perturbs the intrinsic dynamics of a medium called a reservoir. A readout layer is then trained to reconstruct a…

Neural and Evolutionary Computing · Computer Science 2014-01-13 Alireza Goudarzi , Peter Banda , Matthew R. Lakin , Christof Teuscher , Darko Stefanovic

Forecasting high-dimensional spatiotemporal systems remains computationally challenging for recurrent neural networks (RNNs) and long short-term memory (LSTM) models due to gradient-based training and memory bottlenecks. Reservoir Computing…

Machine Learning · Computer Science 2026-01-05 Ata Akbari Asanjan , Filip Wudarski , Daniel O'Connor , Shaun Geaney , Elena Strbac , P. Aaron Lott , Davide Venturelli

Machine learning has become a fundamental approach for modeling, prediction, and control, enabling systems to learn from data and perform complex tasks. Reservoir computing is a machine learning tool that leverages high-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Sahand Tangerami , Nicholas A. Mecholsky , Francesco Sorrentino

Reservoir computers (RCs) provide a computationally efficient alternative to deep learning while also offering a framework for incorporating brain-inspired computational principles. By using an internal neural network with random, fixed…

Neural and Evolutionary Computing · Computer Science 2025-04-18 Keshav Srinivasan , Dietmar Plenz , Michelle Girvan

Reservoir Computing (RC) is a popular methodology for the efficient design of Recurrent Neural Networks (RNNs). Recently, the advantages of the RC approach have been extended to the context of multi-layered RNNs, with the introduction of…

Machine Learning · Computer Science 2019-09-25 Claudio Gallicchio , Alessio Micheli

Reservoir computing (RC) is a machine learning algorithm that can learn complex time series from data very rapidly based on the use of high-dimensional dynamical systems, such as random networks of neurons, called "reservoirs." To implement…

Machine Learning · Computer Science 2020-12-29 Yusuke Sakemi , Kai Morino , Timothée Leleu , Kazuyuki Aihara

Reservoir computing is a popular approach to design recurrent neural networks, due to its training simplicity and approximation performance. The recurrent part of these networks is not trained (e.g., via gradient descent), making them…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Pietro Verzelli , Cesare Alippi , Lorenzo Livi , Peter Tino

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep…

Machine Learning · Statistics 2021-02-18 Jonathan Dong , Ruben Ohana , Mushegh Rafayelyan , Florent Krzakala

Reservoir Computing (RC) is an appealing approach in Machine Learning that combines the high computational capabilities of Recurrent Neural Networks with a fast and easy training method. Likewise, successful implementation of neuro-inspired…

Adaptation and Self-Organizing Systems · Physics 2021-07-13 Guillermo B. Morales , Claudio R. Mirasso , Miguel C. Soriano

"Sparse" neural networks, in which relatively few neurons or connections are active, are common in both machine learning and neuroscience. Whereas in machine learning, "sparsity" is related to a penalty term that leads to some connecting…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Luca Manneschi , Andrew C. Lin , Eleni Vasilaki

Reservoir Computing is a machine learning approach that uses the rich repertoire of complex system dynamics for function approximation. Current approaches to reservoir computing use a network of coupled integrating neurons that require a…

Neural and Evolutionary Computing · Computer Science 2025-07-30 Alexander Yeung , Peter DelMastro , Arjun Karuvally , Hava Siegelmann , Edward Rietman , Hananel Hazan

Reservoir computing (RC) has attracted attention as an efficient recurrent neural network architecture due to its simplified training, requiring only its last perceptron readout layer to be trained. When implemented with memristors, RC…

Neural and Evolutionary Computing · Computer Science 2025-08-01 Rishona Daniels , Duna Wattad , Ronny Ronen , David Saad , Shahar Kvatinsky

Reservoir Computing (RC) is a powerful computational paradigm that allows high versatility with cheap learning. While other artificial intelligence approaches need exhaustive resources to specify their inner workings, RC is based on a…

Adaptation and Self-Organizing Systems · Physics 2018-11-26 Luís F Seoane

Reservoir Computing (RC) with physical systems requires an understanding of the underlying structure and internal dynamics of the specific physical reservoir. In this study, physical nano-electronic networks with neuromorphic dynamics are…

Emerging Technologies · Computer Science 2025-11-20 Yinhao Xu , Georg A. Gottwald , Zdenka Kuncic

Recurrent Neural Networks (RNNs) have been a prominent concept within artificial intelligence. They are inspired by Biological Neural Networks (BNNs) and provide an intuitive and abstract representation of how BNNs work. Derived from the…

Neural and Evolutionary Computing · Computer Science 2017-03-09 Stefano Nichele , Andreas Molund
‹ Prev 1 2 3 10 Next ›