English
Related papers

Related papers: Reservoir-size dependent learning in analogue neur…

200 papers

Recurrent neural networks are used to forecast time series in finance, climate, language, and from many other domains. Reservoir computers are a particularly easily trainable form of recurrent neural network. Recently, a "next-generation"…

Machine Learning · Computer Science 2023-03-28 Sarah E. Marzen , Paul M. Riechers , James P. Crutchfield

Memory-augmented neural networks equip a recurrent neural network with an explicit memory to support tasks that require information storage without interference over long times. A key motivation for such research is to perform classic…

Neural and Evolutionary Computing · Computer Science 2021-07-27 Benjamin Paaßen , Alexander Schulz , Barbara Hammer

Photonic Neural Network implementations have been gaining considerable attention as a potentially disruptive future technology. Demonstrating learning in large scale neural networks is essential to establish photonic machine learning…

Neural and Evolutionary Computing · Computer Science 2019-05-13 Julian Bueno , Sheler Maktoobi , Luc Froehly , Ingo Fischer , Maxime Jacquot , Laurent Larger , Daniel Brunner

As one of the most important paradigms of recurrent neural networks, the echo state network (ESN) has been applied to a wide range of fields, from robotics to medicine, finance, and language processing. A key feature of the ESN paradigm is…

Machine Learning · Computer Science 2020-02-26 Pau Vilimelis Aceituno , Yan Gang , Yang-Yu Liu

We consider reservoirs in the form of liquid state machines, i.e., recurrently connected networks of spiking neurons with randomly chosen weights. So far only the weights of a linear readout were adapted for a specific task. We wondered…

Neural and Evolutionary Computing · Computer Science 2022-06-15 Anand Subramoney , Franz Scherr , Wolfgang Maass

Reservoir Computing is an emerging machine learning framework which is a versatile option for utilising physical systems for computation. In this paper, we demonstrate how a single node reservoir, made of a simple electronic circuit, can be…

Machine Learning · Computer Science 2022-12-23 N. Rasha Shanaz , K. Murali , P. Muruganandam

Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input…

Emerging Technologies · Computer Science 2012-07-06 Yvan Paquot , François Duport , Anteo Smerieri , Joni Dambre , Benjamin Schrauwen , Marc Haelterman , Serge Massar

Reservoir Computing (RC) refers to a Recurrent Neural Networks (RNNs) framework, frequently used for sequence learning and time series prediction. The RC system consists of a random fixed-weight RNN (the input-hidden reservoir layer) and a…

Machine Learning · Computer Science 2017-06-27 M. Andrecut

Reservoir computing is a machine learning paradigm that transforms the transient dynamics of high-dimensional nonlinear systems for processing time-series data. Although reservoir computing was initially proposed to model information…

Neurons and Cognition · Quantitative Biology 2023-06-14 Takuma Sumi , Hideaki Yamamoto , Yuichi Katori , Satoshi Moriya , Tomohiro Konno , Shigeo Sato , Ayumi Hirano-Iwata

For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network…

Neural and Evolutionary Computing · Computer Science 2022-11-14 Sebastián Basterrech , Tarun Kumar Sharma

Reservoir computing typically relies on large, randomly generated reservoirs, enabling simple, often linear readouts. Over the past two decades, most constructions have exploited the freedom to select the reservoir, constrained primarily by…

Dynamical Systems · Mathematics 2026-05-26 G Manjunath , Juan-Pablo Ortega , Alma van der Merwe

Reservoir computing is a machine learning paradigm that uses a structure called a reservoir, which has nonlinearities and short-term memory. In recent years, reservoir computing has expanded to new functions such as the autonomous…

Machine Learning · Computer Science 2023-07-05 Kohei Tsuchiyama , André Röhm , Takatomo Mihana , Ryoichi Horisaki , Makoto Naruse

"Sparse" neural networks, in which relatively few neurons or connections are active, are common in both machine learning and neuroscience. Whereas in machine learning, "sparsity" is related to a penalty term that leads to some connecting…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Luca Manneschi , Andrew C. Lin , Eleni Vasilaki

As we approach the physical limits of CMOS technology, advances in materials science and nanotechnology are making available a variety of unconventional computing substrates that can potentially replace top-down-designed silicon-based…

Emerging Technologies · Computer Science 2014-05-05 Alireza Goudarzi , Matthew R. Lakin , Darko Stefanovic

Reservoir Computing is a relatively new framework created to allow the usage of powerful but complex systems as computational mediums. The basic approach consists in training only a readout layer, exploiting the innate separation and…

Robotics · Computer Science 2022-06-23 Paolo Baldini

Reservoir computing is a recently introduced machine learning paradigm that has been shown to be well-suited for the processing of spatiotemporal data. Rather than training the network node connections and weights via backpropagation in…

Neural and Evolutionary Computing · Computer Science 2016-07-20 Ashley Prater

Artificial Recurrent Neural Networks are a powerful information processing abstraction, and Reservoir Computing provides an efficient strategy to build robust implementations by projecting external inputs into high dimensional dynamical…

Machine Learning · Computer Science 2021-04-21 Claudio Gallicchio , Alessio Micheli , Luca Silvestri

A reservoir computer is a way of using a high dimensional dynamical system for computation. One way to construct a reservoir computer is by connecting a set of nonlinear nodes into a network. Because the network creates feedback between…

Neural and Evolutionary Computing · Computer Science 2022-03-02 Thomas L. Carroll

Large Language Models (LLM) have dominated the science and media landscape duo to their impressive performance on processing large chunks of data and produce human-like levels of text. Nevertheless, their huge energy demand and slow…

Computation and Language · Computer Science 2026-01-12 Felix Köster , Atsushi Uchida

Reservoir computing is a machine learning approach that can generate a surrogate model of a dynamical system. It can learn the underlying dynamical system using fewer trainable parameters and hence smaller training data sets than competing…

Machine Learning · Computer Science 2022-11-23 Daniel J. Gauthier , Ingo Fischer , André Röhm