English
Related papers

Related papers: Decoding Neuronal Networks: A Reservoir Computing …

200 papers

In this paper, we investigate learning-based MIMO-OFDM symbol detection strategies focusing on a special recurrent neural network (RNN) -- reservoir computing (RC). We first introduce the Time-Frequency RC to take advantage of the…

Signal Processing · Electrical Eng. & Systems 2020-03-17 Zhou Zhou , Lingjia Liu , Shashank Jere , Jianzhong , Zhang , Yang Yi

Many of today's most interesting questions involve understanding and interpreting complex relationships within graph-based structures. For instance, in materials science, predicting material properties often relies on analyzing the…

Emerging Technologies · Computer Science 2024-05-08 Derek Gobin , Shay Snyder , Guojing Cong , Shruti R. Kulkarni , Catherine Schuman , Maryam Parsa

Recently, reinforcement learning models have achieved great success, completing complex tasks such as mastering Go and other games with higher scores than human players. Many of these models collect considerable data on the tasks and…

Machine Learning · Computer Science 2019-07-19 Hanten Chang , Katsuya Futagami

Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence-level tasks, capturing the dependencies between words in a single sentence, or…

Computation and Language · Computer Science 2021-09-15 Manuel Widmoser , Maria Leonor Pacheco , Jean Honorio , Dan Goldwasser

Models of neural networks have proven their utility in the development of learning algorithms in computer science and in the theoretical study of brain dynamics in computational neuroscience. We propose in this paper a spatial neural…

Neural and Evolutionary Computing · Computer Science 2014-05-06 Lucas Antiqueira , Liang Zhao

Much of the information the brain processes and stores is temporal in nature - a spoken word or a handwritten signature, for example, is defined by how it unfolds in time. However, it remains unclear how neural circuits encode complex…

Neurons and Cognition · Quantitative Biology 2017-08-15 Vishwa Goudar , Dean Buonomano

As one of the most important paradigms of recurrent neural networks, the echo state network (ESN) has been applied to a wide range of fields, from robotics to medicine, finance, and language processing. A key feature of the ESN paradigm is…

Machine Learning · Computer Science 2020-02-26 Pau Vilimelis Aceituno , Yan Gang , Yang-Yu Liu

Echo state networks (ESNs) are a powerful form of reservoir computing that only require training of linear output weights whilst the internal reservoir is formed of fixed randomly connected neurons. With a correctly scaled connectivity…

Machine Learning · Computer Science 2021-08-03 Luca Manneschi , Matthew O. A. Ellis , Guido Gigante , Andrew C. Lin , Paolo Del Giudice , Eleni Vasilaki

The extraction of a scene graph with objects as nodes and mutual relationships as edges is the basis for a deep understanding of image content. Despite recent advances, such as message passing and joint classification, the detection of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Rajat Koner , Suprosanna Shit , Volker Tresp

Reservoir computing is a relatively recent computational paradigm that originates from a recurrent neural network and is known for its wide range of implementations using different physical technologies. Large reservoirs are very hard to…

The unprecedented dissemination of edge devices is accompanied by a growing demand for neuromorphic chips that can process time-series data natively without cloud support. Echo state network (ESN) is a class of recurrent neural networks…

Machine Learning · Computer Science 2025-03-04 Abdullah M. Zyarah , Alaa M. Abdul-Hadi , Dhireesha Kudithipudi

Numerous Graph Neural Networks (GNNs) have been developed to tackle the challenge of Knowledge Graph Embedding (KGE). However, many of these approaches overlook the crucial role of relation information and inadequately integrate it with…

Machine Learning · Computer Science 2024-09-24 Peyman Baghershahi , Reshad Hosseini , Hadi Moradi

Inspired by the numerical solution of ordinary differential equations, in this paper we propose a novel Reservoir Computing (RC) model, called the Euler State Network (EuSN). The presented approach makes use of forward Euler discretization…

Machine Learning · Computer Science 2023-03-27 Claudio Gallicchio

The Reservoir Computing (RC) paradigm posits that sufficiently complex physical systems can be used to massively simplify pattern recognition tasks and nonlinear signal prediction. This work demonstrates how random topological magnetic…

Mesoscale and Nanoscale Physics · Physics 2020-11-18 Daniele Pinna , George Bourianoff , Karin Everschor-Sitte

Reservoir computing (RC) offers efficient temporal data processing with a low training cost by separating recurrent neural networks into a fixed network with recurrent connections and a trainable linear network. The quality of the fixed…

Emerging Technologies · Computer Science 2021-05-17 John Moon , Wei D. Lu

This paper proposes to study neural networks through neuronal correlation, a statistical measure of correlated neuronal activity on the penultimate layer. We show that neuronal correlation can be efficiently estimated via weight matrix, can…

Machine Learning · Computer Science 2022-01-25 Gaojie Jin , Xinping Yi , Xiaowei Huang

Reservoir computing is a popular approach to design recurrent neural networks, due to its training simplicity and approximation performance. The recurrent part of these networks is not trained (e.g., via gradient descent), making them…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Pietro Verzelli , Cesare Alippi , Lorenzo Livi , Peter Tino

Reservoir computing (RC) has attracted attention as an efficient recurrent neural network architecture due to its simplified training, requiring only its last perceptron readout layer to be trained. When implemented with memristors, RC…

Neural and Evolutionary Computing · Computer Science 2025-08-01 Rishona Daniels , Duna Wattad , Ronny Ronen , David Saad , Shahar Kvatinsky

Reservoir Computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementation are comparable to other state of the art algorithms for tasks such as speech recognition or…

Emerging Technologies · Computer Science 2018-02-09 Piotr Antonik , François Duport , Michiel Hermans , Anteo Smerieri , Marc Haelterman , Serge Massar

Neuroscientists classify neurons into different types that perform similar computations at different locations in the visual field. Traditional methods for neural system identification do not capitalize on this separation of 'what' and…

Machine Learning · Statistics 2018-01-30 David A. Klindt , Alexander S. Ecker , Thomas Euler , Matthias Bethge