中文
相关论文

相关论文: Sparsity in Reservoir Computing Neural Networks

200 篇论文

In this study, we address the challenge of analyzing electrophysiological measurements in neuronal networks. Our computational model, based on the Reservoir Computing Network (RCN) architecture, deciphers spatio-temporal data obtained from…

定量方法 · 定量生物学 2025-02-14 Ilya Auslender , Giorgio Letti , Yasaman Heydari , Clara Zaccaria , Lorenzo Pavesi

We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network…

信号处理 · 电气工程与系统科学 2020-02-19 Pantelis R. Vlachas , Jaideep Pathak , Brian R. Hunt , Themistoklis P. Sapsis , Michelle Girvan , Edward Ott , Petros Koumoutsakos

Multifunctionality is ubiquitous in biological neurons. Several studies have translated the concept to artificial neural networks as well. Recently, multifunctionality in reservoir computing (RC) has gained the widespread attention of…

混沌动力学 · 物理学 2025-04-18 Swarnendu Mandal , Kazuyuki Aihara

Reservoir Computing (RC) is a simple and efficient model-free framework for forecasting the behavior of nonlinear dynamical systems from data. Here, we show that there exist commonly-studied systems for which leading RC frameworks struggle…

机器学习 · 计算机科学 2023-09-27 Yuanzhao Zhang , Sean P. Cornelius

Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input…

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule,…

机器学习 · 计算机科学 2011-02-22 Vincent Gripon , Claude Berrou

Reservoir computers (RCs) are powerful machine learning architectures for time series prediction. Recently, next generation reservoir computers (NGRCs) have been introduced, offering distinct advantages over RCs, such as reduced…

机器学习 · 计算机科学 2024-06-07 Ravi Chepuri , Dael Amzalag , Thomas Antonsen , Michelle Girvan

A reservoir computer is a way of using a high dimensional dynamical system for computation. One way to construct a reservoir computer is by connecting a set of nonlinear nodes into a network. Because the network creates feedback between…

神经与进化计算 · 计算机科学 2022-03-02 Thomas L. Carroll

Reservoir computing - information processing based on untrained recurrent neural networks with random connections - is expected to depend on the nonlinear properties of the neurons and the resulting oscillatory, chaotic, or fixpoint…

神经与进化计算 · 计算机科学 2024-11-18 Claus Metzner , Achim Schilling , Andreas Maier , Patrick Krauss

Deep learning is finding its way into the embedded world with applications such as autonomous driving, smart sensors and aug- mented reality. However, the computation of deep neural networks is demanding in energy, compute power and memory.…

机器学习 · 计算机科学 2018-08-28 Dominik Marek Loroch , Franz-Josef Pfreundt , Norbert Wehn , Janis Keuper

Artificial neural networks with internal dynamics exhibit remarkable capability in processing information. Reservoir computing (RC) is a canonical example that features rich computing expressivity and compatibility with physical…

Model predictive control (MPC) is an industry standard control technique that iteratively solves an open-loop optimization problem to guide a system towards a desired state or trajectory. Consequently, an accurate forward model of system…

系统与控制 · 电气工程与系统科学 2024-11-11 Jan P. Williams , J. Nathan Kutz , Krithika Manohar

Making accurate predictions of chaotic time series is a complex challenge. Reservoir computing, a neuromorphic-inspired approach, has emerged as a powerful tool for this task. It exploits the memory and nonlinearity of dynamical systems…

机器学习 · 计算机科学 2025-05-26 Rodrigo Martínez-Peña , Román Orús

Diffusion-based Molecular Communication (MC) is inherently challenged by severe inter-symbol interference (ISI). This is significantly amplified in mobile scenarios, where the channel impulse response (CIR) becomes time-varying and…

新兴技术 · 计算机科学 2025-11-13 Abdulkadir Bilge , Eren Akyol , Murat Kuscu

Classification of multivariate time series (MTS) has been tackled with a large variety of methodologies and applied to a wide range of scenarios. Reservoir Computing (RC) provides efficient tools to generate a vectorial, fixed-size…

神经与进化计算 · 计算机科学 2020-06-09 Filippo Maria Bianchi , Simone Scardapane , Sigurd Løkse , Robert Jenssen

Reservoir Computing Networks (RCNs) belong to a group of machine learning techniques that project the input space non-linearly into a high-dimensional feature space, where the underlying task can be solved linearly. Popular variants of RCNs…

机器学习 · 计算机科学 2022-05-31 Peter Steiner , Azarakhsh Jalalvand , Simon Stone , Peter Birkholz

We investigate sparse representations for control in reinforcement learning. While these representations are widely used in computer vision, their prevalence in reinforcement learning is limited to sparse coding where extracting…

机器学习 · 计算机科学 2018-11-19 Vincent Liu , Raksha Kumaraswamy , Lei Le , Martha White

Recurrent neural networks (RNNs) are omnipresent in sequence modeling tasks. Practical models usually consist of several layers of hundreds or thousands of neurons which are fully connected. This places a heavy computational and memory…

机器学习 · 计算机科学 2019-05-30 Matthijs Van Keirsbilck , Alexander Keller , Xiaodong Yang

Recurrent Neural Networks (RNNs) are powerful tools for solving sequence-based problems, but their efficacy and execution time are dependent on the size of the network. Following recent work in simplifying these networks with model pruning…

神经与进化计算 · 计算机科学 2018-04-30 Feiwen Zhu , Jeff Pool , Michael Andersch , Jeremy Appleyard , Fung Xie

In this paper, we present a neuro-inspired approach to reservoir computing (RC) in which a network of in vitro cultured cortical neurons serves as the physical reservoir. Rather than relying on artificial recurrent models to approximate…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Luca Ciampi , Ludovico Iannello , Fabrizio Tonelli , Gabriele Lagani , Angelo Di Garbo , Federico Cremisi , Giuseppe Amato