English
Related papers

Related papers: Deep Q-network using reservoir computing with mult…

200 papers

Deep Reinforcement Learning (RL) demonstrates excellent performance on tasks that can be solved by trained policy. It plays a dominant role among cutting-edge machine learning approaches using multi-layer Neural networks (NNs). At the same…

Machine Learning · Computer Science 2019-08-20 Devdhar Patel , Hananel Hazan , Daniel J. Saunders , Hava Siegelmann , Robert Kozma

Deep neural networks have revolutionized numerous research fields and applications. Despite their widespread success, a fundamental limitation known as catastrophic forgetting remains, where models fail to retain their ability to perform…

Machine Learning · Computer Science 2025-02-21 Karolina Bogacka , Maximilian Höfler , Maria Ganzha , Wojciech Samek , Katarzyna Wasielewska-Michniewska

Reservoir computing (RC), a particular form of recurrent neural network, is under explosive development due to its exceptional efficacy and high performance in reconstruction or/and prediction of complex physical systems. However, the…

Machine Learning · Computer Science 2023-05-10 Xing-Yue Duan , Xiong Ying , Si-Yang Leng , Jürgen Kurths , Wei Lin , Huan-Fei Ma

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be…

Optimization and Control · Mathematics 2019-07-26 S. Günther , L. Ruthotto , J. B. Schroder , E. C. Cyr , N. R. Gauger

Recurrent neural networks (RNNs) are known to be difficult to train due to the gradient vanishing and exploding problems and thus difficult to learn long-term patterns and construct deep networks. To address these problems, this paper…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Shuai Li , Wanqing Li , Chris Cook , Yanbo Gao

In the last decade, a new computational paradigm was introduced in the field of Machine Learning, under the name of Reservoir Computing (RC). RC models are neural networks which a recurrent part (the reservoir) that does not participate in…

Neural and Evolutionary Computing · Computer Science 2013-04-08 Sebastián Basterrech , Gerardo Rubino

Reservoir computing is a popular approach to design recurrent neural networks, due to its training simplicity and approximation performance. The recurrent part of these networks is not trained (e.g., via gradient descent), making them…

Neural and Evolutionary Computing · Computer Science 2021-02-15 Pietro Verzelli , Cesare Alippi , Lorenzo Livi , Peter Tino

Echo State Networks (ESN) are a class of Recurrent Neural Networks (RNN) that has gained substantial popularity due to their effectiveness, ease of use and potential for compact hardware implementation. An ESN contains the three network…

Machine Learning · Computer Science 2018-07-26 Luca Carcano , Emanuele Plebani , Danilo Pietro Pau , Marco Piastra

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the proposed deep…

Machine Learning · Computer Science 2021-01-07 Qing Wei , Hailan Ma , Chunlin Chen , Daoyi Dong

In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Zhigang Wang , Hangyu Yang , Ning Wang , Chuanfei Xu , Jie Nie , Zhiqiang Wei , Yu Gu , Ge Yu

Recently, Magnetic Resonance Fingerprinting (MRF) was proposed as a quantitative imaging technique for the simultaneous acquisition of tissue parameters such as relaxation times $T_1$ and $T_2$. Although the acquisition is highly…

Image and Video Processing · Electrical Eng. & Systems 2019-07-23 Elisabeth Hoppe , Florian Thamm , Gregor Körzdörfer , Christopher Syben , Franziska Schirrmacher , Mathias Nittka , Josef Pfeuffer , Heiko Meyer , Andreas Maier

Constructing states from sequences of observations is an important component of reinforcement learning agents. One solution for state construction is to use recurrent neural networks. Back-propagation through time (BPTT), and real-time…

Machine Learning · Computer Science 2023-11-23 Khurram Javed , Haseeb Shah , Rich Sutton , Martha White

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo

We consider the problem of training input-output recurrent neural networks (RNN) for sequence labeling tasks. We propose a novel spectral approach for learning the network parameters. It is based on decomposition of the cross-moment tensor…

Machine Learning · Computer Science 2016-11-01 Hanie Sedghi , Anima Anandkumar

Representing a dialog policy as a recurrent neural network (RNN) is attractive because it handles partial observability, infers a latent representation of state, and can be optimized with supervised learning (SL) or reinforcement learning…

Artificial Intelligence · Computer Science 2016-12-20 Kavosh Asadi , Jason D. Williams

This work investigates the ways in which deep learning methods can benefit from random projection (RP), a classic linear dimensionality reduction method. We focus on two areas where, as we have found, employing RP techniques can improve…

Machine Learning · Computer Science 2018-12-27 Piotr Iwo Wójcik

In this paper, we study the problem of node representation learning with graph neural networks. We present a graph neural network class named recurrent graph neural network (RGNN), that address the shortcomings of prior methods. By using…

Machine Learning · Computer Science 2019-08-27 Binxuan Huang , Kathleen M. Carley

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

Experience reuse is key to sample-efficient reinforcement learning. One of the critical issues is how the experience is represented and stored. Previously, the experience can be stored in the forms of features, individual models, and the…

Machine Learning · Computer Science 2019-06-03 Wen-Ji Zhou , Yang Yu , Yingfeng Chen , Kai Guan , Tangjie Lv , Changjie Fan , Zhi-Hua Zhou

Recurrent networks are a special class of artificial neural systems that use their internal states to perform computing tasks for machine learning. One of its state-of-the-art developments, i.e. reservoir computing (RC), uses the internal…

Disordered Systems and Neural Networks · Physics 2022-11-02 Valeria d'Andrea , Michele Puppin , Manlio De Domenico