English
Related papers

Related papers: Deep Q-network using reservoir computing with mult…

200 papers

Due to its perceptual limitations, an agent may have too little information about the state of the environment to act optimally. In such cases, it is important to keep track of the observation history to uncover hidden state. Recent deep…

Machine Learning · Computer Science 2021-02-18 Miguel Suau , Jinke He , Elena Congeduti , Rolf A. N. Starre , Aleksander Czechowski , Frans A. Oliehoek

Recurrent Neural Networks (RNNs) are commonly used for real-time processing, streaming data, and cases where the amount of training samples is limited. Backpropagation Through Time (BPTT) is the predominant algorithm for training RNNs;…

Machine Learning · Computer Science 2025-07-08 Nikolay Manchev , Luis C. Garcia-Peraza-Herrera

We consider reservoirs in the form of liquid state machines, i.e., recurrently connected networks of spiking neurons with randomly chosen weights. So far only the weights of a linear readout were adapted for a specific task. We wondered…

Neural and Evolutionary Computing · Computer Science 2022-06-15 Anand Subramoney , Franz Scherr , Wolfgang Maass

Reinforcement learning (RL) has increasingly become a pivotal technique in the post-training of large language models (LLMs). The effective exploration of the output space is essential for the success of RL. We observe that for complex…

Machine Learning · Computer Science 2025-07-08 Shihan Dou , Muling Wu , Jingwen Xu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Recently, reinforcement learning models have achieved great success, mastering complex tasks such as Go and other games with higher scores than human players. Many of these models store considerable data on the tasks and achieve high…

Neural and Evolutionary Computing · Computer Science 2019-12-10 Hanten Chang , Katsuya Futagami

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Recurrent neural networks (RNNs) have been widely used for processing sequential data. However, RNNs are commonly difficult to train due to the well-known gradient vanishing and exploding problems and hard to learn long-term patterns. Long…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Shuai Li , Wanqing Li , Chris Cook , Ce Zhu , Yanbo Gao

We present a Fourier-enhanced recurrent neural network (RNN) for downscaling electrical loads. The model combines (i) a recurrent backbone driven by low-resolution inputs, (ii) explicit Fourier seasonal embeddings fused in latent space, and…

Machine Learning · Computer Science 2025-12-10 Qi Chen , Mihai Anitescu

Humans learn continually throughout their lifespan by accumulating diverse knowledge and fine-tuning it for future tasks. When presented with a similar goal, neural networks suffer from catastrophic forgetting if data distributions across…

Machine Learning · Computer Science 2022-09-19 Dupati Srikar Chandra , Sakshi Varshney , P. K. Srijith , Sunil Gupta

Time series prediction is essential for human activities in diverse areas. A common approach to this task is to harness Recurrent Neural Networks (RNNs). However, while their predictions are quite accurate, their learning process is complex…

Quantum Physics · Physics 2025-05-30 Michał Siemaszko , Adam Buraczewski , Bertrand Le Saux , Magdalena Stobińska

Although Recurrent Neural Network (RNN) has been a powerful tool for modeling sequential data, its performance is inadequate when processing sequences with multiple patterns. In this paper, we address this challenge by introducing a novel…

Machine Learning · Computer Science 2019-02-28 Kui Zhao , Yuechuan Li , Chi Zhang , Cheng Yang , Huan Xu

This paper introduces the QDQN-DPER framework to enhance the efficiency of quantum reinforcement learning (QRL) in solving sequential decision tasks. The framework incorporates prioritized experience replay and asynchronous training into…

Quantum Physics · Physics 2023-04-20 Samuel Yen-Chi Chen

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

Neural and Evolutionary Computing · Computer Science 2024-05-09 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

Recurrent neural networks (RNN) have been successfully applied to various sequential decision-making tasks, natural language processing applications, and time-series predictions. Such networks are usually trained through back-propagation…

Machine Learning · Computer Science 2019-12-02 Julia El Zini , Yara Rizk , Mariette Awad

Deep Reinforcement Learning (RL) powered by neural net approximation of the Q function has had enormous empirical success. While the theory of RL has traditionally focused on linear function approximation (or eluder dimension) approaches,…

Machine Learning · Computer Science 2021-12-28 Baihe Huang , Kaixuan Huang , Sham M. Kakade , Jason D. Lee , Qi Lei , Runzhe Wang , Jiaqi Yang

Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural…

Machine Learning · Computer Science 2023-06-22 Yang Ni , Danny Abraham , Mariam Issa , Yeseong Kim , Pietro Mercati , Mohsen Imani

Recurrent Neural Network (RNN) has been widely applied for sequence modeling. In RNN, the hidden states at current step are full connected to those at previous step, thus the influence from less related features at previous step may…

Computation and Language · Computer Science 2017-05-04 Danhao Zhu , Si Shen , Xin-Yu Dai , Jiajun Chen

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to…

Reinforcement Learning (RL) consists of designing agents that make intelligent decisions without human supervision. When used alongside function approximators such as Neural Networks (NNs), RL is capable of solving extremely complex…

Quantum Physics · Physics 2024-11-13 Rodrigo Coelho , André Sequeira , Luís Paulo Santos

Training a neural network using backpropagation algorithm requires passing error gradients sequentially through the network. The backward locking prevents us from updating network layers in parallel and fully leveraging the computing…

Machine Learning · Computer Science 2019-05-30 Zhouyuan Huo , Bin Gu , Heng Huang