中文
相关论文

相关论文: Memory-Efficient Episodic Control Reinforcement Le…

200 篇论文

We introduce the technique of adaptive discretization to design an efficient model-based episodic reinforcement learning algorithm in large (potentially continuous) state-action spaces. Our algorithm is based on optimistic one-step value…

机器学习 · 计算机科学 2020-10-26 Sean R. Sinclair , Tianyu Wang , Gauri Jain , Siddhartha Banerjee , Christina Lee Yu

Off-policy learning allows us to learn about possible policies of behavior from experience generated by a different behavior policy. Temporal difference (TD) learning algorithms can become unstable when combined with function approximation…

机器学习 · 计算机科学 2021-06-23 Ray Jiang , Tom Zahavy , Zhongwen Xu , Adam White , Matteo Hessel , Charles Blundell , Hado van Hasselt

Neural networks are very effective when trained on large datasets for a large number of iterations. However, when they are trained on non-stationary streams of data and in an online fashion, their performance is reduced (1) by the online…

机器学习 · 计算机科学 2023-07-04 Albin Soutif--Cormerais , Antonio Carta , Joost Van de Weijer

Facial expression recognition is a pivotal component in machine learning, facilitating various applications. However, convolutional neural networks (CNNs) are often plagued by catastrophic forgetting, impeding their adaptability. The…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Israel A. Laurensi , Alceu de Souza Britto , Jean Paul Barddal , Alessandro Lameiras Koerich

Typical methods to study cognitive function are to record the electrical activities of animal neurons during the training of animals performing behavioral tasks. A key problem is that they fail to record all the relevant neurons in the…

神经元与认知 · 定量生物学 2021-03-08 Xiaohan Zhang , Lu Liu , Guodong Long , Jing Jiang , Shenquan Liu

Traditional quantum system control methods often face different constraints, and are easy to cause both leakage and stochastic control errors under the condition of limited resources. Reinforcement learning has been proved as an efficient…

新兴技术 · 计算机科学 2024-05-14 Wenjie Liu , Bosi Wang , Jihao Fan , Yebo Ge , Mohammed Zidan

One major obstacle towards AI is the poor ability of models to solve new problems quicker, and without forgetting previously acquired knowledge. To better understand this issue, we study the problem of continual learning, where the model…

机器学习 · 计算机科学 2022-09-14 David Lopez-Paz , Marc'Aurelio Ranzato

Emphatic algorithms are temporal-difference learning algorithms that change their effective state distribution by selectively emphasizing and de-emphasizing their updates on different time steps. Recent works by Sutton, Mahmood and White…

机器学习 · 计算机科学 2015-07-07 A. Rupam Mahmood , Huizhen Yu , Martha White , Richard S. Sutton

Trajectory optimizers for model-based reinforcement learning, such as the Cross-Entropy Method (CEM), can yield compelling results even in high-dimensional control tasks and sparse-reward environments. However, their sampling inefficiency…

As intents unfold and environments change, multi-turn agents face continuously shifting decision contexts. Although reusing past experience is intuitively appealing, existing approaches remain limited: full trajectories are often too…

机器学习 · 计算机科学 2026-02-02 Sijia Li , Yuchen Huang , Zifan Liu , Zijian Li , Jingjing fu , Lei Song , Jiang Bian , Jun Zhang , Rui Wang

The two main impediments to continual learning are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains autoencoders with Neural…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Ali Ayub , Alan R. Wagner

Recognizing human emotions from complex, multivariate, and non-stationary electroencephalography (EEG) time series is essential in affective brain-computer interface. However, because continuous labeling of ever-changing emotional states is…

人机交互 · 计算机科学 2022-12-15 Yongtao Zhang , Yue Pan , Yulin Zhang , Linling Li , Li Zhang , Gan Huang , Zhen Liang , Zhiguo Zhang

Efficient exploration in deep cooperative multi-agent reinforcement learning (MARL) still remains challenging in complex coordination problems. In this paper, we introduce a novel Episodic Multi-agent reinforcement learning with…

机器学习 · 计算机科学 2021-11-23 Lulu Zheng , Jiarui Chen , Jianhao Wang , Jiamin He , Yujing Hu , Yingfeng Chen , Changjie Fan , Yang Gao , Chongjie Zhang

Existing Deep Reinforcement Learning (DRL) algorithms suffer from sample inefficiency. Generally, episodic control-based approaches are solutions that leverage highly-rewarded past experiences to improve sample efficiency of DRL algorithms.…

机器学习 · 计算机科学 2023-02-21 Zhuo Li , Derui Zhu , Yujing Hu , Xiaofei Xie , Lei Ma , Yan Zheng , Yan Song , Yingfeng Chen , Jianjun Zhao

Recent advances in off-policy deep reinforcement learning (RL) have led to impressive success in complex tasks from visual observations. Experience replay improves sample-efficiency by reusing experiences from the past, and convolutional…

机器学习 · 计算机科学 2021-10-29 Lili Chen , Kimin Lee , Aravind Srinivas , Pieter Abbeel

Partially observed control problems are a challenging aspect of reinforcement learning. We extend two related, model-free algorithms for continuous control -- deterministic policy gradient and stochastic value gradient -- to solve partially…

机器学习 · 计算机科学 2015-12-15 Nicolas Heess , Jonathan J Hunt , Timothy P Lillicrap , David Silver

Artificial neural networks are promising for general function approximation but challenging to train on non-independent or non-identically distributed data due to catastrophic forgetting. The experience replay buffer, a standard component…

机器学习 · 计算机科学 2023-04-12 Qingfeng Lan , Yangchen Pan , Jun Luo , A. Rupam Mahmood

Deep Reinforcement Learning agents often suffer from catastrophic forgetting, forgetting previously found solutions in parts of the input space when training on new data. Replay Memories are a common solution to the problem, decorrelating…

机器学习 · 计算机科学 2023-08-29 Muhammad Burhan Hafez , Tilman Immisch , Tom Weber , Stefan Wermter

Episodic memory plays an important role in the behavior of animals and humans. It allows the accumulation of information about current state of the environment in a task-agnostic way. This episodic representation can be later accessed by…

神经与进化计算 · 计算机科学 2019-05-08 Artyom Y. Sorokin , Mikhail S. Burtsev

Event-triggered control (ETC) methods can achieve high-performance control with a significantly lower number of samples compared to usual, time-triggered methods. These frameworks are often based on a mathematical model of the system and…

系统与控制 · 计算机科学 2018-09-17 Dominik Baumann , Jia-Jie Zhu , Georg Martius , Sebastian Trimpe