English
Related papers

Related papers: Memory-Efficient Episodic Control Reinforcement Le…

200 papers

While deep reinforcement learning has shown important empirical success, it tends to learn relatively slow due to slow propagation of rewards information and slow update of parametric neural networks. Non-parametric episodic memory, on the…

Machine Learning · Computer Science 2023-04-25 Zhao Yang , Thomas. M. Moerland , Mike Preuss , Aske Plaat

The research on deep reinforcement learning which estimates Q-value by deep learning has been attracted the interest of researchers recently. In deep reinforcement learning, it is important to efficiently learn the experiences that an agent…

Machine Learning · Computer Science 2018-06-05 Daichi Nishio , Satoshi Yamane

Both the human brain and artificial learning agents operating in real-world or comparably complex environments are faced with the challenge of online model selection. In principle this challenge can be overcome: hierarchical Bayesian…

Machine Learning · Computer Science 2017-12-05 David G. Nagy , Gergő Orbán

Episodic control has been proposed as a third approach to reinforcement learning, besides model-free and model-based control, by analogy with the three types of human memory. i.e. episodic, procedural and semantic memory. But the…

Artificial Intelligence · Computer Science 2018-08-13 Johanni Brea

We introduce a novel training procedure for policy gradient methods wherein episodic memory is used to optimize the hyperparameters of reinforcement learning algorithms on-the-fly. Unlike other hyperparameter searches, we formulate…

Machine Learning · Computer Science 2021-12-06 Hung Le , Majid Abdolshah , Thommen K. George , Kien Do , Dung Nguyen , Svetha Venkatesh

We present an efficient algorithm for model-free episodic reinforcement learning on large (potentially continuous) state-action spaces. Our algorithm is based on a novel $Q$-learning policy with adaptive data-driven discretization. The…

Machine Learning · Computer Science 2019-12-20 Sean R. Sinclair , Siddhartha Banerjee , Christina Lee Yu

Continual Learning (CL) is an emerging machine learning paradigm that aims to learn from a continuous stream of tasks without forgetting knowledge learned from the previous tasks. To avoid performance decrease caused by forgetting, prior…

Machine Learning · Computer Science 2023-01-02 Soobee Lee , Minindu Weerakoon , Jonghyun Choi , Minjia Zhang , Di Wang , Myeongjae Jeon

This work presents an architecture that generates curiosity-driven goal-directed exploration behaviours for an image sensor of a microfarming robot. A combination of deep neural networks for offline unsupervised learning of low-dimensional…

Artificial Intelligence · Computer Science 2020-06-09 Guido Schillaci , Antonio Pico Villalpando , Verena Vanessa Hafner , Peter Hanappe , David Colliaux , Timothée Wintz

Convolutional Neural Network (CNN) has become the most used method for image classification tasks. During its training the learning rate and the gradient are two key factors to tune for influencing the convergence speed of the model. Usual…

Machine Learning · Computer Science 2020-03-24 Zilong Zhao , Sophie Cerf , Bogdan Robu , Nicolas Marchand

Episodic self-imitation learning, a novel self-imitation algorithm with a trajectory selection module and an adaptive loss function, is proposed to speed up reinforcement learning. Compared to the original self-imitation learning algorithm,…

Artificial Intelligence · Computer Science 2020-11-30 Tianhong Dai , Hengyan Liu , Anil Anthony Bharath

Emotional Support Conversation (ESC) systems are pivotal in providing empathetic interactions, aiding users through negative emotional states by understanding and addressing their unique experiences. In this paper, we tackle two key…

Computation and Language · Computer Science 2024-04-04 Zhe Xu , Daoyuan Chen , Jiayi Kuang , Zihao Yi , Yaliang Li , Ying Shen

Few-shot meta-learning presents a challenge for gradient descent optimization due to the limited number of training samples per task. To address this issue, we propose an episodic memory optimization for meta-learning, we call EMO, which is…

Machine Learning · Computer Science 2023-06-28 Yingjun Du , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

Recent years, the database committee has attempted to develop automatic database management systems. Although some researches show that the applying AI to data management is a significant and promising direction, there still exists many…

Databases · Computer Science 2021-11-23 Yu Yan , Hongzhi Wang , Jian Ma , Jian Geng , Yuzhuo Wang

In continual learning (CL), an agent learns from a stream of tasks leveraging prior experience to transfer knowledge to future tasks. It is an ideal framework to decrease the amount of supervision in the existing learning algorithms. But…

We consider the problem of learning multiple tasks in a continual learning setting in which data from different tasks is presented to the learner in a streaming fashion. A key challenge in this setting is the so-called "catastrophic…

Machine Learning · Computer Science 2023-09-22 Christiaan Lamers , Rene Vidal , Nabil Belbachir , Niki van Stein , Thomas Baeck , Paris Giampouras

Experience replay is widely used to improve learning efficiency in reinforcement learning by leveraging past experiences. However, existing experience replay methods, whether based on uniform or prioritized sampling, often suffer from low…

Machine Learning · Computer Science 2025-05-20 Kaiyan Zhao , Yiming Wang , Yuyang Chen , Yan Li , Leong Hou U , Xiaoguang Niu

Multi-agent reinforcement learning (MARL) algorithms have made promising progress in recent years by leveraging the centralized training and decentralized execution (CTDE) paradigm. However, existing MARL algorithms still suffer from the…

Machine Learning · Computer Science 2021-10-20 Xiao Ma , Wu-Jun Li

We consider scenarios from the real-time strategy game StarCraft as new benchmarks for reinforcement learning algorithms. We propose micromanagement tasks, which present the problem of the short-term, low-level control of army members…

Artificial Intelligence · Computer Science 2016-11-29 Nicolas Usunier , Gabriel Synnaeve , Zeming Lin , Soumith Chintala

Many tasks require flexibly modifying perception and behavior based on current goals. Humans can retrieve episodic memories from days to years ago, using them to contextualize and generalize behaviors across novel but structurally related…

Neural and Evolutionary Computing · Computer Science 2025-12-22 Yicong Zheng , Nora Wolf , Charan Ranganath , Randall C. O'Reilly , Kevin L. McKee