English
Related papers

Related papers: Multi-granularity Knowledge Transfer for Continual…

200 papers

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

Machine Learning · Computer Science 2025-04-03 Llewyn Salt , Marcus Gallagher

Curriculum learning in reinforcement learning is a training methodology that seeks to speed up learning of a difficult target task, by first training on a series of simpler tasks and transferring the knowledge acquired to the target task.…

Machine Learning · Computer Science 2019-09-17 Sanmit Narvekar , Peter Stone

Continual learning (CL) has two main objectives: preventing catastrophic forgetting (CF) and encouraging knowledge transfer (KT). The existing literature mainly focused on overcoming CF. Some work has also been done on KT when the tasks are…

Computation and Language · Computer Science 2023-10-17 Zixuan Ke , Bing Liu , Wenhan Xiong , Asli Celikyilmaz , Haoran Li

This paper introduces Meta-Q-Learning (MQL), a new off-policy algorithm for meta-Reinforcement Learning (meta-RL). MQL builds upon three simple ideas. First, we show that Q-learning is competitive with state-of-the-art meta-RL algorithms if…

Machine Learning · Computer Science 2020-04-07 Rasool Fakoor , Pratik Chaudhari , Stefano Soatto , Alexander J. Smola

Multi-Task Reinforcement Learning (MTRL) tackles the long-standing problem of endowing agents with skills that generalize across a variety of problems. To this end, sharing representations plays a fundamental role in capturing both unique…

Machine Learning · Computer Science 2024-05-07 Ahmed Hendawy , Jan Peters , Carlo D'Eramo

Personalized Federated Continual Learning (PFCL) is a new practical scenario that poses greater challenges in sharing and personalizing knowledge. PFCL not only relies on knowledge fusion for server aggregation at the global…

Machine Learning · Computer Science 2024-07-02 Hao Yu , Xin Yang , Xin Gao , Yan Kang , Hao Wang , Junbo Zhang , Tianrui Li

The size and the computational load of fine-tuning large-scale pre-trained neural network are becoming two major obstacles in adopting machine learning in many applications. Continual learning (CL) can serve as a remedy through enabling…

Machine Learning · Computer Science 2023-03-28 Yuliang Cai , Jesse Thomason , Mohammad Rostami

In deductive domains, three metacognitive knowledge types in ascending order are declarative, procedural, and conditional learning. This work leverages Deep Reinforcement Learning (DRL) in providing adaptive metacognitive interventions to…

Computers and Society · Computer Science 2023-04-25 Mark Abdelshiheed , John Wesley Hostetter , Tiffany Barnes , Min Chi

Humans have the ability to reuse previously learned policies to solve new tasks quickly, and reinforcement learning (RL) agents can do the same by transferring knowledge from source policies to a related target task. Transfer RL methods can…

Machine Learning · Computer Science 2023-08-16 Siyuan Li , Hao Li , Jin Zhang , Zhen Wang , Peng Liu , Chongjie Zhang

Deep reinforcement learning (DRL) has been increasingly employed to handle the dynamic and complex resource management in network slicing. The deployment of DRL policies in real networks, however, is complicated by heterogeneous cell…

Networking and Internet Architecture · Computer Science 2023-06-26 Tianlun Hu , Qi Liao , Qiang Liu , Georg Carle

Multi-Task Learning (MTL) in Neural Combinatorial Optimization (NCO) is a promising approach to train a unified model capable of solving multiple Vehicle Routing Problem (VRP) variants. However, existing Reinforcement Learning (RL)-based…

Machine Learning · Computer Science 2025-11-05 Yuepeng Zheng , Fu Luo , Zhenkun Wang , Yaoxin Wu , Yu Zhou

Deep reinforcement learning has demonstrated superhuman performance in complex decision-making tasks, but it struggles with generalization and knowledge reuse - key aspects of true intelligence. This article introduces a novel approach that…

Machine Learning · Computer Science 2024-11-12 Marko Ruman , Tatiana V. Guy

Inspired by the human learning and memory system, particularly the interplay between the hippocampus and cerebral cortex, this study proposes a dual-learner framework comprising a fast learner and a meta learner to address continual…

Machine Learning · Computer Science 2026-03-03 Ke Sun , Hongming Zhang , Jun Jin , Chao Gao , Xi Chen , Wulong Liu , Linglong Kong

Reinforcement learning (RL) is frequently used to increase performance in text generation tasks, including machine translation (MT), notably through the use of Minimum Risk Training (MRT) and Generative Adversarial Networks (GAN). However,…

Computation and Language · Computer Science 2020-01-16 Leshem Choshen , Lior Fox , Zohar Aizenbud , Omri Abend

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning…

Machine Learning · Computer Science 2026-03-11 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Continuously learning new tasks using high-level ideas or knowledge is a key capability of humans. In this paper, we propose Lifelong reinforcement learning with Sequential linear temporal logic formulas and Reward Machines (LSRM), which…

Artificial Intelligence · Computer Science 2021-11-19 Xuejing Zheng , Chao Yu , Chen Chen , Jianye Hao , Hankz Hankui Zhuo

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

Computation and Language · Computer Science 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Modern NLP applications have enjoyed a great boost utilizing neural networks models. Such deep neural models, however, are not applicable to most human languages due to the lack of annotated training data for various NLP tasks.…

Computation and Language · Computer Science 2019-06-06 Xilun Chen , Ahmed Hassan Awadallah , Hany Hassan , Wei Wang , Claire Cardie

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Learning multiple tasks sequentially without forgetting previous knowledge, called Continual Learning(CL), remains a long-standing challenge for neural networks. Most existing methods rely on additional network capacity or data replay. In…

Machine Learning · Computer Science 2022-02-01 Hao Liu , Huaping Liu