中文
相关论文

相关论文: Continual Task Learning through Adaptive Policy Se…

200 篇论文

Continual Multi-Agent Reinforcement Learning (Co-MARL) requires agents to address catastrophic forgetting issues while learning new coordination policies with the dynamics team. In this paper, we delve into the core of Co-MARL, namely…

多智能体系统 · 计算机科学 2025-07-09 Chang Yao , Youfang Lin , Shoucheng Song , Hao Wu , Yuqing Ma , Shang Han , Kai Lv

Model-based methods have recently shown promising for offline reinforcement learning (RL), aiming to learn good policies from historical data without interacting with the environment. Previous model-based offline RL methods learn fully…

机器学习 · 计算机科学 2022-06-06 Zheng-Mao Zhu , Xiong-Hui Chen , Hong-Long Tian , Kun Zhang , Yang Yu

Scenarios in which restrictions in data transfer and storage limit the possibility to compose a single dataset -- also exploiting different data sources -- to perform a batch-based training procedure, make the development of robust models…

计算机视觉与模式识别 · 计算机科学 2023-07-31 Lorenzo Pellegrini , Guido Borghi , Annalisa Franco , Davide Maltoni

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

机器学习 · 计算机科学 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

The goal of Continual Learning (CL) task is to continuously learn multiple new tasks sequentially while achieving a balance between the plasticity and stability of new and old knowledge. This paper analyzes that this insufficiency arises…

机器学习 · 计算机科学 2024-05-28 Hanxi Xiao , Fan Lyu

Continual Learning (CL) seeks to enable neural networks to incrementally acquire new knowledge (plasticity) while retaining existing knowledge (stability). Although pre-trained models (PTMs) have provided a strong foundation for CL,…

机器学习 · 计算机科学 2026-02-12 Aojun Lu , Tao Feng , Hangjie Yuan , Chunhui Ding , Yanan Sun

Continual learning, also known as lifelong learning or incremental learning, refers to the process by which a model learns from a stream of incoming data over time. A common problem in continual learning is the classification layer's bias…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Haoran Chen , Micah Goldblum , Zuxuan Wu , Yu-Gang Jiang

In real-world environments, continual learning is essential for machine learning models, as they need to acquire new knowledge incrementally without forgetting what they have already learned. While pretrained language models have shown…

机器学习 · 计算机科学 2024-06-28 Mingyang Wang , Heike Adel , Lukas Lange , Jannik Strötgen , Hinrich Schütze

User modeling in large e-commerce platforms aims to optimize user experiences by incorporating various customer activities. Traditional models targeting a single task often focus on specific business metrics, neglecting the comprehensive…

信息检索 · 计算机科学 2025-02-28 Mingdai Yang , Fan Yang , Yanhui Guo , Shaoyuan Xu , Tianchen Zhou , Yetian Chen , Simone Shao , Jia Liu , Yan Gao

Meta-reinforcement learning (RL) methods can meta-train policies that adapt to new tasks with orders of magnitude less data than standard RL, but meta-training itself is costly and time-consuming. If we can meta-train on offline data, then…

机器学习 · 计算机科学 2022-07-08 Vitchyr H. Pong , Ashvin Nair , Laura Smith , Catherine Huang , Sergey Levine

Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpass the behavioral policies, RL-based methods are generally…

机器学习 · 计算机科学 2022-01-13 Minghuan Liu , Hanye Zhao , Zhengyu Yang , Jian Shen , Weinan Zhang , Li Zhao , Tie-Yan Liu

Continual learning (CL) aims to acquire new knowledge while preserving information from previous experiences without forgetting. Though buffer-based methods (i.e., retaining samples from previous tasks) have achieved acceptable performance,…

机器学习 · 计算机科学 2023-11-29 Hossein Rezaei , Mohammad Sabokrou

Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a…

Policy constraint methods in offline reinforcement learning employ additional regularization techniques to constrain the discrepancy between the learned policy and the offline dataset. However, these methods tend to result in overly…

机器学习 · 计算机科学 2024-08-06 Shirong Liu , Chenjia Bai , Zixian Guo , Hao Zhang , Gaurav Sharma , Yang Liu

To accommodate real-world dynamics, artificial intelligence systems need to cope with sequentially arriving content in an online manner. Beyond regular Continual Learning (CL) attempting to address catastrophic forgetting with offline…

机器学习 · 计算机科学 2024-04-02 HongWei Yan , Liyuan Wang , Kaisheng Ma , Yi Zhong

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

机器学习 · 计算机科学 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

Continual Learning (CL) focuses on learning from dynamic and changing data distributions while retaining previously acquired knowledge. Various methods have been developed to address the challenge of catastrophic forgetting, including…

机器学习 · 计算机科学 2024-03-21 Zhenyi Wang , Yan Li , Li Shen , Heng Huang

Online Continual Learning (OCL) is a critical area in machine learning, focusing on enabling models to adapt to evolving data streams in real-time while addressing challenges such as catastrophic forgetting and the stability-plasticity…

Continual learning (CL) addresses the problem of catastrophic forgetting in neural networks, which occurs when a trained model tends to overwrite previously learned information, when presented with a new task. CL aims to instill the…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Shishir Muralidhara , Saqib Bukhari , Georg Schneider , Didier Stricker , René Schuster

In offline reinforcement learning, a policy is learned using a static dataset in the absence of costly feedback from the environment. In contrast to the online setting, only using static datasets poses additional challenges, such as…

机器学习 · 计算机科学 2025-12-16 Marvin Alles , Philip Becker-Ehmck , Patrick van der Smagt , Maximilian Karl