English
Related papers

Related papers: Continual Learning of Feedback-based Molecular Com…

200 papers

Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to…

Machine Learning · Computer Science 2021-10-29 Maciej Wołczyk , Michał Zając , Razvan Pascanu , Łukasz Kuciński , Piotr Miłoś

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Self-supervised models have been shown to produce comparable or better visual representations than their supervised counterparts when trained offline on unlabeled data at scale. However, their efficacy is catastrophically reduced in a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Enrico Fini , Victor G. Turrisi da Costa , Xavier Alameda-Pineda , Elisa Ricci , Karteek Alahari , Julien Mairal

Continual learning (CL) aims to learn a sequence of tasks without forgetting the previously acquired knowledge. However, recent CL advances are restricted to supervised continual learning (SCL) scenarios. Consequently, they are not scalable…

Machine Learning · Computer Science 2022-04-06 Divyam Madaan , Jaehong Yoon , Yuanchun Li , Yunxin Liu , Sung Ju Hwang

One of the objectives of continual learning is to prevent catastrophic forgetting in learning multiple tasks sequentially, and the existing solutions have been driven by the conceptualization of the plasticity-stability dilemma. However,…

Machine Learning · Computer Science 2024-04-16 Seungyub Han , Yeongmo Kim , Taehyun Cho , Jungwoo Lee

Continual Learning (CL) methods aim to enable machine learning models to learn new tasks without catastrophic forgetting of those that have been previously mastered. Existing CL approaches often keep a buffer of previously-seen samples,…

Machine Learning · Computer Science 2022-02-22 Dong Gong , Qingsen Yan , Yuhang Liu , Anton van den Hengel , Javen Qinfeng Shi

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Continual learning~(CL) is a field concerned with learning a series of inter-related task with the tasks typically defined in the sense of either regression or classification. In recent years, CL has been studied extensively when these…

Machine Learning · Computer Science 2023-11-07 Krishnan Raghavan , Prasanna Balaprakash

There has been a growing interest in developing data-driven and in particular deep neural network (DNN) based methods for modern communication tasks. For a few popular tasks such as power control, beamforming, and MIMO detection, these…

Signal Processing · Electrical Eng. & Systems 2021-05-27 Haoran Sun , Wenqiang Pu , Minghe Zhu , Xiao Fu , Tsung-Hui Chang , Mingyi Hong

Biological agents are known to learn many different tasks over the course of their lives, and to be able to revisit previous tasks and behaviors with little to no loss in performance. In contrast, artificial agents are prone to…

Machine Learning · Computer Science 2021-12-16 Ta-Chu Kao , Kristopher T. Jensen , Gido M. van de Ven , Alberto Bernacchia , Guillaume Hennequin

In this study, we explore an emerging research area of Continual Learning for Temporal Sensitive Question Answering (CLTSQA). Previous research has primarily focused on Temporal Sensitive Question Answering (TSQA), often overlooking the…

Computation and Language · Computer Science 2024-07-18 Wanqi Yang , Yunqiu Xu , Yanda Li , Kunze Wang , Binbin Huang , Ling Chen

Continual learning (CL) is essential for deploying large language models (LLMs) in dynamic real-world environments without the need for costly retraining. Recent model merging-based methods have attracted significant attention, but they…

Computation and Language · Computer Science 2025-09-23 Yujie Feng , Jian Li , Xiaoyu Dong , Pengfei Xu , Xiaohui Zhou , Yujia Zhang , Zexin LU , Yasha Wang , Alan Zhao , Xu Chu , Xiao-Ming Wu

Continual learning (CL) enables models to adapt to evolving data streams. A major challenge of CL is catastrophic forgetting, where new knowledge will overwrite previously acquired knowledge. Traditional methods usually retain the past data…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Baocai Yin , Ji Zhao , Huajie Jiang , Ningning Hou , Yongli Hu , Amin Beheshti , Ming-Hsuan Yang , Yuankai Qi

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Semantic communications will play a critical role in enabling goal-oriented services over next-generation wireless systems. However, most prior art in this domain is restricted to specific applications (e.g., text or image), and it does not…

Networking and Internet Architecture · Computer Science 2022-02-16 Mohammad Karimzadeh Farshbafan , Walid Saad , Merouane Debbah

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

Machine Learning · Computer Science 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

We introduce Continual Learning via Neural Pruning (CLNP), a new method aimed at lifelong learning in fixed capacity models based on neuronal model sparsification. In this method, subsequent tasks are trained using the inactive neurons and…

Machine Learning · Computer Science 2019-03-12 Siavash Golkar , Michael Kagan , Kyunghyun Cho

We introduce a new neural network-based continual learning algorithm, dubbed as Uncertainty-regularized Continual Learning (UCL), which builds on traditional Bayesian online learning framework with variational inference. We focus on two…

Machine Learning · Computer Science 2019-11-15 Hongjoon Ahn , Sungmin Cha , Donggyu Lee , Taesup Moon

Foundation Models (FMs) have become the hallmark of modern AI, however, these models are trained on massive data, leading to financially expensive training. Updating FMs as new data becomes available is important, however, can lead to…

Machine Learning · Computer Science 2024-04-22 James Seale Smith , Lazar Valkov , Shaunak Halbe , Vyshnavi Gutta , Rogerio Feris , Zsolt Kira , Leonid Karlinsky

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

Computation and Language · Computer Science 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov