English
Related papers

Related papers: Dual Consolidation for Pre-Trained Model-Based Dom…

200 papers

This paper focuses on Federated Domain-Incremental Learning (FDIL) where each client continues to learn incremental tasks where their domain shifts from each other. We propose a novel adaptive knowledge matching-based personalized FDIL…

Machine Learning · Computer Science 2024-07-19 Yichen Li , Wenchao Xu , Haozhao Wang , Ruixuan Li , Yining Qi , Jingcai Guo

Multimodal recommendation focuses primarily on effectively exploiting both behavioral and multimodal information for the recommendation task. However, most existing models suffer from the following issues when fusing information from two…

Information Retrieval · Computer Science 2024-09-10 Kangning Zhang , Yingjie Qin , Jiarui Jin , Yifan Liu , Ruilong Su , Weinan Zhang , Yong Yu

The dynamic expansion architecture is becoming popular in class incremental learning, mainly due to its advantages in alleviating catastrophic forgetting. However, task confusion is not well assessed within this framework, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Bingchen Huang , Zhineng Chen , Peng Zhou , Jiayin Chen , Zuxuan Wu

Class-incremental learning (CIL) aims to train a model to learn new classes from non-stationary data streams without forgetting old ones. In this paper, we propose a new kind of connectionist model by tailoring neural unit dynamics that…

Machine Learning · Computer Science 2024-06-05 Depeng Li , Tianqi Wang , Junwei Chen , Wei Dai , Zhigang Zeng

Domain incremental learning aims to adapt to a sequence of domains with access to only a small subset of data (i.e., memory) from previous domains. Various methods have been proposed for this problem, but it is still unclear how they are…

Machine Learning · Computer Science 2023-10-20 Haizhou Shi , Hao Wang

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Improving the reasoning capabilities of large language models (LLMs) typically relies either on the model's ability to sample a correct solution to be reinforced or on the existence of a stronger model able to solve the problem. However,…

Machine Learning · Computer Science 2026-02-03 Ethan Mendes , Jungsoo Park , Alan Ritter

This paper studies continual learning (CL) of a sequence of aspect sentiment classification(ASC) tasks in a particular CL setting called domain incremental learning (DIL). Each task is from a different domain or product. The DIL setting is…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Hu Xu , Lei Shu

To adapt effectively to dynamic real-world environments, intelligent systems must continually acquire new skills while generalizing them to diverse, unseen scenarios. Here, we introduce a novel and realistic setting named domain…

Machine Learning · Computer Science 2025-10-21 Hongwei Yan , Guanglong Sun , Zhiqi Kang , Yi Zhong , Liyuan Wang

Class Incremental Learning (CIL) aims to handle the scenario where data of novel classes occur continuously and sequentially. The model should recognize the sequential novel classes while alleviating the catastrophic forgetting. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Xiaoshuang Chen , Zhongyi Sun , Ke Yan , Shouhong Ding , Hongtao Lu

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Class-incremental learning (CIL) in medical image-guided diagnosis requires retaining prior diagnostic knowledge while adapting to newly emerging disease categories, which is critical for scalable clinical deployment. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xinyao Wu , Zhe Xu , Cheng Chen , Jiawei Ma , Yefeng Zheng , Raymond Kai-yu Tong

Incremental learning (IL) aims to overcome catastrophic forgetting of previous tasks while learning new ones. Existing IL methods make strong assumptions that the incoming task type will either only increases new classes or domains (i.e.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Sheng Luo , Yi Zhou , Tao Zhou

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jiawei Zhan , Jun Liu , Jinlong Peng , Xiaochen Chen , Bin-Bin Gao , Yong Liu , Chengjie Wang

This paper proposes two novel knowledge transfer techniques for class-incremental learning (CIL). First, we propose data-free generative replay (DF-GR) to mitigate catastrophic forgetting in CIL by using synthetic samples from a generative…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Yoojin Choi , Mostafa El-Khamy , Jungwon Lee

Generating large-scale synthetic data in simulation is a feasible alternative to collecting/labelling real data for training vision-based deep learning models, albeit the modelling inaccuracies do not generalize to the physical world. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Ajay Kumar Tanwani

Class-incremental learning (CIL) has been widely studied under the setting of starting from a small number of classes (base classes). Instead, we explore an understudied real-world setting of CIL that starts with a strong model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Tz-Ying Wu , Gurumurthy Swaminathan , Zhizhong Li , Avinash Ravichandran , Nuno Vasconcelos , Rahul Bhotika , Stefano Soatto

Multiple instance learning (MIL) was a weakly supervised learning approach that sought to assign binary class labels to collections of instances known as bags. However, due to their weak supervision nature, the MIL methods were susceptible…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Wenhui Zhu , Peijie Qiu , Xiwen Chen , Oana M. Dumitrascu , Yalin Wang

Class-incremental Learning (CIL) enables the model to incrementally absorb knowledge from new classes and build a generic classifier across all previously encountered classes. When the model optimizes with new classes, the knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Juncen Guo , Xiaoguang Zhu , Liangyu Teng , Hao Yang , Jing Liu , Yang Liu , Liang Song