English
Related papers

Related papers: Continual Learning for Visual Search with Backward…

200 papers

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Continual learning (CL) enables models to adapt to new tasks and environments without forgetting previously learned knowledge. While current CL setups have ignored the relationship between labels in the past task and the new task with or…

Machine Learning · Computer Science 2023-08-29 Byung Hyun Lee , Okchul Jung , Jonghyun Choi , Se Young Chun

Continual learning (CL) is widely regarded as crucial challenge for lifelong AI. However, existing CL benchmarks, e.g. Permuted-MNIST and Split-CIFAR, make use of artificial temporal variation and do not align with or generalize to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhiqiu Lin , Jia Shi , Deepak Pathak , Deva Ramanan

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Deep neural networks, despite their remarkable success, remain fundamentally limited in their ability to perform Continual Learning (CL). While most current methods aim to enhance the capabilities of a single model, Inspired by the…

Machine Learning · Computer Science 2025-08-01 Aojun Lu , Junchao Ke , Chunhui Ding , Jiahao Fan , Jiancheng Lv , Yanan Sun

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

Machine Learning · Computer Science 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

Continual learning (CL) is under-explored in the video domain. The few existing works contain splits with imbalanced class distributions over the tasks, or study the problem in unsuitable datasets. We introduce vCLIMB, a novel video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Andrés Villa , Kumail Alhamoud , Juan León Alcázar , Fabian Caba Heilbron , Victor Escorcia , Bernard Ghanem

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

We propose a novel framework and a solution to tackle the continual learning (CL) problem with changing network architectures. Most CL methods focus on adapting a single architecture to a new task/class by modifying its weights. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Divyam Madaan , Hongxu Yin , Wonmin Byeon , Jan Kautz , Pavlo Molchanov

Continual Learning (CL) aims to sequentially train models on streams of incoming data that vary in distribution by preserving previous knowledge while adapting to new data. Current CL literature focuses on restricted access to previously…

During the last few years, continual learning (CL) strategies for image classification and segmentation have been widely investigated designing innovative solutions to tackle catastrophic forgetting, like knowledge distillation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Elena Camuffo , Simone Milani

Continual learning (CL) studies the problem of learning a sequence of tasks, one at a time, such that the learning of each new task does not lead to the deterioration in performance on the previously seen ones while exploiting previously…

Machine Learning · Computer Science 2020-11-03 Ammar Shaker , Francesco Alesiani , Shujian Yu , Wenzhe Yin

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Continual Learning (CL) focuses on learning from dynamic and changing data distributions while retaining previously acquired knowledge. Various methods have been developed to address the challenge of catastrophic forgetting, including…

Machine Learning · Computer Science 2024-03-21 Zhenyi Wang , Yan Li , Li Shen , Heng Huang

Continual learning (CL) studies how models acquire tasks sequentially while retaining previously learned knowledge. Despite substantial progress in benchmarking CL methods, comparative evaluations typically keep the fine-tuning regime…

Machine Learning · Computer Science 2026-04-28 Paul-Tiberiu Iordache , Elena Burceanu

Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously…

Computation and Language · Computer Science 2021-01-11 Magdalena Biesialska , Katarzyna Biesialska , Marta R. Costa-jussà

Continual learning in online scenario aims to learn a sequence of new tasks from data stream using each data only once for training, which is more realistic than in offline mode assuming data from new task are all available. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiangpeng He , Fengqing Zhu

Multi-view learning (MVL) has gained great success in integrating information from multiple perspectives of a dataset to improve downstream task performance. To make MVL methods more practical in an open-ended environment, this paper…

Machine Learning · Computer Science 2023-10-16 Depeng Li , Tianqi Wang , Junwei Chen , Kenji Kawaguchi , Cheng Lian , Zhigang Zeng

Medical imaging analysis has witnessed remarkable advancements even surpassing human-level performance in recent years, driven by the rapid development of advanced deep-learning algorithms. However, when the inference dataset slightly…

Image and Video Processing · Electrical Eng. & Systems 2024-10-11 Pratibha Kumari , Joohi Chauhan , Afshin Bozorgpour , Boqiang Huang , Reza Azad , Dorit Merhof

Current Multilingual ASR models only support a fraction of the world's languages. Continual Learning (CL) aims to tackle this problem by adding new languages to pre-trained models while avoiding the loss of performance on existing…

Computation and Language · Computer Science 2025-01-15 Chin Yuen Kwok , Jia Qi Yip , Eng Siong Chng