English
Related papers

Related papers: Solving the Catastrophic Forgetting Problem in Gen…

200 papers

Graph contrastive learning (GCL) has achieved remarkable success by following the computer vision paradigm of preserving absolute similarity between augmented views. However, this approach faces fundamental challenges in graphs due to their…

Machine Learning · Computer Science 2025-05-13 Zhiyuan Ning , Pengfei Wang , Ziyue Qiao , Pengyang Wang , Yuanchun Zhou

Novel Class Discovery (NCD) is the problem of trying to discover novel classes in an unlabeled set, given a labeled set of different but related classes. The majority of NCD methods proposed so far only deal with image data, despite tabular…

In continual learning, new categories may be introduced over time, and an ideal learning system should perform well on both the original categories and the new categories. While deep neural nets have achieved resounding success in the…

Machine Learning · Computer Science 2020-11-30 Ke Li , Shichong Peng , Kailas Vodrahalli , Jitendra Malik

Continual Learning (CL) aims to learn new data while remembering previously acquired knowledge. In contrast to CL for image classification, CL for Object Detection faces additional challenges such as the missing annotations problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Riccardo De Monte , Davide Dalle Pezze , Marina Ceccon , Francesco Pasti , Francesco Paissan , Elisabetta Farella , Gian Antonio Susto , Nicola Bellotto

Discovering novel classes in open-world settings is crucial for real-world applications. Traditional explicit representations, such as object descriptors or 3D segmentation maps, are constrained by their discrete, hole-prone, and noisy…

Machine Learning · Computer Science 2025-06-10 Junming Wang , Yi Shi

Modern deep learning models for change detection (CD) often struggle to explicitly represent task-relevant semantic differences. This paper proposes the Latent Difference Guidance (LDGuid) framework that explicitly learns and injects…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jiaxuan Zhao , Ali Bereyhi

Graph contrastive learning (GCL) alleviates the heavy reliance on label information for graph representation learning (GRL) via self-supervised learning schemes. The core idea is to learn by maximising mutual information for similar…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Shirui Pan , Vincent Cs Lee , Yu Zheng , Philip S. Yu

Deep learning models suffer from catastrophic forgetting when being fine-tuned with samples of new classes. This issue becomes even more pronounced when faced with the domain shift between training and testing data. In this paper, we study…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Can Peng , Piotr Koniusz , Kaiyu Guo , Brian C. Lovell , Peyman Moghadam

Generalized Category Discovery is a crucial real-world task. Despite the improved performance on known categories, current methods perform poorly on novel categories. We attribute the poor performance to two reasons: biased knowledge…

Computation and Language · Computer Science 2023-12-29 Wenbin An , Feng Tian , Wenkai Shi , Yan Chen , Yaqiang Wu , Qianying Wang , Ping Chen

On-the-Fly Category Discovery (OCD) aims to recognize known classes while simultaneously discovering emerging novel categories during inference, using supervision only from known classes during offline training. Existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Bohan Zhang , Weidong Tang , Zhixiang Chi , Yi Jin , Zhenbo Li , Yang Wang , Yanan Wu

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Recognizing and differentiating among both familiar and unfamiliar faces is a critical capability for face recognition systems and a key step toward artificial general intelligence (AGI). Motivated by this ability, this paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Yunseok Oh , Dong-Wan Choi

Deep neural networks suffer from catastrophic forgetting when continually learning new concepts. In this paper, we analyze this problem from a data imbalance point of view. We argue that the imbalance between old task and new task data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Leyuan Wang , Liuyu Xiang , Yunlong Wang , Huijia Wu , Zhaofeng He

This work addresses the task of generalized class discovery (GCD) in instance segmentation. The goal is to discover novel classes and obtain a model capable of segmenting instances of both known and novel categories, given labeled and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Cuong Manh Hoang , Yeejin Lee , Byeongkeun Kang

Unsupervised Continual Learning (UCL) is a burgeoning field in machine learning, focusing on enabling neural networks to sequentially learn tasks without explicit label information. Catastrophic Forgetting (CF), where models forget…

Machine Learning · Computer Science 2024-05-30 Mohammadreza Sadeghi , Zihan Wang , Narges Armanfard

Lifelong learning is challenging for deep neural networks due to their susceptibility to catastrophic forgetting. Catastrophic forgetting occurs when a trained network is not able to maintain its ability to accomplish previously learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Mengyao Zhai , Lei Chen , Fred Tung , Jiawei He , Megha Nawhal , Greg Mori

Contrastive learning has gained widespread adoption for retrieval tasks due to its minimal requirement for manual annotations. However, popular training frameworks typically learn from binary (positive/negative) relevance, making them…

Information Retrieval · Computer Science 2025-04-29 Tianyu Zhu , Myong Chol Jung , Jesse Clark

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Traditional Graph Neural Network (GNN), as a graph representation learning method, is constrained by label information. However, Graph Contrastive Learning (GCL) methods, which tackle the label problem effectively, mainly focus on the…

Machine Learning · Computer Science 2023-08-08 Kai Yang , Yuan Liu , Zijuan Zhao , Peijin Ding , Wenqian Zhao

Semi-supervised learning (SSL) is one of the dominant approaches to address the annotation bottleneck of supervised learning. Recent SSL methods can effectively leverage a large repository of unlabeled data to improve performance while…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah