English
Related papers

Related papers: Solving the Catastrophic Forgetting Problem in Gen…

200 papers

Modern visual recognition models often display overconfidence due to their reliance on complex deep neural networks and one-hot target supervision, resulting in unreliable confidence scores that necessitate calibration. While current…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianshui Chen , Weihang Wang , Tao Pu , Jinghui Qin , Zhijing Yang , Jie Liu , Liang Lin

We consider the problem of learning multiple tasks in a continual learning setting in which data from different tasks is presented to the learner in a streaming fashion. A key challenge in this setting is the so-called "catastrophic…

Machine Learning · Computer Science 2023-09-22 Christiaan Lamers , Rene Vidal , Nabil Belbachir , Niki van Stein , Thomas Baeck , Paris Giampouras

Continual Learning (CL) aims to enable Deep Neural Networks (DNNs) to learn new data without forgetting previously learned knowledge. The key to achieving this goal is to avoid confusion at the feature level, i.e., avoiding confusion within…

Machine Learning · Computer Science 2024-08-07 Shaoxu Cheng , Kanglei Geng , Chiyuan He , Zihuan Qiu , Linfeng Xu , Heqian Qiu , Lanxiao Wang , Qingbo Wu , Fanman Meng , Hongliang Li

Regularization-based methods are beneficial to alleviate the catastrophic forgetting problem in class-incremental learning. With the absence of old task images, they often assume that old knowledge is well preserved if the classifier…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Xiaomeng Xin , Yiran Zhong , Yunzhong Hou , Jinjun Wang , Liang Zheng

Class-Incremental Learning (CIL) aims to train a reliable model with the streaming data, which emerges unknown classes sequentially. Different from traditional closed set learning, CIL has two main challenges: 1) Novel class detection. The…

Machine Learning · Computer Science 2020-09-01 Yang Yang , Zhen-Qiang Sun , HengShu Zhu , Yanjie Fu , Hui Xiong , Jian Yang

Federated learning (FL) has attracted growing attention via data-private collaborative training on decentralized clients. However, most existing methods unrealistically assume object classes of the overall framework are fixed over time. It…

Machine Learning · Computer Science 2022-03-23 Jiahua Dong , Lixu Wang , Zhen Fang , Gan Sun , Shichao Xu , Xiao Wang , Qi Zhu

In this paper, we address the problem of novel class discovery (NCD), which aims to cluster novel classes by leveraging knowledge from disjoint known classes. While recent advances have made significant progress in this area, existing NCD…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Xinhang Wan , Jiyuan Liu , Qian Qu , Suyuan Liu , Chuyu Zhang , Fangdi Wang , Xinwang Liu , En Zhu , Kunlun He

Learning new tasks continuously without forgetting on a constantly changing data distribution is essential for real-world problems but extremely challenging for modern deep learning. In this work we propose HCL, a Hybrid…

In this paper, we tackle the problem of novel visual category discovery, i.e., grouping unlabelled images from new classes into different semantic partitions by leveraging a labelled dataset that contains images from other different but…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Bingchen Zhao , Kai Han

In Novel Class Discovery (NCD), the goal is to find new classes in an unlabeled set given a labeled set of known but different classes. While NCD has recently gained attention from the community, no framework has yet been proposed for…

Continual learning, involving sequential training on diverse tasks, often faces catastrophic forgetting. While knowledge distillation-based approaches exhibit notable success in preventing forgetting, we pinpoint a limitation in their…

Machine Learning · Computer Science 2024-05-17 Zenglin Shi , Pei Liu , Tong Su , Yunpeng Wu , Kuien Liu , Yu Song , Meng Wang

Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Hari Chandana Kuchibhotla , Sumitra S Malagi , Shivam Chandhok , Vineeth N Balasubramanian

Traditional semi-supervised learning tasks assume that both labeled and unlabeled data follow the same class distribution, but the realistic open-world scenarios are of more complexity with unknown novel classes mixed in the unlabeled set.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jiaming Liu , Yangqiming Wang , Tongze Zhang , Yulu Fan , Qinli Yang , Junming Shao

Open set domain recognition has got the attention in recent years. The task aims to specifically classify each sample in the practical unlabeled target domain, which consists of all known classes in the manually labeled source domain and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Xinxing He , Yuan Yuan , Zhiyu Jiang

In the quest for unveiling novel categories at test time, we confront the inherent limitations of traditional supervised recognition models that are restricted by a predefined category set. While strides have been made in the realms of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Sarah Rastegar , Hazel Doughty , Cees G. M. Snoek

In Generalized Zero-Shot Learning (GZSL), we aim to recognize both seen and unseen categories using a model trained only on seen categories. In computer vision, this translates into a classification problem, where knowledge from seen…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 William Heyden , Habib Ullah , M. Salman Siddiqui , Fadi Al Machot

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

Machine Learning · Computer Science 2021-12-09 Shivam Khare , Kun Cao , James Rehg

Task-incremental continual learning refers to continually training a model in a sequence of tasks while overcoming the problem of catastrophic forgetting (CF). The issue arrives for the reason that the learned representations are forgotten…

Machine Learning · Computer Science 2023-05-23 Yun Luo , Xiaotian Lin , Zhen Yang , Fandong Meng , Jie Zhou , Yue Zhang

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

We tackle the problem of novel class discovery, which aims to learn novel classes without supervision based on labeled data from known classes. A key challenge lies in transferring the knowledge in the known-class data to the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Peiyan Gu , Chuyu Zhang , Ruijie Xu , Xuming He