中文
相关论文

相关论文: Combining Past, Present and Future: A Self-Supervi…

200 篇论文

Class incremental learning (CIL) aims to recognize both the old and new classes along the increment tasks. Deep neural networks in CIL suffer from catastrophic forgetting and some approaches rely on saving exemplars from previous tasks,…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Xiuwei Chen , Xiaobin Chang

Traditional machine learning systems are deployed under the closed-world setting, which requires the entire training data before the offline training process. However, real-world applications often face the incoming new classes, and a model…

机器学习 · 计算机科学 2022-10-27 Da-Wei Zhou , Fu-Yun Wang , Han-Jia Ye , De-Chuan Zhan

We formulate a unifying framework for unsupervised continual learning (UCL), which disentangles learning objectives that are specific to the present and the past data, encompassing stability, plasticity, and cross-task consolidation. The…

机器学习 · 计算机科学 2024-08-13 Yipeng Zhang , Laurent Charlin , Richard Zemel , Mengye Ren

The key challenge of cross-modal domain-incremental learning (DIL) is to enable the learning model to continuously learn from novel data with different feature distributions under the same task without forgetting old ones. However, existing…

计算与语言 · 计算机科学 2024-08-05 Yu Feng , Zhen Tian , Yifan Zhu , Zongfu Han , Haoran Luo , Guangwei Zhang , Meina Song

Different from fine-tuning models pre-trained on a large-scale dataset of preset classes, class-incremental learning (CIL) aims to recognize novel classes over time without forgetting pre-trained classes. However, a given model will be…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Xiang Xiang , Yuwen Tan , Qian Wan , Jing Ma

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

机器学习 · 计算机科学 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Class-Incremental Learning (CIL) enables models to continuously integrate new knowledge while mitigating catastrophic forgetting. Driven by the remarkable generalization of CLIP, leveraging pre-trained vision-language models has become a…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Hao Sun , Zi-Jun Ding , Da-Wei Zhou

Lifelong or continual learning remains to be a challenge for artificial neural network, as it is required to be both stable for preservation of old knowledge and plastic for acquisition of new knowledge. It is common to see previous…

机器学习 · 计算机科学 2020-10-08 Song Zhang , Gehui Shen , Jinsong Huang , Zhi-Hong Deng

New classes arise frequently in our ever-changing world, e.g., emerging topics in social media and new types of products in e-commerce. A model should recognize new classes and meanwhile maintain discriminability over old classes. Under…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Da-Wei Zhou , Han-Jia Ye , Liang Ma , Di Xie , Shiliang Pu , De-Chuan Zhan

Class-incremental learning (CIL) aims to train a classification model while the number of classes increases phase-by-phase. An inherent challenge of CIL is the stability-plasticity tradeoff, i.e., CIL models should keep stable to retain old…

机器学习 · 计算机科学 2023-06-30 Yaoyao Liu , Yingying Li , Bernt Schiele , Qianru Sun

The ability to incrementally learn new classes is crucial to the development of real-world artificial intelligence systems. In this paper, we focus on a challenging but practical few-shot class-incremental learning (FSCIL) problem. FSCIL…

计算机视觉与模式识别 · 计算机科学 2020-04-27 Xiaoyu Tao , Xiaopeng Hong , Xinyuan Chang , Songlin Dong , Xing Wei , Yihong Gong

Class-incremental learning (CIL) has emerged as a means to learn new classes incrementally without catastrophic forgetting of previous classes. Recently, CIL has undergone a paradigm shift towards dynamic architectures due to their superior…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Sunyuan Qiang , Yanyan Liang , Jun Wan , Du Zhang

Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Mingli Zhu , Zihao Zhu , Sihong Chen , Chen Chen , Baoyuan Wu

Domain-Incremental Learning (DIL) involves the progressive adaptation of a model to new concepts across different domains. While recent advances in pre-trained models provide a solid foundation for DIL, learning new concepts often results…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Da-Wei Zhou , Zi-Wen Cai , Han-Jia Ye , Lijun Zhang , De-Chuan Zhan

This paper proposes two novel knowledge transfer techniques for class-incremental learning (CIL). First, we propose data-free generative replay (DF-GR) to mitigate catastrophic forgetting in CIL by using synthetic samples from a generative…

计算机视觉与模式识别 · 计算机科学 2021-06-21 Yoojin Choi , Mostafa El-Khamy , Jungwon Lee

In incremental object detection, knowledge distillation has been proven to be an effective way to alleviate catastrophic forgetting. However, previous works focused on preserving the knowledge of old models, ignoring that images could…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Qijie Mo , Yipeng Gao , Shenghao Fu , Junkai Yan , Ancong Wu , Wei-Shi Zheng

We consider class incremental learning (CIL) problem, in which a learning agent continuously learns new classes from incrementally arriving training data batches and aims to predict well on all the classes learned so far. The main challenge…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Hongjoon Ahn , Jihwan Kwak , Subin Lim , Hyeonsu Bang , Hyojun Kim , Taesup Moon

Rehearsal approaches in class incremental learning (CIL) suffer from decision boundary overfitting to new classes, which is mainly caused by two factors: insufficiency of old classes data for knowledge distillation and imbalanced data…

机器学习 · 计算机科学 2024-09-27 Kunchi Li , Jun Wan , Shan Yu

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vision inspired our SED-tailored method, addressing the unique…

音频与语音处理 · 电气工程与系统科学 2025-01-14 Yang Xiao , Rohan Kumar Das

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

机器学习 · 计算机科学 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau