中文
相关论文

相关论文: Rethinking Class-Incremental Learning from a Dynam…

200 篇论文

Continual lifelong learning is essential to many applications. In this paper, we propose a simple but effective approach to continual deep learning. Our approach leverages the principles of deep model compression, critical weights…

机器学习 · 计算机科学 2019-10-31 Steven C. Y. Hung , Cheng-Hao Tu , Cheng-En Wu , Chien-Hung Chen , Yi-Ming Chan , Chu-Song Chen

Deep neural networks are used in many state-of-the-art systems for machine perception. Once a network is trained to do a specific task, e.g., bird classification, it cannot easily be trained to do new tasks, e.g., incrementally learning to…

人工智能 · 计算机科学 2017-11-10 Ronald Kemker , Marc McClure , Angelina Abitino , Tyler Hayes , Christopher Kanan

Recently, many unsupervised deep learning methods have been proposed to learn clustering with unlabelled data. By introducing data augmentation, most of the latest methods look into deep clustering from the perspective that the original…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Huasong Zhong , Chong Chen , Zhongming Jin , Xian-Sheng Hua

In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model's ability to effectively represent prior classes in the…

计算机视觉与模式识别 · 计算机科学 2022-08-17 Arjun Ashok , K J Joseph , Vineeth Balasubramanian

Neural networks tend to gradually forget the previously learned knowledge when learning multiple tasks sequentially from dynamic data distributions. This problem is called \textit{catastrophic forgetting}, which is a fundamental challenge…

计算与语言 · 计算机科学 2022-03-21 Chenze Shao , Yang Feng

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

机器学习 · 计算机科学 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

机器学习 · 计算机科学 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

Generalized category discovery (GCD) is a recently proposed open-world problem, which aims to automatically cluster partially labeled data. The main challenge is that the unlabeled data contain instances that are not only from known…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Nan Pu , Zhun Zhong , Nicu Sebe

Machine unlearning seeks to remove the influence of particular data or class from trained models to meet privacy, legal, or ethical requirements. Existing unlearning methods tend to forget shallowly: phenomenon of an unlearned model pretend…

机器学习 · 计算机科学 2025-07-23 Jaeheun Jung , Bosung Jung , Suhyun Bae , Donghun Lee

The ability to learn different tasks sequentially is essential to the development of artificial intelligence. In general, neural networks lack this capability, the major obstacle being catastrophic forgetting. It occurs when the…

机器学习 · 计算机科学 2021-10-22 Kaustubh Olpadkar , Ekta Gavas

Online Continual Learning (CL) solves the problem of learning the ever-emerging new classification tasks from a continuous data stream. Unlike its offline counterpart, in online CL, the training data can only be seen once. Most existing…

机器学习 · 计算机科学 2024-04-02 Maorong Wang , Nicolas Michel , Ling Xiao , Toshihiko Yamasaki

Human intelligence gradually accepts new information and accumulates knowledge throughout the lifespan. However, deep learning models suffer from a catastrophic forgetting phenomenon, where they forget previous knowledge when acquiring new…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Jisu Han , Jaemin Na , Wonjun Hwang

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

机器学习 · 计算机科学 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

The dynamic nature of open-world scenarios has attracted more attention to class incremental learning (CIL). However, existing CIL methods typically presume the availability of complete ground-truth labels throughout the training process,…

机器学习 · 计算机科学 2024-08-20 Jiaming Liu , Hongyuan Liu , Zhili Qin , Wei Han , Yulu Fan , Qinli Yang , Junming Shao

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Deep neural networks have shown remarkable performance when trained on independent and identically distributed data from a fixed set of classes. However, in real-world scenarios, it can be desirable to train models on a continuous stream of…

机器学习 · 计算机科学 2023-09-04 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher , Toshihiko Yamasaki

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. In this work, we focus on continual text classification under the class-incremental setting. Recent CL studies…

计算与语言 · 计算机科学 2023-05-15 Yifan Song , Peiyi Wang , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

With the wide application of machine learning algorithms to the real world, class imbalance and concept drift have become crucial learning issues. Class imbalance happens when the data categories are not equally represented, i.e., at least…

机器学习 · 计算机科学 2017-08-01 Shuo Wang , Leandro L. Minku , Nitesh Chawla , Xin Yao

The fact that image datasets are often imbalanced poses an intense challenge for deep learning techniques. In this paper, we propose a method to restore the balance in imbalanced images, by coalescing two concurrent methods, generative…

机器学习 · 计算机科学 2020-04-09 Pourya Shamsolmoali , Masoumeh Zareapoor , Linlin Shen , Abdul Hamid Sadka , Jie Yang

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan