中文
相关论文

相关论文: Dense Network Expansion for Class Incremental Lear…

200 篇论文

Incremental Learning (IL) is an interesting AI problem when the algorithm is assumed to work on a budget. This is especially true when IL is modeled using a deep learning approach, where two com- plex challenges arise due to limited memory,…

计算机视觉与模式识别 · 计算机科学 2018-08-21 Eden Belouadah , Adrian Popescu

The dynamic nature of open-world scenarios has attracted more attention to class incremental learning (CIL). However, existing CIL methods typically presume the availability of complete ground-truth labels throughout the training process,…

机器学习 · 计算机科学 2024-08-20 Jiaming Liu , Hongyuan Liu , Zhili Qin , Wei Han , Yulu Fan , Qinli Yang , Junming Shao

Inspired by the human brain's ability to adapt to new tasks without erasing prior knowledge, we develop spiking neural networks (SNNs) with dynamic structures for Class Incremental Learning (CIL). Our comparative experiments reveal that…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Wenyao Ni , Jiangrong Shen , Qi Xu , Huajin Tang

Class-incremental learning (CIL) aims to enable models to continuously learn new classes while overcoming catastrophic forgetting. The introduction of pre-trained models has brought new tuning paradigms to CIL. In this paper, we revisit…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Qinhao Zhou , Yuwen Tan , Boqing Gong , Xiang Xiang

The problem of continual learning has attracted rising attention in recent years. However, few works have questioned the commonly used learning setup, based on a task curriculum of random class. This differs significantly from human…

机器学习 · 计算机科学 2023-04-13 Yuzhao Chen , Zonghuan Li , Zhiyuan Hu , Nuno Vasconcelos

It is common to have continuous streams of new data that need to be introduced in the system in real-world applications. The model needs to learn newly added capabilities (future tasks) while retaining the old knowledge (past tasks).…

人工智能 · 计算机科学 2022-05-24 Md Sazzad Hossain , Pritom Saha , Townim Faisal Chowdhury , Shafin Rahman , Fuad Rahman , Nabeel Mohammed

We address the problem of class incremental learning, which is a core step towards achieving adaptive vision intelligence. In particular, we consider the task setting of incremental learning with limited memory and aim to achieve better…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Shipeng Yan , Jiangwei Xie , Xuming He

Task-incremental learning involves the challenging problem of learning new tasks continually, without forgetting past knowledge. Many approaches address the problem by expanding the structure of a shared neural network as tasks arrive, but…

机器学习 · 计算机科学 2020-11-24 Azhar Shaikh , Nishant Sinha

Although well-trained deep neural networks have shown remarkable performance on numerous tasks, they rapidly forget what they have learned as soon as they begin to learn with additional data with the previous data stop being provided. In…

计算机视觉与模式识别 · 计算机科学 2020-10-30 Byungju Kim , Jaeyoung Lee , Kyungsu Kim , Sungjin Kim , Junmo Kim

Continual Learning is an unresolved challenge, whose relevance increases when considering modern applications. Unlike the human brain, trained deep neural networks suffer from a phenomenon called catastrophic forgetting, wherein they…

机器学习 · 计算机科学 2025-02-18 Shahar Shaul-Ariel , Daphna Weinshall

Incremental Learning (IL) aims to accumulate knowledge from sequential input tasks while overcoming catastrophic forgetting. Existing IL methods typically assume that an incoming task has only increments of classes or domains, referred to…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Min-Yeong Park , Jae-Ho Lee , Gyeong-Moon Park

NeuroEvolution (NE) methods are known for applying Evolutionary Computation to the optimisation of Artificial Neural Networks(ANNs). Despite aiding non-expert users to design and train ANNs, the vast majority of NE approaches disregard the…

神经与进化计算 · 计算机科学 2020-04-02 Filipe Assunção , Nuno Lourenço , Bernardete Ribeiro , Penousal Machado

In class-incremental learning, a model learns continuously from a sequential data stream in which new classes occur. Existing methods often rely on static architectures that are manually crafted. These methods can be prone to capacity…

机器学习 · 计算机科学 2019-09-17 Shenyang Huang , Vincent François-Lavet , Guillaume Rabusseau

In class incremental learning (CIL) a model must learn new classes in a sequential manner without forgetting old ones. However, conventional CIL methods consider a balanced distribution for each new task, which ignores the prevalence of…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Xialei Liu , Yu-Song Hu , Xu-Sheng Cao , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zichong Meng , Jie Zhang , Changdi Yang , Zheng Zhan , Pu Zhao , Yanzhi Wang

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

机器学习 · 计算机科学 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL settings, class incremental learning (CIL) and task incremental learning (TIL). A major challenge of CL is catastrophic forgetting (CF). While a…

机器学习 · 计算机科学 2022-11-07 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Zixuan Ke , Bing Liu

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the…

机器学习 · 计算机科学 2025-03-19 Guannan Lai , Yujie Li , Xiangkun Wang , Junbo Zhang , Tianrui Li , Xin Yang

Real-world applications require the classification model to adapt to new classes without forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a model with limited memory size to meet this requirement. Typical…

机器学习 · 计算机科学 2023-02-17 Da-Wei Zhou , Qi-Wei Wang , Han-Jia Ye , De-Chuan Zhan