中文
相关论文

相关论文: Slightly Shift New Classes to Remember Old Classes…

200 篇论文

We study class-incremental learning, a training setup in which new classes of data are observed over time for the model to learn from. Despite the straightforward problem formulation, the naive application of classification models to…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Ahmet Iscen , Thomas Bird , Mathilde Caron , Alireza Fathi , Cordelia Schmid

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

计算机视觉与模式识别 · 计算机科学 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Non-exemplar class-incremental learning is to recognize both the old and new classes when old class samples cannot be saved. It is a challenging task since representation optimization and feature retention can only be achieved under…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Kai Zhu , Wei Zhai , Yang Cao , Jiebo Luo , Zheng-Jun Zha

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

机器学习 · 计算机科学 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

Incremental or continual learning has been extensively studied for image classification tasks to alleviate catastrophic forgetting, a phenomenon that earlier learned knowledge is forgotten when learning new concepts. For class incremental…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Zekang Zhang , Guangyu Gao , Zhiyuan Fang , Jianbo Jiao , Yunchao Wei

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Incremental learning (IL) suffers from catastrophic forgetting of old tasks when learning new tasks. This can be addressed by replaying previous tasks' data stored in a memory, which however is usually prone to size limits and privacy…

机器学习 · 计算机科学 2023-05-26 Jiangtao Kong , Zhenyu Zong , Tianyi Zhou , Huajie Shao

Incremental few-shot semantic segmentation (IFSS) targets at incrementally expanding model's capacity to segment new class of images supervised by only a few samples. However, features learned on old classes could significantly drift,…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Guangchen Shi , Yirui Wu , Jun Liu , Shaohua Wan , Wenhai Wang , Tong Lu

This work proposes a minimal computational model for learning structured memories of multiple object classes in an incremental setting. Our approach is based on establishing a closed-loop transcription between the classes and a…

计算机视觉与模式识别 · 计算机科学 2023-06-08 Shengbang Tong , Xili Dai , Ziyang Wu , Mingyang Li , Brent Yi , Yi Ma

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

机器学习 · 计算机科学 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model's ability to effectively represent prior classes in the…

计算机视觉与模式识别 · 计算机科学 2022-08-17 Arjun Ashok , K J Joseph , Vineeth Balasubramanian

A fundamental challenge in machine learning today is to build a model that can learn from few examples. Here, we describe a reservoir based spiking neural model for learning to recognize actions with a limited number of labeled videos.…

神经与进化计算 · 计算机科学 2017-10-23 Priyadarshini Panda , Narayan Srinivasa

Humans excel at lifelong learning, as the brain has evolved to be robust to distribution shifts and noise in our ever-changing environment. Deep neural networks (DNNs), however, exhibit catastrophic forgetting and the learned…

机器学习 · 计算机科学 2023-02-23 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Despite the outstanding performance in many individual tasks, deep neural networks suffer from catastrophic forgetting when learning from continuous data streams in real-world scenarios. Current Non-Exemplar Class-Incremental Learning…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Liang Bai , Hong Song , Yucong Lin , Tianyu Fu , Deqiang Xiao , Danni Ai , Jingfan Fan , Jian Yang

Exemplar-based class-incremental learning is to recognize new classes while not forgetting old ones, whose samples can only be saved in limited memory. The ratio fluctuation of new samples to old exemplars, which is caused by the variation…

计算机视觉与模式识别 · 计算机科学 2022-02-22 Zhiheng Liu , Kai Zhu , Yang Cao

Incremental learning is a form of online learning. Incremental learning can modify the parameters and structure of the deep learning model so that the model does not forget the old knowledge while learning new knowledge. Preventing…

计算机视觉与模式识别 · 计算机科学 2020-10-12 Sheng Ren , Yan He , Neal N. Xiong , Kehua Guo

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

机器学习 · 计算机科学 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge of old classes. The difficulty lies in that limited data…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Chi Zhang , Nan Song , Guosheng Lin , Yun Zheng , Pan Pan , Yinghui Xu

In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new data,…

机器学习 · 计算机科学 2022-05-03 Lucas Caccia , Rahaf Aljundi , Nader Asadi , Tinne Tuytelaars , Joelle Pineau , Eugene Belilovsky

In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new data,…

机器学习 · 计算机科学 2022-04-26 Lucas Caccia , Rahaf Aljundi , Nader Asadi , Tinne Tuytelaars , Joelle Pineau , Eugene Belilovsky