English
Related papers

Related papers: Controllable Forgetting Mechanism for Few-Shot Cla…

200 papers

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning techniques for few-shot learning. It uses gradient descent to learn commonalities between various tasks, enabling the model to learn the meta-initialization of…

Machine Learning · Computer Science 2022-08-18 Lin Ding , Peng Liu , Wenfeng Shen , Weijia Lu , Shengbo Chen

When incrementally trained on new classes, deep neural networks are subject to catastrophic forgetting which leads to an extreme deterioration of their performance on the old classes while learning the new ones. Using a small memory…

Machine Learning · Computer Science 2022-11-15 Quentin Jodelet , Xin Liu , Tsuyoshi Murata

Object detection has achieved substantial progress in the last decade. However, detecting novel classes with only few samples remains challenging, since deep learning under low data regime usually leads to a degraded feature space. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuhang Cao , Jiaqi Wang , Ying Jin , Tong Wu , Kai Chen , Ziwei Liu , Dahua Lin

We consider class incremental learning (CIL) problem, in which a learning agent continuously learns new classes from incrementally arriving training data batches and aims to predict well on all the classes learned so far. The main challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Hongjoon Ahn , Jihwan Kwak , Subin Lim , Hyeonsu Bang , Hyojun Kim , Taesup Moon

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

Machine Learning · Computer Science 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang

Current methods for few-shot segmentation (FSSeg) have mainly focused on improving the performance of novel classes while neglecting the performance of base classes. To overcome this limitation, the task of generalized few-shot semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Weide Liu , Zhonghua Wu , Yang Zhao , Yuming Fang , Chuan-Sheng Foo , Jun Cheng , Guosheng Lin

We observe a high level of imbalance in the accuracy of different classes in the same old task for the first time. This intriguing phenomenon, discovered in replay-based Class Incremental Learning (CIL), highlights the imbalanced forgetting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Shixiong Xu , Gaofeng Meng , Xing Nie , Bolin Ni , Bin Fan , Shiming Xiang

In class-incremental learning, an agent with limited resources needs to learn a sequence of classification tasks, forming an ever growing classification problem, with the constraint of not being able to access data from previous tasks. The…

Machine Learning · Computer Science 2024-05-29 Albin Soutif--Cormerais , Marc Masana , Joost van de Weijer , Bartłomiej Twardowski

Gathering cyber threat intelligence from open sources is becoming increasingly important for maintaining and achieving a high level of security as systems become larger and more complex. However, these open sources are often subject to…

Cryptography and Security · Computer Science 2022-07-25 Markus Bayer , Tobias Frey , Christian Reuter

Few-shot learning (FSL) has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in learning to generalize from a few examples. This paper proposes an adaptive margin principle to improve…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Aoxue Li , Weiran Huang , Xu Lan , Jiashi Feng , Zhenguo Li , Liwei Wang

Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Jie Zhang , Changdi Yang , Zheng Zhan , Pu Zhao , Yanzhi Wang

Learning from large-scale pre-trained models with strong generalization ability has shown remarkable success in a wide range of downstream tasks recently, but it is still underexplored in the challenging few-shot class-incremental learning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Linpu He , Yanan Li , Bingze Li , Elvis Han Cui , Donghui Wang

In this paper, we propose to tackle the challenging few-shot learning (FSL) problem by learning global class representations using both base and novel class training samples. In each training episode, an episodic class mean computed from a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Tiange Luo , Aoxue Li , Tao Xiang , Weiran Huang , Liwei Wang

Currently, the state-of-the-art methods treat few-shot semantic segmentation task as a conditional foreground-background segmentation problem, assuming each class is independent. In this paper, we introduce the concept of meta-class, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhonghua Wu , Xiangxi Shi , Guosheng lin , Jianfei Cai

Few-shot image classification aims at training a model from only a few examples for each of the "novel" classes. This paper proposes the idea of associative alignment for leveraging part of the base data by aligning the novel training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

Deep neural networks are known to suffer the catastrophic forgetting problem, where they tend to forget the knowledge from the previous tasks when sequentially learning new tasks. Such failure hinders the application of deep learning based…

Machine Learning · Computer Science 2018-12-04 Junfeng Wen , Yanshuai Cao , Ruitong Huang

Few-shot segmentation is a task to segment objects or regions of novel classes within an image given only a few annotated examples. In the generalized setting, the task extends to segment both the base and the novel classes. The main…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Steve Andreas Immanuel , Hagai Raja Sinulingga

Although few-shot learning and one-class classification (OCC), i.e., learning a binary classifier with data from only one class, have been separately well studied, their intersection remains rather unexplored. Our work addresses the…

Machine Learning · Computer Science 2021-02-12 Ahmed Frikha , Denis Krompaß , Hans-Georg Köpken , Volker Tresp

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

Machine Learning · Computer Science 2021-12-09 Shivam Khare , Kun Cao , James Rehg