English
Related papers

Related papers: Few-shot Continual Learning: a Brain-inspired Appr…

200 papers

In this paper, we propose a general framework in continual learning for generative models: Feature-oriented Continual Learning (FoCL). Unlike previous works that aim to solve the catastrophic forgetting problem by introducing regularization…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Qicheng Lao , Mehrzad Mortazavi , Marzieh Tahaei , Francis Dutil , Thomas Fevens , Mohammad Havaei

This paper introduces and studies zero-base generalized few-shot learning (zero-base GFSL), which is an extreme yet practical version of few-shot learning problem. Motivated by the cases where base data is not available due to privacy or…

Machine Learning · Computer Science 2022-12-01 Seong-Woong Kim , Dong-Wan Choi

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

The key issue of few-shot learning is learning to generalize. This paper proposes a large margin principle to improve the generalization capacity of metric based methods for few-shot learning. To realize it, we develop a unified framework…

Machine Learning · Computer Science 2018-09-24 Yong Wang , Xiao-Ming Wu , Qimai Li , Jiatao Gu , Wangmeng Xiang , Lei Zhang , Victor O. K. Li

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Real-world object detection is highly desired to be equipped with the learning expandability that can enlarge its detection classes incrementally. Moreover, such learning from only few annotated training samples further adds the flexibility…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Yiting Li , Haiyue Zhu , Jun Ma , Chek Sing Teo , Cheng Xiang , Prahlad Vadakkepat , Tong Heng Lee

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

Existing research on continual learning of a sequence of tasks focused on dealing with catastrophic forgetting, where the tasks are assumed to be dissimilar and have little shared knowledge. Some work has also been done to transfer…

Machine Learning · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Xingchang Huang

Few-shot class-incremental learning (FSCIL) has addressed challenging real-world scenarios where unseen novel classes continually arrive with few samples. In these scenarios, it is required to develop a model that recognizes the novel…

Machine Learning · Computer Science 2022-06-23 Jaehoon Oh , Se-Young Yun

Existing approaches to few-shot learning in NLP rely on large language models (LLMs) and/or fine-tuning of these to generalise on out-of-distribution data. In this work, we propose a novel few-shot learning approach based on soft-label…

Machine Learning · Computer Science 2024-09-24 Avyav Kumar Singh , Ekaterina Shutova , Helen Yannakoudakis

Few-shot learning (FSL) aims to learn novel visual categories from very few samples, which is a challenging problem in real-world applications. Many methods of few-shot classification work well on general images to learn global…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Xiaojian He , Jinfu Lin , Junming Shen

Few-shot learning and self-supervised learning address different facets of the same problem: how to train a model with little or no labeled data. Few-shot learning aims for optimization methods and models that can learn efficiently to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Spyros Gidaris , Andrei Bursuc , Nikos Komodakis , Patrick Pérez , Matthieu Cord

The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish…

Machine Learning · Computer Science 2017-08-24 Nathan Hilliard , Nathan O. Hodas , Courtney D. Corley

Continual learning requires incremental compatibility with a sequence of tasks. However, the design of model architecture remains an open question: In general, learning all tasks with a shared set of parameters suffers from severe…

Machine Learning · Computer Science 2022-07-15 Liyuan Wang , Xingxing Zhang , Qian Li , Jun Zhu , Yi Zhong

Few-shot learning (FSL) aims at recognizing novel classes given only few training samples, which still remains a great challenge for deep learning. However, humans can easily recognize novel classes with only few samples. A key component of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Yixiong Zou , Shanghang Zhang , Ke Chen , Yonghong Tian , Yaowei Wang , José M. F. Moura

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Few-shot learning is currently enjoying a considerable resurgence of interest, aided by the recent advance of deep learning. Contemporary approaches based on weight-generation scheme delivers a straightforward and flexible solution to the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Mingjiang Liang , Shaoli Huang , Shirui Pan , Mingming Gong , Wei Liu

Continual Learning (CL) methods usually learn from all available data. However, this is not the case in human cognition which efficiently focuses on key experiences while disregarding the redundant information. Similarly, not all data…

Machine Learning · Computer Science 2024-10-24 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Joaquin Vanschoren

Though neural networks have achieved much progress in various applications, it is still highly challenging for them to learn from a continuous stream of tasks without forgetting. Continual learning, a new learning paradigm, aims to solve…

Machine Learning · Computer Science 2019-05-13 Ju Xu , Jin Ma , Zhanxing Zhu

Existing research on continual learning (CL) of a sequence of tasks focuses mainly on dealing with catastrophic forgetting (CF) to balance the learning plasticity of new tasks and the memory stability of old tasks. However, an ideal CL…

Machine Learning · Computer Science 2026-01-12 Zhi Wang , Zhongbin Wu , Yanni Li , Bing Liu , Guangxi Li , Yuping Wang