English
Related papers

Related papers: Continual Few-Shot Learning with Adversarial Class…

200 papers

The primary goal of continual learning (CL) task in medical image segmentation field is to solve the "catastrophic forgetting" problem, where the model totally forgets previously learned features when it is extended to new categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Qian Chen , Lei Zhu , Hangzhou He , Xinliang Zhang , Shuang Zeng , Qiushi Ren , Yanye Lu

Meta-learning for few-shot learning allows a machine to leverage previously acquired knowledge as a prior, thus improving the performance on novel tasks with only small amounts of data. However, most mainstream models suffer from…

Machine Learning · Computer Science 2019-11-13 Yadan Luo , Zi Huang , Zheng Zhang , Ziwei Wang , Mahsa Baktashmotlagh , Yang Yang

Adversarial continual learning is effective for continual learning problems because of the presence of feature alignment process generating task-invariant features having low susceptibility to the catastrophic forgetting problem.…

Machine Learning · Computer Science 2022-09-07 Tanmoy Dam , Mahardhika Pratama , MD Meftahul Ferdaus , Sreenatha Anavatti , Hussein Abbas

Continual Learning (CL) algorithms incrementally learn a predictor or representation across multiple sequentially observed tasks. Designing CL algorithms that perform reliably and avoid so-called catastrophic forgetting has proven a…

Machine Learning · Computer Science 2020-06-11 Jeremias Knoblauch , Hisham Husain , Tom Diethe

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

The goal of few-shot classification is to learn a model that can classify novel classes using only a few training examples. Despite the promising results shown by existing meta-learning algorithms in solving the few-shot classification…

Machine Learning · Computer Science 2020-11-03 Shuman Peng , Weilian Song , Martin Ester

Although deep learning performs really well in a wide variety of tasks, it still suffers from catastrophic forgetting -- the tendency of neural networks to forget previously learned information upon learning new tasks where previous data is…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Ankur Singh

Continual learning (CL) aims to empower machine learning models to learn continually from new data, while building upon previously acquired knowledge without forgetting. As models have evolved from small to large pre-trained architectures,…

Machine Learning · Computer Science 2026-03-31 Dianzhi Yu , Xinni Zhang , Yankai Chen , Aiwei Liu , Yifei Zhang , Philip S. Yu , Irwin King

Neural networks are known to suffer from catastrophic forgetting when trained on sequential datasets. While there have been numerous attempts to solve this problem in large-scale supervised classification, little has been done to overcome…

Machine Learning · Computer Science 2021-06-22 Pauching Yap , Hippolyt Ritter , David Barber

Continual learning models allow to learn and adapt to new changes and tasks over time. However, in continual and sequential learning scenarios in which the models are trained using different data with various distributions, neural networks…

Machine Learning · Computer Science 2020-08-17 HongLin Li , Payam Barnaghi , Shirin Enshaeifar , Frieder Ganz

Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Nianzu Ma , Hu Xu , Lei Shu

Few-shot learning remains challenging for meta-learning that learns a learning algorithm (meta-learner) from many related tasks. In this work, we argue that this is due to the lack of a good representation for meta-learning, and propose…

Machine Learning · Computer Science 2018-02-13 Fengwei Zhou , Bin Wu , Zhenguo Li

Image compression emerges as a pivotal tool in the efficient handling and transmission of digital images. Its ability to substantially reduce file size not only facilitates enhanced data storage capacity but also potentially brings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Justin Yang , Zhihao Duan , Andrew Peng , Yuning Huang , Jiangpeng He , Fengqing Zhu

Despite its astounding success in learning deeper multi-dimensional data, the performance of deep learning declines on new unseen tasks mainly due to its focus on same-distribution prediction. Moreover, deep learning is notorious for poor…

Machine Learning · Computer Science 2023-03-15 Hassan Gharoun , Fereshteh Momenifar , Fang Chen , Amir H. Gandomi

Continual learning (CL) aims to empower models to learn new tasks without forgetting previously acquired knowledge. Most prior works concentrate on the techniques of architectures, replay data, regularization, \etc. However, the category…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Bolin Ni , Hongbo Zhao , Chenghao Zhang , Ke Hu , Gaofeng Meng , Zhaoxiang Zhang , Shiming Xiang

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

Machine Learning · Computer Science 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

A continual learning agent should be able to build on top of existing knowledge to learn on new data quickly while minimizing forgetting. Current intelligent systems based on neural network function approximators arguably do the…

Machine Learning · Computer Science 2019-11-01 Khurram Javed , Martha White

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge of old classes. The difficulty lies in that limited data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Chi Zhang , Nan Song , Guosheng Lin , Yun Zheng , Pan Pan , Yinghui Xu

Advanced life forms, sustained by the synergistic interaction of neural cognitive mechanisms, continually acquire and transfer knowledge throughout their lifespan. In contrast, contemporary machine learning paradigms exhibit limitations in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Biqing Qi , Xingquan Chen , Junqi Gao , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou