English
Related papers

Related papers: Improving Open-world Continual Learning under the …

200 papers

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited…

Machine Learning · Computer Science 2020-11-18 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Most recent few-shot learning approaches are based on meta-learning with episodic training. However, prior studies encounter two crucial problems: (1) \textit{the presence of inductive bias}, and (2) \textit{the occurrence of catastrophic…

Multimedia · Computer Science 2024-09-18 Bingzhi Chen , Haoming Zhou , Yishu Liu , Biqing Zeng , Jiahui Pan , Guangming Lu

We propose a novel approach for class incremental online learning in a limited data setting. This problem setting is challenging because of the following constraints: (1) Classes are given incrementally, which necessitates a class…

Machine Learning · Computer Science 2021-06-15 Mohammed Asad Karim , Vinay Kumar Verma , Pravendra Singh , Vinay Namboodiri , Piyush Rai

Graph class-incremental learning (GCIL) allows graph neural networks (GNNs) to adapt to evolving graph analytical tasks by incrementally learning new class knowledge while retaining knowledge of old classes. Existing GCIL methods primarily…

Machine Learning · Computer Science 2025-07-24 Jiazhen Chen , Zheng Ma , Sichao Fu , Mingbin Feng , Tony S. Wirjanto , Weihua Ou

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

Model agnostic meta-learning algorithms aim to infer priors from several observed tasks that can then be used to adapt to a new task with few examples. Given the inherent diversity of tasks arising in existing benchmarks, recent methods use…

Machine Learning · Computer Science 2022-07-26 Rakshith Subramanyam , Mark Heimann , Jayram Thathachar , Rushil Anirudh , Jayaraman J. Thiagarajan

In-context Learning (ICL) is an emerging few-shot learning paradigm on Language Models (LMs) with inner mechanisms un-explored. There are already existing works describing the inner processing of ICL, while they struggle to capture all the…

Computation and Language · Computer Science 2025-02-21 Hakaze Cho , Mariko Kato , Yoshihiro Sakai , Naoya Inoue

Large deep learning models are impressive, but they struggle when real-time data is not available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for deep neural networks to learn new tasks from just a few labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Songsong Tian , Lusi Li , Weijun Li , Hang Ran , Xin Ning , Prayag Tiwari

Few-shot object detection, learning to adapt to the novel classes with a few labeled data, is an imperative and long-lasting problem due to the inherent long-tail distribution of real-world data and the urgent demands to cut costs of data…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Leng Jiaxu , Chen Taiyue , Gao Xinbo , Yu Yongtao , Wang Ye , Gao Feng , Wang Yue

Aiming to incrementally learn new classes with only few samples while preserving the knowledge of base (old) classes, few-shot class-incremental learning (FSCIL) faces several challenges, such as overfitting and catastrophic forgetting.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Junghun Oh , Sungyong Baik , Kyoung Mu Lee

In-context learning (ICL) empowers large language models (LLMs) to perform diverse tasks in underrepresented languages using only short in-context information, offering a crucial avenue for narrowing the gap between high-resource and…

Computation and Language · Computer Science 2024-06-26 Samuel Cahyawijaya , Holy Lovenia , Pascale Fung

In Few-Shot Learning (FSL), models are trained to recognise unseen objects from a query set, given a few labelled examples from a support set. In standard FSL, models are evaluated on query instances sampled from the same class distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mateusz Ochal , Massimiliano Patacchiola , Malik Boudiaf , Sen Wang

Learning under a continuously changing data distribution with incorrect labels is a desirable real-world problem yet challenging. A large body of continual learning (CL) methods, however, assumes data streams with clean labels, and online…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jihwan Bang , Hyunseo Koh , Seulki Park , Hwanjun Song , Jung-Woo Ha , Jonghyun Choi

Even with the luxury of having abundant data, multi-label classification is widely known to be a challenging task to address. This work targets the problem of multi-label meta-learning, where a model learns to predict multiple labels within…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Christian Simon , Piotr Koniusz , Mehrtash Harandi

Online Continual learning is a challenging learning scenario where the model must learn from a non-stationary stream of data where each sample is seen only once. The main challenge is to incrementally learn while avoiding catastrophic…

Machine Learning · Computer Science 2022-06-24 Mattia Sangermano , Antonio Carta , Andrea Cossu , Davide Bacciu

The complexity of learning problems, such as Generative Adversarial Network (GAN) and its variants, multi-task and meta-learning, hyper-parameter learning, and a variety of real-world vision applications, demands a deeper understanding of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Risheng Liu , Jiaxin Gao , Xuan Liu , Xin Fan

Few-shot classification aims at classifying categories of a novel task by learning from just a few (typically, 1 to 5) labelled examples. An effective approach to few-shot classification involves a prior model trained on a large-sample base…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Rajshekhar Das , Yu-Xiong Wang , JoséM. F. Moura

In this paper, we consider a real-world scenario where a model that is trained on pre-defined classes continually encounters unlabeled data that contains both known and novel classes. The goal is to continually discover novel classes while…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Yanan Wu , Zhixiang Chi , Yang Wang , Songhe Feng