English
Related papers

Related papers: When Sensing Varies with Contexts: Context-as-Tran…

200 papers

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu

The application of activity recognition in the "AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity types,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Yilei Qian , Kanglei Geng , Kailong Chen , Shaoxu Cheng , Linfeng Xu , Hongliang Li , Fanman Meng , Qingbo Wu

Continual learning and few-shot learning are important frontiers in progress toward broader Machine Learning (ML) capabilities. Recently, there has been intense interest in combining both. One of the first examples to do so was the…

Neural and Evolutionary Computing · Computer Science 2024-07-10 Gideon Kowadlo , Abdelrahman Ahmed , Amir Mayan , David Rawlinson

Few-shot learning (FSL) often requires effective adaptation of models using limited labeled data. However, most existing FSL methods rely on entangled representations, requiring the model to implicitly recover the unmixing process to obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tianjiao Jiang , Zhen Zhang , Yuhang Liu , Javen Qinfeng Shi

We propose Consistency-guided Asynchronous Contrastive Tuning (CoACT), a novel method for continuously tuning foundation models to learn new classes in few-shot settings. CoACT consists of three key components:(i) asynchronous contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Shuvendu Roy , Elham Dolatabadi , Arash Afkanpour , Ali Etemad

Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jie Mei , Mingyuan Jiu , Hichem Sahbi , Xiaoheng Jiang , Mingliang Xu

Few-Shot Class-Incremental Learning (FSCIL) has gained considerable attention in recent years for its pivotal role in addressing continuously arriving classes. However, it encounters additional challenges. The scarcity of samples in new…

Artificial Intelligence · Computer Science 2024-03-08 Biqing Qi , Junqi Gao , Xingquan Chen , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou

Electromyography (EMG)-based gesture recognition is a promising approach for designing intuitive human-computer interfaces. However, while these systems typically perform well in controlled laboratory settings, their usability in real-world…

Human-Computer Interaction · Computer Science 2025-05-12 Gabriel Gagné , Anisha Azad , Thomas Labbé , Evan Campbell , Xavier Isabel , Erik Scheme , Ulysse Côté-Allard , Benoit Gosselin

Inspired by Regularized Lottery Ticket Hypothesis (RLTH), which hypothesizes that there exist smooth (non-binary) subnetworks within a dense network that achieve the competitive performance of the dense network, we propose a few-shot class…

Machine Learning · Computer Science 2023-03-02 Haeyong Kang , Jaehong Yoon , Sultan Rizky Hikmawan Madjid , Sung Ju Hwang , Chang D. Yoo

The proliferation of Few-Shot Class Incremental Learning (FSCIL) methodologies has highlighted the critical challenge of maintaining robust anti-amnesia capabilities in FSCIL learners. In this paper, we present a novel conceptualization of…

Machine Learning · Computer Science 2024-12-06 Jingren Liu , Zhong Ji , Yanwei Pang , YunLong Yu

Few-shot fine-tuning and in-context learning are two alternative strategies for task adaptation of pre-trained language models. Recently, in-context learning has gained popularity over fine-tuning due to its simplicity and improved…

Computation and Language · Computer Science 2023-05-31 Marius Mosbach , Tiago Pimentel , Shauli Ravfogel , Dietrich Klakow , Yanai Elazar

Open-world continual learning (OWCL) adapts to sequential tasks with open samples, learning knowledge incrementally while preventing forgetting. However, existing OWCL still requires a large amount of labeled data for training, which is…

Machine Learning · Computer Science 2025-07-29 Yujie Li , Xiangkun Wang , Xin Yang , Marcello Bonsangue , Junbo Zhang , Tianrui Li

There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation…

Computation and Language · Computer Science 2024-06-25 Ying Mo , Jiahao Liu , Jian Yang , Qifan Wang , Shun Zhang , Jingang Wang , Zhoujun Li

Fine-tuning Large Language Models (LLMs) typically involves updating at least a few billions of parameters. A more parameter-efficient approach is Prompt Tuning (PT), which updates only a few learnable tokens, and differently, In-Context…

Computation and Language · Computer Science 2024-10-23 Tsachi Blau , Moshe Kimhi , Yonatan Belinkov , Alexander Bronstein , Chaim Baskin

Few-shot class-incremental learning (FSCIL) has been proposed aiming to enable a deep learning system to incrementally learn new classes with limited data. Recently, a pioneer claims that the commonly used replay-based method in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Huan Liu , Li Gu , Zhixiang Chi , Yang Wang , Yuanhao Yu , Jun Chen , Jin Tang

We study the phenomenon of \textit{in-context learning} (ICL) exhibited by large language models, where they can adapt to a new learning task, given a handful of labeled examples, without any explicit parameter optimization. Our goal is to…

Machine Learning · Computer Science 2023-05-29 Jacob Abernethy , Alekh Agarwal , Teodor V. Marinov , Manfred K. Warmuth

Few-shot class-incremental learning (FSCIL) poses significant challenges for artificial neural networks due to the need to efficiently learn from limited data while retaining knowledge of previously learned tasks. Inspired by the brain's…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Wanyi Li , Wei Wei , Yongkang Luo , Peng Wang

Imbalanced and small data regimes are pervasive in domains such as rare disease imaging, genomics, and disaster response, where labeled samples are scarce and naive augmentation often introduces artifacts. Existing solutions such as…

Machine Learning · Computer Science 2025-09-17 J. Cha , J. Lee , J. Cho , J. Shin

As model context lengths continue to increase, the number of demonstrations that can be provided in-context approaches the size of entire training datasets. We study the behavior of in-context learning (ICL) at this extreme scale on…

Computation and Language · Computer Science 2025-03-05 Amanda Bertsch , Maor Ivgi , Emily Xiao , Uri Alon , Jonathan Berant , Matthew R. Gormley , Graham Neubig

The field of Few-Shot Learning (FSL), or learning from very few (typically $1$ or $5$) examples per novel class (unseen during training), has received a lot of attention and significant performance advances in the recent literature. While…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Moshe Lichtenstein , Prasanna Sattigeri , Rogerio Feris , Raja Giryes , Leonid Karlinsky