English
Related papers

Related papers: MEAL: Stable and Active Learning for Few-Shot Prom…

200 papers

Meta-learning (ML) has emerged as a promising learning method under resource constraints such as few-shot learning. ML approaches typically propose a methodology to learn generalizable models. In this work-in-progress paper, we put the…

Machine Learning · Computer Science 2022-03-07 Aroof Aimen , Sahil Sidheekh , Vineet Madan , Narayanan C. Krishnan

The Prototypical Network (ProtoNet) has emerged as a popular choice in Few-shot Learning (FSL) scenarios due to its remarkable performance and straightforward implementation. Building upon such success, we first propose a simple (yet novel)…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Xuanyu Zhuang , Geoffroy Peeters , Gaël Richard

The high cost of acquiring and annotating samples has made the `few-shot' learning problem of prime importance. Existing works mainly focus on improving performance on clean data and overlook robustness concerns on the data perturbed with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Gaurav Kumar Nayak , Ruchit Rawal , Inder Khatri , Anirban Chakraborty

Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Ding Li , Xuebing Yang , Yongqiang Tang , Chenyang Zhang , Wensheng Zhang

Despite the notable advancements achieved by leveraging pre-trained vision-language (VL) models through few-shot tuning for downstream tasks, our detailed empirical study highlights a significant dependence of few-shot learning outcomes on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhaojun Guo , Jinghui Lu , Xuejing Liu , Rui Zhao , ZhenXing Qian , Fei Tan

Foundational vision transformer models have shown impressive few shot performance on many vision tasks. This research presents a novel investigation into the application of parameter efficient fine-tuning methods within an active learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Athmanarayanan Lakshmi Narayanan , Ranganath Krishnan , Amrutha Machireddy , Mahesh Subedar

Few-shot class-incremental learning(FSCIL) focuses on designing learning algorithms that can continually learn a sequence of new tasks from a few samples without forgetting old ones. The difficulties are that training on a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Jinze Li , Yan Bai , Yihang Lou , Xiongkun Linghu , Jianzhong He , Shaoyun Xu , Tao Bai

We introduce Prompt Curriculum Learning (PCL), a lightweight reinforcement learning (RL) algorithm that selects intermediate-difficulty prompts using a learned value model to post-train language models. Since post-training LLMs via RL…

Machine Learning · Computer Science 2025-10-02 Zhaolin Gao , Joongwon Kim , Wen Sun , Thorsten Joachims , Sid Wang , Richard Yuanzhe Pang , Liang Tan

Active learning selects the most informative samples to exploit limited annotation budgets. Existing work follows a cumbersome pipeline that repeats the time-consuming model training and batch data selection multiple times. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yichen Xie , Masayoshi Tomizuka , Wei Zhan

Few-shot Learning has been studied to mimic human visual capabilities and learn effective models without the need of exhaustive human annotation. Even though the idea of meta-learning for adaptation has dominated the few-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Jiawei Ma , Hanchen Xie , Guangxing Han , Shih-Fu Chang , Aram Galstyan , Wael Abd-Almageed

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Continual learning strives to ensure stability in solving previously seen tasks while demonstrating plasticity in a novel domain. Recent advances in continual learning are mostly confined to a supervised learning setting, especially in NLP…

Machine Learning · Computer Science 2024-06-03 Stella Ho , Ming Liu , Shang Gao , Longxiang Gao

Annotating datasets for object detection is an expensive and time-consuming endeavor. To minimize this burden, active learning (AL) techniques are employed to select the most informative samples for annotation within a constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Active learning (AL) is a promising ML paradigm that has the potential to parse through large unlabeled data and help reduce annotation cost in domains where labeling data can be prohibitive. Recently proposed neural network based AL…

Machine Learning · Computer Science 2022-06-17 Prateek Munjal , Nasir Hayat , Munawar Hayat , Jamshid Sourati , Shadab Khan

A human's attention can intuitively adapt to corrupted areas of an image by recalling a similar uncorrupted image they have previously seen. This observation motivates us to improve the attention of adversarial images by considering their…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Runqi Wang , Xiaoyue Duan , Baochang Zhang , Song Xue , Wentao Zhu , David Doermann , Guodong Guo

Training a quantum machine learning model generally requires a large labeled dataset, which incurs high labeling and computational costs. To reduce such costs, a selective training strategy, called active learning (AL), chooses only a…

Quantum Physics · Physics 2022-08-04 Chen Ding , Xiao-Yue Xu , Yun-Fei Niu , Shuo Zhang , Wan-Su Bao , He-Liang Huang

Active learning (AL) seeks to reduce annotation costs by selecting the most informative samples for labeling, making it particularly valuable in resource-constrained settings. However, traditional evaluation methods, which focus solely on…

Machine Learning · Computer Science 2025-07-22 Julia Machnio , Mads Nielsen , Mostafa Mehdipour Ghazi

Pretrained language models (PLMs) have shown remarkable few-shot learning capabilities when provided with properly formatted examples. However, selecting the "best" examples remains an open challenge. We propose a complexity-based prompt…

Computation and Language · Computer Science 2024-08-01 Rishabh Adiga , Lakshminarayanan Subramanian , Varun Chandrasekaran

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu