English
Related papers

Related papers: Episode-specific Fine-tuning for Metric-based Few-…

200 papers

Prompt-based methods have achieved promising results in most few-shot text classification tasks. However, for readability assessment tasks, traditional prompt methods lackcrucial linguistic knowledge, which has already been proven to be…

Computation and Language · Computer Science 2024-04-11 Ziyang Wang , Sanwoo Lee , Hsiu-Yuan Huang , Yunfang Wu

As large language models (LLMs) are widely adopted, new safety issues and policies emerge, to which existing safety classifiers do not generalize well. If we have only observed a few examples of violations of a new safety rule, how can we…

Machine Learning · Computer Science 2023-10-27 Ananth Balashankar , Xiao Ma , Aradhana Sinha , Ahmad Beirami , Yao Qin , Jilin Chen , Alex Beutel

Adapting deep learning models to new domains often requires computationally intensive retraining and risks catastrophic forgetting. While fine-tuning enables domain-specific adaptation, it can reduce robustness to distribution shifts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Reza Akbarian Bafghi , Carden Bagwell , Avinash Ravichandran , Ashish Shrivastava , Maziar Raissi

NMT systems trained on Pre-trained Multilingual Sequence-Sequence (PMSS) models flounder when sufficient amounts of parallel data is not available for fine-tuning. This specifically holds for languages missing/under-represented in these…

The goal of few-shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Zhiqiang Shen , Zechun Liu , Jie Qin , Marios Savvides , Kwang-Ting Cheng

Cross-Domain Few-Shot Segmentation (CD-FSS) poses the challenge of segmenting novel categories from a distinct domain using only limited exemplars. In this paper, we undertake a comprehensive study of CD-FSS and uncover two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Jiahao Nie , Yun Xing , Gongjie Zhang , Pei Yan , Aoran Xiao , Yap-Peng Tan , Alex C. Kot , Shijian Lu

Deep learning models have become increasingly useful in many different industries. On the domain of image classification, convolutional neural networks proved the ability to learn robust features for the closed set problem, as shown in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rafael S. Pereira , Alexis Joly , Patrick Valduriez , Fabio Porto

In many practical few-shot learning problems, even though labeled examples are scarce, there are abundant auxiliary datasets that potentially contain useful information. We propose the problem of extended few-shot learning to study these…

Machine Learning · Computer Science 2021-07-06 Reza Esfandiarpoor , Amy Pu , Mohsen Hajabdollahi , Stephen H. Bach

To address the annotation scarcity issue in some cases of semantic segmentation, there have been a few attempts to develop the segmentation model in the few-shot learning paradigm. However, most existing methods only focus on the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Pinzhuo Tian , Zhangkai Wu , Lei Qi , Lei Wang , Yinghuan Shi , Yang Gao

The focus in machine learning has branched beyond training classifiers on a single task to investigating how previously acquired knowledge in a source domain can be leveraged to facilitate learning in a related target domain, known as…

Machine Learning · Computer Science 2018-10-30 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

Few-shot learning features the capability of generalizing from a few examples. In this paper, we first identify that a discriminative feature space, namely a rectified metric space, that is learned to maintain the metric consistency from…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yang Zhao , Chunyuan Li , Ping Yu , Changyou Chen

In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Constance Ferragu , Philomene Chagniot , Vincent Coyette

This paper presents a gradient-informed fine-tuning method for large language models under few-shot conditions. The goal is to enhance task adaptability and training stability when data is limited. The method builds on a base loss function…

Computation and Language · Computer Science 2025-06-03 Hongye Zheng , Yichen Wang , Ray Pan , Guiran Liu , Binrong Zhu , Hanlu Zhang

Labeled data is a critical resource for training and evaluating machine learning models. However, many real-life datasets are only partially labeled. We propose a semi-supervised machine learning training strategy to improve event detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Florian Dubost , Erin Hong , Nandita Bhaskhar , Siyi Tang , Daniel Rubin , Christopher Lee-Messer

Transformer-based large language models exhibit in-context learning, enabling adaptation to downstream tasks via few-shot prompting with demonstrations. In practice, such models are often fine-tuned to improve zero-shot performance on…

Computation and Language · Computer Science 2026-02-27 Chungpa Lee , Jy-yong Sohn , Kangwook Lee

Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoxiao Wu , Xiaowei Chen , Zhenguo Gao , Shulei Qu , Yuanyuan Qiu

Few-shot semantic segmentation aims to segment novel-class objects in a given query image with only a few labeled support images. Most advanced solutions exploit a metric learning framework that performs segmentation through matching each…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Jiacheng Chen , Bin-Bin Gao , Zongqing Lu , Jing-Hao Xue , Chengjie Wang , Qingmin Liao

We study the problem of few-shot learning-based denoising where the training set contains just a handful of clean and noisy samples. A solution to mitigate the small training set issue is to pre-train a denoising model with small training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Leslie Casas , Attila Klimmek , Gustavo Carneiro , Nassir Navab , Vasileios Belagiannis

Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples. In this paper,…

Machine Learning · Computer Science 2023-06-02 Xu Luo , Hao Wu , Ji Zhang , Lianli Gao , Jing Xu , Jingkuan Song

Applying large-scale vision-language pre-trained models like CLIP to few-shot action recognition (FSAR) can significantly enhance both performance and efficiency. While several studies have recognized this advantage, most of them resort to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Jiazheng Xing , Chao Xu , Mengmeng Wang , Guang Dai , Baigui Sun , Yong Liu , Jingdong Wang , Jian Zhao