English
Related papers

Related papers: Task-Specific Preconditioner for Cross-Domain Few-…

200 papers

While deep learning excels in computer vision tasks with abundant labeled data, its performance diminishes significantly in scenarios with limited labeled samples. To address this, Few-shot learning (FSL) enables models to perform the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Huali Xu , Shuaifeng Zhi , Shuzhou Sun , Vishal M. Patel , Li Liu

Most few-shot learning works rely on the same domain assumption between the base and the target tasks, hindering their practical applications. This paper proposes an adaptive transformer network (ADAPTER), a simple but effective solution…

Machine Learning · Computer Science 2024-01-26 Naeem Paeedeh , Mahardhika Pratama , Muhammad Anwar Ma'sum , Wolfgang Mayer , Zehong Cao , Ryszard Kowlczyk

Model-agnostic meta-learning (MAML) is a well-known optimization-based meta-learning algorithm that works well in various computer vision tasks, e.g., few-shot classification. MAML is to learn an initialization so that a model can adapt to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sanghyuk Lee , Seunghyun Lee , Byung Cheol Song

Few-shot learning has made impressive strides in addressing the crucial challenges of recognizing unknown samples from novel classes in target query sets and managing visual shifts between domains. However, existing techniques fall short…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Debabrata Pal , Deeptej More , Sai Bhargav , Dipesh Tamboli , Vaneet Aggarwal , Biplab Banerjee

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Transfer learning paradigm has driven substantial advancements in various vision tasks. However, as state-of-the-art models continue to grow, classical full fine-tuning often becomes computationally impractical, particularly in multi-task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Seungmin Baek , Soyul Lee , Hayeon Jo , Hyesong Choi , Dongbo Min

Unsupervised domain adaptation~(UDA) aims at reducing the distribution discrepancy when transferring knowledge from a labeled source domain to an unlabeled target domain. Previous UDA methods assume that the source and target domains share…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Chuan-Xian Ren , Pengfei Ge , Peiyi Yang , Shuicheng Yan

Cross-Domain Few-Shot Learning (CD-FSL) aims to transfer knowledge from a seen source domain to unseen target domains, serving as a key benchmark for evaluating the robustness and transferability of models. Existing style-based perturbation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Wenqian Li , Pengfei Fang , Hui Xue

Few-shot text classification aims to classify the text under the few-shot scenario. Most of the previous methods adopt optimization-based meta learning to obtain task distribution. However, due to the neglect of matching between the few…

Computation and Language · Computer Science 2023-07-31 Tianyi Lei , Honghui Hu , Qiaoyang Luo , Dezhong Peng , Xu Wang

Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task.…

Computation and Language · Computer Science 2022-01-28 Jixuan Wang , Kuan-Chieh Wang , Frank Rudzicz , Michael Brudno

Source-Free Cross-Domain Few-Shot Learning (SF-CDFSL) focuses on fine-tuning with limited training data from target domains (e.g., medical or satellite images), where Vision-Language Models (VLMs) such as CLIP and SigLIP have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhenyu Zhang , Yixiong Zou , Yuhua Li , Ruixuan Li , Guangyao Chen

Few-shot learning (FSL) aims to recognize novel queries with only a few support samples through leveraging prior knowledge from a base dataset. In this paper, we consider the domain shift problem in FSL and aim to address the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wentao Chen , Zhang Zhang , Wei Wang , Liang Wang , Zilei Wang , Tieniu Tan

Cross-Domain Few-Shot Learning (CD-FSL) aims to transfer knowledge from seen source domains to unseen target domains, which is crucial for evaluating the generalization and robustness of models. Recent studies focus on utilizing visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Wenqian Li , Pengfei Fang , Hui Xue

This paper presents a gradient-informed fine-tuning method for large language models under few-shot conditions. The goal is to enhance task adaptability and training stability when data is limited. The method builds on a base loss function…

Computation and Language · Computer Science 2025-06-03 Hongye Zheng , Yichen Wang , Ray Pan , Guiran Liu , Binrong Zhu , Hanlu Zhang

We propose Domain-Conditioned Meta-Contrastive Learning, a framework for improving the cross-domain generalization of vision-language models. While contrastive models such as CLIP achieve strong performance through large-scale training,…

Optimization and Control · Mathematics 2026-03-31 Merham Fouladvand , Peuroly Batra

Few-Shot transfer learning has become a major focus of research as it allows recognition of new classes with limited labeled data. While it is assumed that train and test data have the same data distribution, this is often not the case in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Wenjian Wang , Lijuan Duan , Yuxi Wang , Junsong Fan , Zhi Gong , Zhaoxiang Zhang

In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiajun Chen , Hongpeng Yin , Yifu Yang

The goal of this paper is to design image classification systems that, after an initial multi-task training phase, can automatically adapt to new tasks encountered at test time. We introduce a conditional neural process based approach to…

Machine Learning · Statistics 2020-07-14 James Requeima , Jonathan Gordon , John Bronskill , Sebastian Nowozin , Richard E. Turner

In this paper, we present a new method, Transductive Multi-Head Few-Shot learning (TMHFS), to address the Cross-Domain Few-Shot Learning (CD-FSL) challenge. The TMHFS method extends the Meta-Confidence Transduction (MCT) and Dense…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Jianan Jiang , Zhenpeng Li , Yuhong Guo , Jieping Ye