English
Related papers

Related papers: Cross-Domain Few-Shot Learning with Meta Fine-Tuni…

200 papers

Few-shot unsupervised domain adaptation (FS-UDA) leverages a limited amount of labeled data from a source domain to enable accurate classification in an unlabeled target domain. Despite recent advancements, current approaches of FS-UDA…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Wanqi Yang , Haoran Wang , Lei Wang , Ge Song , Ming Yang , Yang Gao

Deep learning models have become the mainstream method for medical image segmentation, but they require a large manually labeled dataset for training and are difficult to extend to unseen categories. Few-shot segmentation(FSS) has the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-27 Yao Huang , Jianming Liu

In this study, we investigate the performance of few-shot classification models across different domains, specifically natural images and histopathological images. We first train several few-shot classification models on natural images and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ardhendu Sekhar , Aditya Bhattacharya , Vinayak Goyal , Vrinda Goel , Aditya Bhangale , Ravi Kant Gupta , Amit Sethi

Meta-learning for few-shot learning allows a machine to leverage previously acquired knowledge as a prior, thus improving the performance on novel tasks with only small amounts of data. However, most mainstream models suffer from…

Machine Learning · Computer Science 2019-11-13 Yadan Luo , Zi Huang , Zheng Zhang , Ziwei Wang , Mahsa Baktashmotlagh , Yang Yang

Cross-domain few-shot learning (CDFSL) aims to transfer knowledge from a data-sufficient source domain to data-scarce target domains. Although Vision Transformer (ViT) has shown superior capability in many vision tasks, its transferability…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Transferring the knowledge learned from large scale datasets (e.g., ImageNet) via fine-tuning offers an effective solution for domain-specific fine-grained visual categorization (FGVC) tasks (e.g., recognizing bird species or car make and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yin Cui , Yang Song , Chen Sun , Andrew Howard , Serge Belongie

Few-shot meta-learning methods consider the problem of learning new tasks from a small, fixed number of examples, by meta-learning across static data from a set of previous tasks. However, in many real world settings, it is more natural to…

Machine Learning · Computer Science 2020-12-15 Tianhe Yu , Xinyang Geng , Chelsea Finn , Sergey Levine

Pre-trained neural language models bring significant improvement for various NLP tasks, by fine-tuning the models on task-specific training sets. During fine-tuning, the parameters are initialized from pre-trained models directly, which…

Computation and Language · Computer Science 2020-09-17 Chengyu Wang , Minghui Qiu , Jun Huang , Xiaofeng He

Many real-world classification problems often have classes with very few labeled training samples. Moreover, all possible classes may not be initially available for training, and may be given incrementally. Deep learning models need to deal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pratik Mazumder , Pravendra Singh , Piyush Rai

A recent family of techniques, dubbed lightweight fine-tuning methods, facilitates parameter-efficient transfer learning by updating only a small set of additional parameters while keeping the parameters of the pretrained language model…

Computation and Language · Computer Science 2022-12-09 Mozhdeh Gheini , Xuezhe Ma , Jonathan May

Both few-shot and continual learning have seen substantial progress in the last years due to the introduction of proper benchmarks. That being said, the field has still to frame a suite of benchmarks for the highly desirable setting of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Antreas Antoniou , Massimiliano Patacchiola , Mateusz Ochal , Amos Storkey

Automatic cell segmentation in microscopy images works well with the support of deep neural networks trained with full supervision. Collecting and annotating images, though, is not a sustainable solution for every new microscopy database…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Youssef Dawoud , Julia Hornauer , Gustavo Carneiro , Vasileios Belagiannis

Few-shot learning (FSL) aims to recognize novel queries with only a few support samples through leveraging prior knowledge from a base dataset. In this paper, we consider the domain shift problem in FSL and aim to address the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wentao Chen , Zhang Zhang , Wei Wang , Liang Wang , Zilei Wang , Tieniu Tan

Existing few-shot learning (FSL) methods usually assume base classes and novel classes are from the same domain (in-domain setting). However, in practice, it may be infeasible to collect sufficient training samples for some special domains…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yixiong Zou , Shanghang Zhang , JianPeng Yu , Yonghong Tian , José M. F. Moura

In medical image analysis, transfer learning is a powerful method for deep neural networks (DNNs) to generalize well on limited medical data. Prior efforts have focused on developing pre-training algorithms on domains such as lung…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yixiong Chen , Li Liu , Jingxian Li , Hua Jiang , Chris Ding , Zongwei Zhou

Finetuning a pretrained model has become a standard approach for training neural networks on novel tasks, resulting in fast convergence and improved performance. In this work, we study an alternative finetuning method, where instead of…

Machine Learning · Computer Science 2023-07-04 Gal Kaplun , Andrey Gurevich , Tal Swisa , Mazor David , Shai Shalev-Shwartz , Eran Malach

Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kun Song , Huimin Ma , Bochao Zou , Huishuai Zhang , Weiran Huang

Current few-shot learning models capture visual object relations in the so-called meta-learning setting under a fixed-resolution input. However, such models have a limited generalization ability under the scale and location mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Hongguang Zhang , Philip H. S. Torr , Piotr Koniusz

Few-shot learning is a standard practice in most deep learning based histopathology image segmentation, given the relatively low number of digitized slides that are generally available. While many models have been developed for domain…

Image and Video Processing · Electrical Eng. & Systems 2021-10-01 Zheng Yuan , Andre Esteva , Ran Xu

Reinforcement learning methods can achieve significant performance but require a large amount of training data collected on the same robotic platform. A policy trained with expensive data is rendered useless after making even a minor change…

Robotics · Computer Science 2021-03-08 Ali Ghadirzadeh , Xi Chen , Petra Poklukar , Chelsea Finn , Mårten Björkman , Danica Kragic