English
Related papers

Related papers: ReFine: Re-randomization before Fine-tuning for Cr…

200 papers

We study linear regression under covariate shift, where the marginal distribution over the input covariates differs in the source and the target domains, while the conditional distribution of the output given the input covariates is similar…

Machine Learning · Computer Science 2022-08-04 Jingfeng Wu , Difan Zou , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

Few-shot image classification aims to learn an image classifier using only a small set of labeled examples per class. A recent research direction for improving few-shot classifiers involves augmenting the labelled samples with synthetic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Victor G. Turrisi da Costa , Nicola Dall'Asen , Yiming Wang , Nicu Sebe , Elisa Ricci

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

Machine Learning · Computer Science 2023-12-08 Jaron Mar , Jiamou Liu

In this paper, we present a new method, Transductive Multi-Head Few-Shot learning (TMHFS), to address the Cross-Domain Few-Shot Learning (CD-FSL) challenge. The TMHFS method extends the Meta-Confidence Transduction (MCT) and Dense…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Jianan Jiang , Zhenpeng Li , Yuhong Guo , Jieping Ye

Few-shot fine-tuning and in-context learning are two alternative strategies for task adaptation of pre-trained language models. Recently, in-context learning has gained popularity over fine-tuning due to its simplicity and improved…

Computation and Language · Computer Science 2023-05-31 Marius Mosbach , Tiago Pimentel , Shauli Ravfogel , Dietrich Klakow , Yanai Elazar

Few-shot learning (FSL) based on manifold regularization aims to improve the recognition capacity of novel objects with limited training samples by mixing two samples from different categories with a blending factor. However, this mixing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xingyu Zhu , Shuo Wang , Jinda Lu , Yanbin Hao , Haifeng Liu , Xiangnan He

Self-training is a competitive approach in domain adaptive segmentation, which trains the network with the pseudo labels on the target domain. However inevitably, the pseudo labels are noisy and the target features are dispersed due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Yong Wang , Fang Wen

We propose Regularized Learning under Label shifts (RLLS), a principled and a practical domain-adaptation algorithm to correct for shifts in the label distribution between a source and a target domain. We first estimate importance weights…

Machine Learning · Computer Science 2020-08-10 Kamyar Azizzadenesheli , Anqi Liu , Fanny Yang , Animashree Anandkumar

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization…

Machine Learning · Computer Science 2021-06-18 Wouter M. Kouw , Marco Loog

Training generative models, such as GANs, on a target domain containing limited examples (e.g., 10) can easily result in overfitting. In this work, we seek to utilize a large source domain for pretraining and transfer the diversity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Utkarsh Ojha , Yijun Li , Jingwan Lu , Alexei A. Efros , Yong Jae Lee , Eli Shechtman , Richard Zhang

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Zejiang Hou , Sun-Yuan Kung

Most computer aided pathology detection systems rely on large volumes of quality annotated data to aid diagnostics and follow up procedures. However, quality assuring large volumes of annotated medical image data can be subjective and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Sohini Roychowdhury

In recent years, few-shot learning problems have received a lot of attention. While methods in most previous works were trained and tested on datasets in one single domain, cross-domain few-shot learning is a brand-new branch of few-shot…

Machine Learning · Computer Science 2024-02-07 Jia-Fong Yeh , Hsin-Ying Lee , Bing-Chen Tsai , Yi-Rong Chen , Ping-Chia Huang , Winston H. Hsu

Few-shot learning requires to recognize novel classes with scarce labeled data. Prototypical network is useful in existing researches, however, training on narrow-size distribution of scarce data usually tends to get biased prototypes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jinlu Liu , Liang Song , Yongqiang Qin

Few-shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta-learning algorithms, and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wei-Yu Chen , Yen-Cheng Liu , Zsolt Kira , Yu-Chiang Frank Wang , Jia-Bin Huang

Most existing studies on few-shot learning focus on unimodal settings, where models are trained to generalize to unseen data using a limited amount of labeled examples from a single modality. However, real-world data are inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhengwei Yang , Yuke Li , Qiang Sun , Basura Fernando , Heng Huang , Zheng Wang

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

Few-shot learning aims to build classifiers for new classes from a small number of labeled examples and is commonly facilitated by access to examples from a distinct set of 'base classes'. The difference in data distribution between the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Zitian Chen , Subhransu Maji , Erik Learned-Miller

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

We study the problem of few-shot graph classification across domains with nonequivalent feature spaces by introducing three new cross-domain benchmarks constructed from publicly available datasets. We also propose an attention-based graph…

Machine Learning · Computer Science 2022-01-21 Kaveh Hassani