English
Related papers

Related papers: Neural Fine-Tuning Search for Few-Shot Learning

200 papers

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

Computation and Language · Computer Science 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

Binary Convolutional Neural Networks (CNNs) have significantly reduced the number of arithmetic operations and the size of memory storage needed for CNNs, which makes their deployment on mobile and embedded systems more feasible. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Baozhou Zhu , Zaid Al-Ars , Peter Hofstee

In this paper, we tackle the new Cross-Domain Few-Shot Learning benchmark proposed by the CVPR 2020 Challenge. To this end, we build upon state-of-the-art methods in domain adaptation and few-shot learning to create a system that can be…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 John Cai , Sheng Mei Shen

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Federated Learning (FL) often struggles with data heterogeneity due to the naturally uneven distribution of user data across devices. Federated Neural Architecture Search (NAS) enables collaborative search for optimal model architectures…

Machine Learning · Computer Science 2025-04-10 Xinyuan Huang , Jiechao Gao

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

Few-shot classification is a challenging problem that aims to learn a model that can adapt to unseen classes given a few labeled samples. Recent approaches pre-train a feature extractor, and then fine-tune for episodic meta-learning. Other…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Philip Chikontwe , Soopil Kim , Sang Hyun Park

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Saeid Motiian , Quinn Jones , Seyed Mehdi Iranmanesh , Gianfranco Doretto

Fine-grained few-shot recognition often suffers from the problem of training data scarcity for novel categories.The network tends to overfit and does not generalize well to unseen classes due to insufficient training data. Many methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jingyi Xu , Hieu Le , Mingzhen Huang , ShahRukh Athar , Dimitris Samaras

There has been a remarkable progress in learning a model which could recognise novel classes with only a few labeled examples in the last few years. Few-shot learning (FSL) for action recognition is a challenging task of recognising novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Neeraj Kumar , Siddhansh Narang

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

Machine Learning · Computer Science 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

In this paper, we propose an approach to improve few-shot classification performance using a composite rotation based auxiliary task. Few-shot classification methods aim to produce neural networks that perform well for classes with a large…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Vinay P. Namboodiri

Few-shot deep learning is a topical challenge area for scaling visual recognition to open ended growth of unseen new classes with limited labeled examples. A promising approach is based on metric learning, which trains a deep embedding to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Xueting Zhang , Yuting Qiang , Flood Sung , Yongxin Yang , Timothy M. Hospedales

Designing neural networks typically relies on manual trial and error or a neural architecture search (NAS) followed by weight training. The former is time-consuming and labor-intensive, while the latter often discretizes architecture search…

Machine Learning · Computer Science 2025-11-19 Zitong Huang , Mansooreh Montazerin , Ajitesh Srivastava

Recently, deep learning has become a de facto standard in machine learning with convolutional neural networks (CNNs) demonstrating spectacular success on a wide variety of tasks. However, CNNs are typically very demanding computationally at…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Yochai Zur , Chaim Baskin , Evgenii Zheltonozhskii , Brian Chmiel , Itay Evron , Alex M. Bronstein , Avi Mendelson

To recognize the unseen classes with only few samples, few-shot learning (FSL) uses prior knowledge learned from the seen classes. A major challenge for FSL is that the distribution of the unseen classes is different from that of those…

Machine Learning · Computer Science 2020-07-28 Jiechao Guan , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

Few-shot learning (FSL) is the task of learning to recognize previously unseen categories of images from a small number of training examples. This is a challenging task, as the available examples may not be enough to unambiguously determine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Kun Yan , Zied Bouraoui , Ping Wang , Shoaib Jameel , Steven Schockaert

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Meta-learning algorithms are widely used for few-shot learning. For example, image recognition systems that readily adapt to unseen classes after seeing only a few labeled examples. Despite their success, we show that modern meta-learning…

Machine Learning · Computer Science 2021-10-28 Mayank Agarwal , Mikhail Yurochkin , Yuekai Sun