English
Related papers

Related papers: Neural Fine-Tuning Search for Few-Shot Learning

200 papers

Few-shot image classification aims at training a model from only a few examples for each of the "novel" classes. This paper proposes the idea of associative alignment for leveraging part of the base data by aligning the novel training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

Neural Architecture Search (NAS) methods have been shown to outperform hand-designed models and help to democratize AI. However, NAS methods often start from scratch with each new task, making them computationally expensive and limiting…

Machine Learning · Computer Science 2025-07-15 Prabhant Singh , Joaquin Vanschoren

Few-shot recognition learns a recognition model with very few (e.g., 1 or 5) images per category, and current few-shot learning methods focus on improving the average accuracy over many episodes. We argue that in real-world applications we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Minghao Fu , Yun-Hao Cao , Jianxin Wu

The task of Few-shot Learning (FSL) aims to do the inference on novel categories containing only few labeled examples, with the help of knowledge learned from base categories containing abundant labeled training samples. While there are…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Chengming Xu , Siqian Yang , Yabiao Wang , Zhanxiong Wang , Yanwei Fu , Xiangyang Xue

Few-shot learning is often motivated by the ability of humans to learn new tasks from few examples. However, standard few-shot classification benchmarks assume that the representation is learned on a limited amount of base class data,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard

In this article, we consider the problem of few-shot learning for classification. We assume a network trained for base categories with a large number of training examples, and we aim to add novel categories to it that have only a few, e.g.,…

Machine Learning · Computer Science 2020-03-23 Hong-Gyu Jung , Seong-Whan Lee

Due to limited computational cost and energy consumption, most neural network models deployed in mobile devices are tiny. However, tiny neural networks are commonly very vulnerable to attacks. Current research has proved that larger model…

Machine Learning · Computer Science 2022-01-11 Guoyang Xie , Jinbao Wang , Guo Yu , Feng Zheng , Yaochu Jin

Few-shot learning aims to classify unseen classes with a few training examples. While recent works have shown that standard mini-batch training with a carefully designed training strategy can improve generalization ability for unseen…

Machine Learning · Computer Science 2021-03-02 Jin-Woo Seo , Hong-Gyu Jung , Seong-Whan Lee

In this paper we reformulate few-shot classification as a reconstruction problem in latent space. The ability of the network to reconstruct a query feature map from support features of a given class predicts membership of the query in that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Davis Wertheimer , Luming Tang , Bharath Hariharan

Feature representations from pre-trained deep neural networks have been known to exhibit excellent generalization and utility across a variety of related tasks. Fine-tuning is by far the simplest and most widely used approach that seeks to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-09 Donghyun Yoo , Haoqi Fan , Vishnu Naresh Boddeti , Kris M. Kitani

Neural Architecture Search (NAS) has gained attraction due to superior classification performance. Differential Architecture Search (DARTS) is a computationally light method. To limit computational resources DARTS makes numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Muhammad Suhaib Tanveer , Muhammad Umar Karim Khan , Chong-Min Kyung

Few-shot learning is a fundamental task in computer vision that carries the promise of alleviating the need for exhaustively labeled data. Most few-shot learning approaches to date have focused on progressively more complex neural feature…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Peyman Bateni , Raghav Goyal , Vaden Masrani , Frank Wood , Leonid Sigal

Many Few-Shot Learning research works have two stages: pre-training base model and adapting to novel model. In this paper, we propose to use closed-form base learner, which constrains the adapting stage with pre-trained base model to get…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Liang Song , Jinlu Liu , Yongqiang Qin

We present a conceptually simple, flexible, and general framework for few-shot learning, where a classifier must learn to recognise new classes given only few examples from each. Our method, called the Relation Network (RN), is trained…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Flood Sung , Yongxin Yang , Li Zhang , Tao Xiang , Philip H. S. Torr , Timothy M. Hospedales

Most of the existing deep neural nets on automatic facial expression recognition focus on a set of predefined emotion classes, where the amount of training data has the biggest impact on performance. However, in the standard setting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Anca-Nicoleta Ciubotaru , Arnout Devos , Behzad Bozorgtabar , Jean-Philippe Thiran , Maria Gabrani

Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Jiemin Fang , Yuzhu Sun , Qian Zhang , Kangjian Peng , Yuan Li , Wenyu Liu , Xinggang Wang

Finetuning a pretrained model has become a standard approach for training neural networks on novel tasks, resulting in fast convergence and improved performance. In this work, we study an alternative finetuning method, where instead of…

Machine Learning · Computer Science 2023-07-04 Gal Kaplun , Andrey Gurevich , Tal Swisa , Mazor David , Shai Shalev-Shwartz , Eran Malach

Recent advancements in the area of deep learning have shown the effectiveness of very large neural networks in several applications. However, as these deep neural networks continue to grow in size, it becomes more and more difficult to…

Machine Learning · Computer Science 2022-10-19 Anjul Tyagi , Cong Xie , Klaus Mueller

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Viewpoint estimation for known categories of objects has been improved significantly thanks to deep networks and large datasets, but generalization to unknown categories is still very challenging. With an aim towards improving performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Hung-Yu Tseng , Shalini De Mello , Jonathan Tremblay , Sifei Liu , Stan Birchfield , Ming-Hsuan Yang , Jan Kautz