English
Related papers

Related papers: Evaluating the Evaluators: Are Current Few-Shot Le…

200 papers

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

Pretrained Language Models (PLMs) have achieved tremendous success in natural language understanding tasks. While different learning schemes -- fine-tuning, zero-shot, and few-shot learning -- have been widely explored and compared for…

Computation and Language · Computer Science 2021-09-30 Liang Xu , Xiaojing Lu , Chenyang Yuan , Xuanwei Zhang , Huilin Xu , Hu Yuan , Guoao Wei , Xiang Pan , Xin Tian , Libo Qin , Hu Hai

Few-shot learning aims to learn classifiers for new classes with only a few training examples per class. Most existing few-shot learning approaches belong to either metric-based meta-learning or optimization-based meta-learning category,…

Machine Learning · Computer Science 2019-08-28 Duo Wang , Yu Cheng , Mo Yu , Xiaoxiao Guo , Tao Zhang

Continual learning and few-shot learning are important frontiers in progress toward broader Machine Learning (ML) capabilities. Recently, there has been intense interest in combining both. One of the first examples to do so was the…

Neural and Evolutionary Computing · Computer Science 2024-07-10 Gideon Kowadlo , Abdelrahman Ahmed , Amir Mayan , David Rawlinson

Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed with the common aim of transferring knowledge acquired on a previously…

Machine Learning · Computer Science 2021-10-19 Yuqing Hu , Vincent Gripon , Stéphane Pateux

Most of the existing deep neural nets on automatic facial expression recognition focus on a set of predefined emotion classes, where the amount of training data has the biggest impact on performance. However, in the standard setting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Anca-Nicoleta Ciubotaru , Arnout Devos , Behzad Bozorgtabar , Jean-Philippe Thiran , Maria Gabrani

Viewpoint estimation for known categories of objects has been improved significantly thanks to deep networks and large datasets, but generalization to unknown categories is still very challenging. With an aim towards improving performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Hung-Yu Tseng , Shalini De Mello , Jonathan Tremblay , Sifei Liu , Stan Birchfield , Ming-Hsuan Yang , Jan Kautz

Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quantifying model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Deep Pandey , Qi Yu

Few-shot learning is currently enjoying a considerable resurgence of interest, aided by the recent advance of deep learning. Contemporary approaches based on weight-generation scheme delivers a straightforward and flexible solution to the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Mingjiang Liang , Shaoli Huang , Shirui Pan , Mingming Gong , Wei Liu

For machine learning models trained with limited labeled training data, validation stands to become the main bottleneck to reducing overall annotation costs. We propose a statistical validation algorithm that accurately estimates the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Fait Poms , Vishnu Sarukkai , Ravi Teja Mullapudi , Nimit S. Sohoni , William R. Mark , Deva Ramanan , Kayvon Fatahalian

Few-shot semantic segmentation (FSS) is a crucial challenge in computer vision, driving extensive research into a diverse range of methods, from advanced meta-learning techniques to simple transfer learning baselines. With the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Reda Bensaid , Vincent Gripon , François Leduc-Primeau , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux

Fine-tuning a deep network trained with the standard cross-entropy loss is a strong baseline for few-shot learning. When fine-tuned transductively, this outperforms the current state-of-the-art on standard datasets such as Mini-ImageNet,…

Machine Learning · Computer Science 2020-10-23 Guneet S. Dhillon , Pratik Chaudhari , Avinash Ravichandran , Stefano Soatto

Few-shot learning aims to recognize new categories using very few labeled samples. Although few-shot learning has witnessed promising development in recent years, most existing methods adopt an average operation to calculate prototypes,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Minglei Yuan , Wenhai Wang , Tao Wang , Chunhao Cai , Qian Xu , Tong Lu

The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing, achieving acceptable performance even when working with limited training data. The goal of FSL is to effectively…

Few-shot learning allows pre-trained language models to adapt to downstream tasks while using a limited number of training examples. However, practical applications are limited when all model parameters must be optimized. In this work we…

Computation and Language · Computer Science 2023-02-01 Ethan Kim , Jerry Yang

Recent advances in natural language processing (NLP) have led to strong text classification models for many tasks. However, still often thousands of examples are needed to train models with good quality. This makes it challenging to quickly…

Computation and Language · Computer Science 2022-05-18 Thomas Müller , Guillermo Pérez-Torró , Angelo Basile , Marc Franco-Salvador

The performance of meta-learning approaches for few-shot learning generally depends on three aspects: features suitable for comparison, the classifier ( base learner ) suitable for low-data scenarios, and valuable information from the…

Machine Learning · Computer Science 2020-09-15 Haoqing Wang , Zhi-Hong Deng

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

In this paper, we tackle the new Cross-Domain Few-Shot Learning benchmark proposed by the CVPR 2020 Challenge. To this end, we build upon state-of-the-art methods in domain adaptation and few-shot learning to create a system that can be…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 John Cai , Sheng Mei Shen

In the ever-evolving era of Artificial Intelligence (AI), model performance has constituted a key metric driving innovation, leading to an exponential growth in model size and complexity. However, sustainability and energy efficiency have…