English
Related papers

Related papers: Mutual-Information Based Few-Shot Classification

200 papers

Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed to solve few-shot classification, among which transfer-based methods have…

Machine Learning · Computer Science 2021-01-27 Yuqing Hu , Vincent Gripon , Stéphane Pateux

Few-shot image classification has become a popular research topic for its wide application in real-world scenarios, however the problem of supervision collapse induced by single image-level annotation remains a major challenge. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Kexin Di , Xiuxing Li , Yuyang Han , Ziyu Li , Qing Li , Xia Wu

Few-shot temporal action localization (TAL) methods that adapt large models via single-prompt tuning often fail to produce precise temporal boundaries. This stems from the model learning a non-discriminative mean representation of an action…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Edward Fish , Andrew Gilbert

Model agnostic meta-learning algorithms aim to infer priors from several observed tasks that can then be used to adapt to a new task with few examples. Given the inherent diversity of tasks arising in existing benchmarks, recent methods use…

Machine Learning · Computer Science 2022-07-26 Rakshith Subramanyam , Mark Heimann , Jayram Thathachar , Rushil Anirudh , Jayaraman J. Thiagarajan

We introduce MIM (Masked Image Modeling)-Refiner, a contrastive learning boost for pre-trained MIM models. MIM-Refiner is motivated by the insight that strong representations within MIM models generally reside in intermediate layers.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Benedikt Alkin , Lukas Miklautz , Sepp Hochreiter , Johannes Brandstetter

In multimodal sentiment analysis (MSA), the performance of a model highly depends on the quality of synthesized embeddings. These embeddings are generated from the upstream process called multimodal fusion, which aims to extract and combine…

Computation and Language · Computer Science 2021-09-17 Wei Han , Hui Chen , Soujanya Poria

Transformer-based language models have achieved remarkable success in few-shot in-context learning and drawn a lot of research interest. However, these models' performance greatly depends on the choice of the example prompts and also has…

Computation and Language · Computer Science 2023-06-21 Genta Indra Winata , Liang-Kang Huang , Soumya Vadlamannati , Yash Chandarana

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

Meta-learning has been the most common framework for few-shot learning in recent years. It learns the model from collections of few-shot classification tasks, which is believed to have a key advantage of making the training objective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Yinbo Chen , Zhuang Liu , Huijuan Xu , Trevor Darrell , Xiaolong Wang

Vision Transformers (ViTs) emerge to achieve impressive performance on many data-abundant computer vision tasks by capturing long-range dependencies among local features. However, under few-shot learning (FSL) settings on small datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Han Lin , Guangxing Han , Jiawei Ma , Shiyuan Huang , Xudong Lin , Shih-Fu Chang

User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many examples. To solve…

Machine Learning · Computer Science 2022-10-06 Wei-Tsung Kao , Yuan-Kuei Wu , Chia-Ping Chen , Zhi-Sheng Chen , Yu-Pao Tsai , Hung-Yi Lee

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

In this paper, we explore meta-learning for few-shot text classification. Meta-learning has shown strong performance in computer vision, where low-level patterns are transferable across learning tasks. However, directly applying this…

Computation and Language · Computer Science 2020-02-19 Yujia Bao , Menghua Wu , Shiyu Chang , Regina Barzilay

Few-shot learning aims to learn to generalize a classifier to novel classes with limited labeled data. Transductive inference that utilizes unlabeled test set to deal with low-data problem has been employed for few-shot learning in recent…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Chenyang Si , Wentao Chen , Wei Wang , Liang Wang , Tieniu Tan

Text matching is a core natural language processing research problem. How to retain sufficient information on both content and structure information is one important challenge. In this paper, we present a neural approach for general-purpose…

Computation and Language · Computer Science 2020-03-26 Xixi Zhou , Chengxi Li , Jiajun Bu , Chengwei Yao , Keyue Shi , Zhi Yu , Zhou Yu

In this paper, we study the few-shot multi-label classification for user intent detection. For multi-label intent detection, state-of-the-art work estimates label-instance relevance scores and uses a threshold to select multiple associated…

Computation and Language · Computer Science 2020-10-13 Yutai Hou , Yongkui Lai , Yushan Wu , Wanxiang Che , Ting Liu

Most few-shot learning models utilize only one modality of data. We would like to investigate qualitatively and quantitatively how much will the model improve if we add an extra modality (i.e. text description of the image), and how it…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Zilun Zhang , Shihao Ma , Yichun Zhang

Feature selection by maximizing high-order mutual information between the selected feature vector and a target variable is the gold standard in terms of selecting the best subset of relevant features that maximizes the performance of…

Machine Learning · Computer Science 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

We present a novel method for few-shot video classification, which performs appearance and temporal alignments. In particular, given a pair of query and support videos, we conduct appearance alignment via frame-level feature matching to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Khoi D. Nguyen , Quoc-Huy Tran , Khoi Nguyen , Binh-Son Hua , Rang Nguyen

Thanks to the availability of powerful computing resources, big data and deep learning algorithms, we have made great progress on computer vision in the last few years. Computer vision systems begin to surpass humans in some tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Fupin Yao