English
Related papers

Related papers: Few-shot Text Classification with Dual Contrastive…

200 papers

Short text classification has gained significant attention in the information age due to its prevalence and real-world applications. Recent advancements in graph learning combined with contrastive learning have shown promising results in…

Computation and Language · Computer Science 2025-01-17 Yonghao Liu , Fausto Giunchiglia , Lan Huang , Ximing Li , Xiaoyue Feng , Renchu Guan

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

We investigate semi-structured document classification in a zero-shot setting. Classification of semi-structured documents is more challenging than that of standard unstructured documents, as positional, layout, and style information play a…

Computation and Language · Computer Science 2022-10-12 Muhammad Khalifa , Yogarshi Vyas , Shuai Wang , Graham Horwood , Sunil Mallya , Miguel Ballesteros

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

Few-shot methods for accurate modeling under sparse label-settings have improved significantly. However, the applications of few-shot modeling in natural language processing remain solely in the field of document classification. With recent…

Computation and Language · Computer Science 2022-12-20 Anton Thielmann , Christoph Weisser , Benjamin Säfken

Few-shot segmentation enables the model to recognize unseen classes with few annotated examples. Most existing methods adopt prototype learning architecture, where support prototype vectors are expanded and concatenated with query features…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Xiaoyu Zhao , Xiaoqian Chen , Zhiqiang Gong , Wen Yao , Yunyang Zhang , Xiaohu Zheng

Contrastive self-supervised learning methods learn to map data points such as images into non-parametric representation space without requiring labels. While highly successful, current methods require a large amount of data in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Ali Lotfi Rezaabad , Sidharth Kumar , Sriram Vishwanath , Jonathan I. Tamir

Contrastive pretraining techniques for text classification has been largely studied in an unsupervised setting. However, oftentimes labeled data from related tasks which share label semantics with current task is available. We hypothesize…

Computation and Language · Computer Science 2021-12-22 Samujjwal Ghosh , Subhadeep Maji , Maunendra Sankar Desarkar

Few-shot classification consists of a training phase where a model is learned on a relatively large dataset and an adaptation phase where the learned model is adapted to previously-unseen tasks with limited labeled samples. In this paper,…

Machine Learning · Computer Science 2023-06-02 Xu Luo , Hao Wu , Ji Zhang , Lianli Gao , Jing Xu , Jingkuan Song

Sign language recognition from sequences of monocular images or 2D poses is a challenging field, not only due to the difficulty to infer 3D information from 2D data, but also due to the temporal relationship between the sequences of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Silvan Ferreira , Esdras Costa , Márcio Dahia , Jampierre Rocha

Semi-supervised few-shot learning consists in training a classifier to adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Many sophisticated methods have been developed to address the challenges this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xiu-Shen Wei , He-Yang Xu , Faen Zhang , Yuxin Peng , Wei Zhou

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieve state-of-the-art performance. However, the performance of existing approaches heavily depends on the inter-class variance of the support…

Computation and Language · Computer Science 2023-06-12 Shuo Lei , Xuchao Zhang , Jianfeng He , Fanglan Chen , Chang-Tien Lu

Self-training provides an effective means of using an extremely small amount of labeled data to create pseudo-labels for unlabeled data. Many state-of-the-art self-training approaches hinge on different regularization methods to prevent…

Computation and Language · Computer Science 2022-02-08 Hazel Kim , Jaeman Son , Yo-Sub Han

Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task.…

Computation and Language · Computer Science 2022-01-28 Jixuan Wang , Kuan-Chieh Wang , Frank Rudzicz , Michael Brudno

Most of the literature around text classification treats it as a supervised learning problem: given a corpus of labeled documents, train a classifier such that it can accurately predict the classes of unseen documents. In industry, however,…

Computation and Language · Computer Science 2018-04-09 Katherine Bailey , Sunny Chopra

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich

Few-shot classification and meta-learning methods typically struggle to generalize across diverse domains, as most approaches focus on a single dataset, failing to transfer knowledge across various seen and unseen domains. Existing…

Machine Learning · Computer Science 2025-10-07 Kristi Topollai , Anna Choromanska

Few-shot learning aims to transfer information from one task to enable generalization on novel tasks given a few examples. This information is present both in the domain and the class labels. In this work we investigate the complementary…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Orchid Majumder , Avinash Ravichandran , Subhransu Maji , Alessandro Achille , Marzia Polito , Stefano Soatto

A recent approach for few-shot text classification is to convert textual inputs to cloze questions that contain some form of task description, process them with a pretrained language model and map the predicted words to labels. Manually…

Computation and Language · Computer Science 2020-10-27 Timo Schick , Helmut Schmid , Hinrich Schütze