English
Related papers

Related papers: Label Agnostic Pre-training for Zero-shot Text Cla…

200 papers

Small sample instance segmentation is a very challenging task, and many existing methods follow the training strategy of meta-learning which pre-train models on support set and fine-tune on query set. The pre-training phase, which is highly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ruting Chi , Zhiyi Huang , Yuexing Han

Supervised classification for tabular data remains a core machine learning task, yet its reliance on large labeled datasets limits applicability in data-scarce domains. For such few-shot scenarios, specialized methods like TabPFN - a…

Machine Learning · Computer Science 2026-05-26 Daria Grushina , Kseniia Kuvshinova , Alina Kostromina , Aziz Temirkhanov , Mile Mitrovic , Dmitry Simakov

Structured information extraction from document images usually consists of three steps: text detection, text recognition, and text field labeling. While text detection and text recognition have been heavily studied and improved a lot in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Mengli Cheng , Minghui Qiu , Xing Shi , Jun Huang , Wei Lin

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than…

Artificial Intelligence · Computer Science 2016-09-20 Russell Stewart , Stefano Ermon

Text classification can be useful in many real-world scenarios, saving a lot of time for end users. However, building a custom classifier typically requires coding skills and ML knowledge, which poses a significant barrier for many…

Given semantic descriptions of object classes, zero-shot learning aims to accurately recognize objects of the unseen classes, from which no examples are available at the training stage, by associating them to the seen classes, from which…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

Transforming unstructured text into structured and meaningful forms, organized by useful category labels, is a fundamental step in text mining for downstream analysis and application. However, most existing methods for producing label…

Classification is an essential and fundamental task in machine learning, playing a cardinal role in the field of natural language processing (NLP) and computer vision (CV). In a supervised learning setting, labels are always needed for the…

Computation and Language · Computer Science 2021-02-04 Irene Li

We propose a novel Generalized Zero-Shot learning (GZSL) method that is agnostic to both unseen images and unseen semantic vectors during training. Prior works in this context propose to map high-dimensional visual features to the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

The excellent generative capabilities of text-to-image diffusion models suggest they learn informative representations of image-text data. However, what knowledge their representations capture is not fully understood, and they have not been…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Kevin Clark , Priyank Jaini

Utilizing language models (LMs) without internal access is becoming an attractive paradigm in the field of NLP as many cutting-edge LMs are released through APIs and boast a massive scale. The de-facto method in this type of black-box…

Computation and Language · Computer Science 2023-06-12 Hyunsoo Cho , Youna Kim , Sang-goo Lee

In-line with the success of deep learning on traditional recognition problem, several end-to-end deep models for zero-shot recognition have been proposed in the literature. These models are successful to predict a single unseen label given…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Shafin Rahman , Salman Khan

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes always suffers from…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yuanqi Chen , Xiaoming Yu , Shan Liu , Ge Li

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Pre-trained language models (PLMs) have seen tremendous success in text classification (TC) problems in the context of Natural Language Processing (NLP). In many real-world text classification tasks, the class definitions being learned do…

Computation and Language · Computer Science 2023-11-07 Sumegh Roychowdhury , Karan Gupta , Siva Rajesh Kasa , Prasanna Srinivasa Murthy , Alok Chandra

Tuning pre-trained language models (PLMs) with task-specific prompts has been a promising approach for text classification. Particularly, previous studies suggest that prompt-tuning has remarkable superiority in the low-data scenario over…

Computation and Language · Computer Science 2022-03-21 Shengding Hu , Ning Ding , Huadong Wang , Zhiyuan Liu , Jingang Wang , Juanzi Li , Wei Wu , Maosong Sun

Sentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various downstream tasks, such…

Computation and Language · Computer Science 2021-05-28 John Giorgi , Osvald Nitski , Bo Wang , Gary Bader

Pretrained language models (PLMs) have demonstrated remarkable performance in various natural language processing tasks: Unidirectional PLMs (e.g., GPT) are well known for their superior text generation capabilities; bidirectional PLMs…

Computation and Language · Computer Science 2022-10-13 Yu Meng , Jiaxin Huang , Yu Zhang , Jiawei Han