English
Related papers

Related papers: Zero-Shot Text Classification with Self-Training

200 papers

Zero-shot learning has received increasing interest as a means to alleviate the often prohibitive expense of annotating training data for large scale recognition problems. These methods have achieved great success via learning intermediate…

Machine Learning · Computer Science 2015-03-27 Yanwei Fu , Yongxin Yang , Tim Hospedales , Tao Xiang , Shaogang Gong

Text classification tends to be difficult when data are deficient or when it is required to adapt to unseen classes. In such challenging scenarios, recent studies have often used meta-learning to simulate the few-shot task, thus negating…

Information Retrieval · Computer Science 2019-11-22 Shumin Deng , Ningyu Zhang , Zhanlin Sun , Jiaoyan Chen , Huajun Chen

Few-shot learning benchmarks are critical for evaluating modern NLP techniques. It is possible, however, that benchmarks favor methods which easily make use of unlabeled text, because researchers can use unlabeled text from the test set to…

Computation and Language · Computer Science 2024-10-03 Kush Dubey

One of the most impressive results of recent NLP history is the ability of pre-trained language models to solve new tasks in a zero-shot setting. To achieve this, NLP tasks are framed as natural language prompts, generating a response…

Computation and Language · Computer Science 2022-12-29 Chunting Zhou , Junxian He , Xuezhe Ma , Taylor Berg-Kirkpatrick , Graham Neubig

State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information. In these formulations the current best complement to visual features are attributes: manually encoded…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Scott Reed , Zeynep Akata , Bernt Schiele , Honglak Lee

State-of-the-art audio classification often employs a zero-shot approach, which involves comparing audio embeddings with embeddings from text describing the respective audio class. These embeddings are usually generated by neural networks…

Sound · Computer Science 2025-07-29 James Taylor , Wolfgang Mack

While billions of non-English speaking users rely on search engines every day, the problem of ad-hoc information retrieval is rarely studied for non-English languages. This is primarily due to a lack of data set that are suitable to train…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Luca Soldaini , Nazli Goharian

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Object recognition systems usually require fully complete manually labeled training data to train the classifier. In this paper, we study the problem of object recognition where the training samples are missing during the classifier…

Computer Vision and Pattern Recognition · Computer Science 2014-10-15 Wai Lam Hoo , Chee Seng Chan

Language models can be viewed as functions that embed text into Euclidean space, where the quality of the embedding vectors directly determines model performance, training such neural networks involves various uncertainties. This paper…

Computation and Language · Computer Science 2025-03-31 Yifei Duan , Raphael Shang , Deng Liang , Yongqiang Cai

Audio-text models trained via contrastive learning offer a practical approach to perform audio classification through natural language prompts, such as "this is a sound of" followed by category names. In this work, we explore alternative…

Sound · Computer Science 2024-09-23 Michel Olvera , Paraskevas Stamatiadis , Slim Essid

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

Computation and Language · Computer Science 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Aditya Ramesh , Mikhail Pavlov , Gabriel Goh , Scott Gray , Chelsea Voss , Alec Radford , Mark Chen , Ilya Sutskever

Current text classification methods typically require a good number of human-labeled documents as training data, which can be costly and difficult to obtain in real applications. Humans can perform classification without seeing any labeled…

Computation and Language · Computer Science 2020-10-15 Yu Meng , Yunyi Zhang , Jiaxin Huang , Chenyan Xiong , Heng Ji , Chao Zhang , Jiawei Han

Within textual emotion classification, the set of relevant labels depends on the domain and application scenario and might not be known at the time of model development. This conflicts with the classical paradigm of supervised learning in…

Computation and Language · Computer Science 2022-09-16 Flor Miriam Plaza-del-Arco , María-Teresa Martín-Valdivia , Roman Klinger

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Substantial improvements have been made in machine reading comprehension, where the machine answers questions based on a given context. Current state-of-the-art models even surpass human performance on several benchmarks. However, their…

Computation and Language · Computer Science 2021-05-11 Wei-Cheng Huang , Chien-yu Huang , Hung-yi Lee

Zero-shot entity and relation classification models leverage available external information of unseen classes -- e.g., textual descriptions -- to annotate input text data. Thanks to the minimum data requirement, Zero-Shot Learning (ZSL)…

Computation and Language · Computer Science 2024-06-05 Gabriele Picco , Leopold Fuchs , Marcos Martínez Galindo , Alberto Purpura , Vanessa López , Hoang Thanh Lam

Recent advances in large language and vision-language models have enabled zero-shot inference, allowing models to solve new tasks without task-specific training. Various adaptation techniques such as prompt engineering, In-Context Learning…

Machine Learning · Computer Science 2025-04-04 Artyom Gadetsky , Andrei Atanov , Yulun Jiang , Zhitong Gao , Ghazal Hosseini Mighan , Amir Zamir , Maria Brbic