English
Related papers

Related papers: CLIP-driven Zero-shot Learning with Ambiguous Labe…

200 papers

Recently, zero-shot learning (ZSL) emerged as an exciting topic and attracted a lot of attention. ZSL aims to classify unseen classes by transferring the knowledge from seen classes to unseen classes based on the class description. Despite…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

The task of zero-shot learning (ZSL) requires correctly predicting the label of samples from classes which were unseen at training time. This is achieved by leveraging side information about class labels, such as label attributes or word…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Colin Samplawski , Jannik Wolff , Tassilo Klein , Moin Nabi

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Though many ZSL methods rely on a direct mapping between the visual and the semantic space, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Yang Liu , Lei Zhou , Xiao Bai , Lin Gu , Tatsuya Harada , Jun Zhou

Generalised zero-shot learning (GZSL) methods aim to classify previously seen and unseen visual classes by leveraging the semantic information of those classes. In the context of GZSL, semantic information is non-visual data such as a text…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rafael Felix , Ben Harwood , Michele Sasdelli , Gustavo Carneiro

Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Hari Chandana Kuchibhotla , Sumitra S Malagi , Shivam Chandhok , Vineeth N Balasubramanian

Zero-Shot Learning (ZSL) promises to scale visual recognition by bypassing the conventional model training requirement of annotated examples for every category. This is achieved by establishing a mapping connecting low-level features and a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xun Xu , Timothy M. Hospedales , Shaogang Gong

Inspired by the remarkable zero-shot generalization capacity of vision-language pre-trained model, we seek to leverage the supervision from CLIP model to alleviate the burden of data labeling. However, such supervision inevitably contains…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Junchu Huang , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

Zero-shot learning (ZSL) is made possible by learning a projection function between a feature space and a semantic space (e.g.,~an attribute space). Key to ZSL is thus to learn a projection that is robust against the often large domain gap…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Zhiwu Lu , Jiechao Guan , Aoxue Li , Tao Xiang , An Zhao , Ji-Rong Wen

Multi-modal learning has become increasingly popular due to its ability to leverage information from different data sources (e.g., text and images) to improve the model performance. Recently, CLIP has emerged as an effective approach that…

Machine Learning · Computer Science 2024-07-12 Zixiang Chen , Yihe Deng , Yuanzhi Li , Quanquan Gu

Pretrained vision-language models, such as CLIP, show promising zero-shot performance across a wide variety of datasets. For closed-set classification tasks, however, there is an inherent limitation: CLIP image encoders are typically…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Piyapat Saranrittichai , Mauricio Munoz , Volker Fischer , Chaithanya Kumar Mummadi

Zero-Shot Learning (ZSL) aims to recognize unseen classes by generalizing the knowledge, i.e., visual and semantic relationships, obtained from seen classes, where image augmentation techniques are commonly applied to improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Zhi Chen , Pengfei Zhang , Jingjing Li , Sen Wang , Zi Huang

We introduce the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign class examples to recognize the instances of unseen signs. To this end, we propose to utilize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Yunus Can Bilge , Nazli Ikizler-Cinbis , Ramazan Gokberk Cinbis

Zero-shot learning aims to recognize instances of unseen classes, for which no visual instance is available during training, by learning multimodal relations between samples from seen classes and corresponding class semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Most existing Zero-Shot Learning (ZSL) methods have the strong bias problem, in which instances of unseen (target) classes tend to be categorized as one of the seen (source) classes. So they yield poor performance after being deployed in…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Jie Song , Chengchao Shen , Yezhou Yang , Yang Liu , Mingli Song

Zero-shot Learning (ZSL) enables classifiers to recognize classes unseen during training, commonly via generative two stage methods: (1) learn visual semantic correlations from seen classes; (2) synthesize unseen class features from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Zihan Ye , Shreyank N Gowda , Kaile Du , Weijian Luo , Ling Shao

Zero-shot learning (ZSL) aims at recognizing unseen class examples (e.g., images) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jingcai Guo

Vision-language pre-training such as CLIP enables zero-shot transfer that can classify images according to the candidate class names. While CLIP demonstrates an impressive zero-shot performance on diverse downstream tasks, the distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qi Qian , Juhua Hu

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by learning seen classes and known attributes, but correlations in attributes were ignored by previous study which lead to classification results confused. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang

Vision-Language Models like CLIP create aligned embedding spaces for text and images, making it possible for anyone to build a visual classifier by simply naming the classes they want to distinguish. However, a model that works well in one…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Kevin Robbins , Xiaotong Liu , Yu Wu , Le Sun , Grady McPeak , Abby Stylianou , Robert Pless

Zero-shot learning (ZSL) is one of the most extreme forms of learning from scarce labeled data. It enables predicting that images belong to classes for which no labeled training instances are available. In this paper, we present a new ZSL…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Colin Samplawski , Heesung Kwon , Erik Learned-Miller , Benjamin M. Marlin