English
Related papers

Related papers: CLIP-driven Zero-shot Learning with Ambiguous Labe…

200 papers

This paper introduces a novel framework for zero-shot learning (ZSL), i.e., to recognize new categories that are unseen during training, by using a multi-model and multi-alignment integration method. Specifically, we propose three…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Siqi Yin , Lifan Jiang

Zero-shot learning (ZSL) aims to recognize a set of unseen classes without any training images. The standard approach to ZSL requires a set of training images annotated with seen class labels and a semantic descriptor for seen/unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Nanyi Fei , Jiechao Guan , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

Learning with Noisy labels (LNL) poses a significant challenge for the Machine Learning community. Some of the most widely used approaches that select as clean samples for which the model itself (the in-training model) has high confidence,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Chen Feng , Georgios Tzimiropoulos , Ioannis Patras

Fine-tuning vision-language models (VLMs) like CLIP to downstream tasks is often necessary to optimize their performance. However, a major obstacle is the limited availability of labeled data. We study the use of pseudolabels, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Cristina Menghini , Andrew Delworth , Stephen H. Bach

Zero-shot learning (ZSL) methods have been studied in the unrealistic setting where test data are assumed to come from unseen classes only. In this paper, we advocate studying the problem of generalized zero-shot learning (GZSL) where the…

Computer Vision and Pattern Recognition · Computer Science 2017-01-12 Wei-Lun Chao , Soravit Changpinyo , Boqing Gong , Fei Sha

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Zero-Shot Learning (ZSL) is a classification task where we do not have even a single training labeled example from a set of unseen classes. Instead, we only have prior information (or description) about seen and unseen classes, often in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Shabnam Daghaghi , Tharun Medini , Anshumali Shrivastava

Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Bowen Tang , Long Yan , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Multi-label classification is an essential task utilized in a wide variety of real-world applications. Multi-label zero-shot learning is a method for classifying images into multiple unseen categories for which no training data is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Muhammad Ali , Salman Khan

Zero-shot learning (ZSL) which aims to recognize unseen object classes by only training on seen object classes, has increasingly been of great interest in Machine Learning, and has registered with some successes. Most existing ZSL methods…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Wen Tang , Ashkan Panahi , Hamid Krim

Zero-shot learning (ZSL) can be formulated as a cross-domain matching problem: after being projected into a joint embedding space, a visual sample will match against all candidate class-level semantic descriptions and be assigned to the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Lei Zhang , Peng Wang , Lingqiao Liu , Chunhua Shen , Wei Wei , Yannning Zhang , Anton Van Den Hengel

Recently, CLIP has been applied to pixel-level zero-shot learning tasks via a two-stage scheme. The general idea is to first generate class-agnostic region proposals and then feed the cropped proposal regions to CLIP to utilize its…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ziqin Zhou , Bowen Zhang , Yinjie Lei , Lingqiao Liu , Yifan Liu

Supervised learning requires a sufficient training dataset which includes all label. However, there are cases that some class is not in the training data. Zero-Shot Learning (ZSL) is the task of predicting class that is not in the training…

Machine Learning · Computer Science 2020-07-02 Toshitaka Hayashi , Hamido Fujita

In Zero-Shot Learning (ZSL), embedding-based methods enable knowledge transfer from seen to unseen classes by learning a visual-semantic mapping from seen-class images to class-level semantic prototypes (e.g., attributes). However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Lei Wang , Shiming Chen , Guo-Sen Xie , Ziming Hong , Chaojian Yu , Qinmu Peng , Xinge You

Leveraging class semantic descriptions and examples of known objects, zero-shot learning makes it possible to train a recognition model for an object class whose examples are not available. In this paper, we propose a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Soravit Changpinyo , Wei-Lun Chao , Fei Sha

Zero-shot learning (ZSL) aims to recognize unseen image categories by learning an embedding space between image and semantic representations. For years, among existing works, it has been the center task to learn the proper mapping matrices…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yan Li , Junge Zhang , Jianguo Zhang , Kaiqi Huang

We propose a novel Generalized Zero-Shot learning (GZSL) method that is agnostic to both unseen images and unseen semantic vectors during training. Prior works in this context propose to map high-dimensional visual features to the semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

Semantic segmentation is a fundamental task in medical image analysis and autonomous driving and has a problem with the high cost of annotating the labels required in training. To address this problem, semantic segmentation methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Nagito Saito , Shintaro Ito , Koichi Ito , Takafumi Aoki