English
Related papers

Related papers: Learning Visual Proxy for Compositional Zero-Shot …

200 papers

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Open-World Compositional Zero-Shot Learning (OW-CZSL) aims to recognize new compositions of seen attributes and objects. In OW-CZSL, methods built on the conventional closed-world setting degrade severely due to the unconstrained OW test…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Yun Li , Zhe Liu , Saurav Jha , Sally Cripps , Lina Yao

Humans are able to identify and categorize novel compositions of known concepts. The task in Compositional Zero-Shot learning (CZSL) is to learn composition of primitive concepts, i.e. objects and states, in such a way that even their novel…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Muhammad Umer Anwaar , Zhihui Pan , Martin Kleinsteuber

Vision and language models (VLMs) such as CLIP have showcased remarkable zero-shot recognition abilities yet face challenges in visio-linguistic compositionality, particularly in linguistic comprehension and fine-grained image-text…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Youngtaek Oh , Pyunghwan Ahn , Jinhyung Kim , Gwangmo Song , Soonyoung Lee , In So Kweon , Junmo Kim

Generalised zero-shot learning (GZSL) methods aim to classify previously seen and unseen visual classes by leveraging the semantic information of those classes. In the context of GZSL, semantic information is non-visual data such as a text…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rafael Felix , Ben Harwood , Michele Sasdelli , Gustavo Carneiro

Generalized zero-shot learning (GZSL) aims to classify samples under the assumption that some classes are not observable during training. To bridge the gap between the seen and unseen classes, most GZSL methods attempt to associate the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Zhi Chen , Yadan Luo , Ruihong Qiu , Sen Wang , Zi Huang , Jingjing Li , Zheng Zhang

Generalized zero-shot learning aims to recognize both seen and unseen classes with the help of semantic information that is shared among different classes. It inevitably requires consistent visual-semantic alignment. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Huajie Jiang , Zhengxian Li , Xiaohan Yu , Yongli Hu , Baocai Yin , Jian Yang , Yuankai Qi

We present an audio-visual multimodal approach for the task of zeroshot learning (ZSL) for classification and retrieval of videos. ZSL has been studied extensively in the recent past but has primarily been limited to visual modality and to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Kranti Kumar Parida , Neeraj Matiyali , Tanaya Guha , Gaurav Sharma

Generalized Zero-Shot Learning (GZSL) aims to train a classifier that can generalize to unseen classes, using a set of attributes as auxiliary information, and the visual features extracted from a pre-trained convolutional neural network.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Paola Cascante-Bonilla , Leonid Karlinsky , James Seale Smith , Yanjun Qi , Vicente Ordonez

Vision-language models (VLMs) classify the query video by calculating a similarity score between the visual features and text-based class label representations. Recently, large language models (LLMs) have been used to enrich the text-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Adeel Yousaf , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

To recognize objects of the unseen classes, most existing Zero-Shot Learning(ZSL) methods first learn a compatible projection function between the common semantic space and the visual space based on the data of source seen classes, then…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Ziyu Wan , Dongdong Chen , Yan Li , Xingguang Yan , Junge Zhang , Yizhou Yu , Jing Liao

Zero-shot learning (ZSL) aims to recognize unseen classes by exploiting semantic descriptions shared between seen classes and unseen classes. Current methods show that it is effective to learn visual-semantic alignment by projecting…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Zaiquan Yang , Yang Liu , Wenjia Xu , Chong Huang , Lei Zhou , Chao Tong

Zero-shot learning (ZSL) is a framework to classify images belonging to unseen classes based on solely semantic information about these unseen classes. In this paper, we propose a new ZSL algorithm using coupled dictionary learning. The…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Mohammad Rostami , Soheil Kolouri , Zak Murez , Yuri Owekcho , Eric Eaton , Kuyngnam Kim

Vision-language models (VLMs) like CLIP have showcased a remarkable ability to extract transferable features for downstream tasks. Nonetheless, the training process of these models is usually based on a coarse-grained contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Ali Abdollah , Amirmohammad Izadi , Armin Saghafian , Reza Vahidimajd , Mohammad Mozafari , Amirreza Mirzaei , Mohammadmahdi Samiei , Mahdieh Soleymani Baghshah

Few-shot learning (FSL) aims to recognize novel concepts from only a few labeled support samples. Recent studies enhance support features by incorporating additional semantic information or designing complex semantic fusion modules.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Wenhao Li , Qiangchang Wang , Xianjing Meng , Zhibin Wu , Yilong Yin

Zero-Shot Learning (ZSL) aims to classify a test instance from an unseen category based on the training instances from seen categories, in which the gap between seen categories and unseen categories is generally bridged via visual-semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Li Niu , Jianfei Cai , Ashok Veeraraghavan

Vision-Language Models (VLMs) have shown remarkable capabilities in a large number of downstream tasks. Nonetheless, compositional image understanding remains a rather difficult task due to the object bias present in training data. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Matteo Nulli , Anesa Ibrahimi , Avik Pal , Hoshe Lee , Ivona Najdenkoska

Zero-shot learning (ZSL) makes object recognition in images possible in absence of visual training data for a part of the classes from a dataset. When the number of classes is large, classes are usually represented by semantic class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Yannick Le Cacheux , Adrian Popescu , Hervé Le Borgne

Recently, zero-shot learning (ZSL) emerged as an exciting topic and attracted a lot of attention. ZSL aims to classify unseen classes by transferring the knowledge from seen classes to unseen classes based on the class description. Despite…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Vision-language pre-training methods, e.g., CLIP, demonstrate an impressive zero-shot performance on visual categorizations with the class proxy from the text embedding of the class name. However, the modality gap between the text and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Qi Qian , Yuanhong Xu , Juhua Hu