English
Related papers

Related papers: EVA: Mixture-of-Experts Semantic Variant Alignment…

200 papers

Zero-shot learning (ZSL) is concerned with the recognition of previously unseen classes. It relies on additional semantic knowledge for which a mapping can be learned with training examples of seen classes. While classical ZSL considers the…

Machine Learning · Computer Science 2019-01-16 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

We present a new embedding-based framework for zero-shot learning (ZSL). Most embedding-based methods aim to learn the correspondence between an image classifier (visual representation) and its class prototype (semantic representation) for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Mei-Chen Yeh , Fang Li

Vision and language models (VLMs) such as CLIP have showcased remarkable zero-shot recognition abilities yet face challenges in visio-linguistic compositionality, particularly in linguistic comprehension and fine-grained image-text…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Youngtaek Oh , Pyunghwan Ahn , Jinhyung Kim , Gwangmo Song , Soonyoung Lee , In So Kweon , Junmo Kim

Zero-shot learning (ZSL) models rely on learning a joint embedding space where both textual/semantic description of object classes and visual representation of object images can be projected to for nearest neighbour search. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-22 Li Zhang , Tao Xiang , Shaogang Gong

Deep learning models struggle with compositional generalization, i.e. the ability to recognize or generate novel combinations of observed elementary concepts. In hopes of enabling compositional generalization, various unsupervised learning…

Machine Learning · Computer Science 2022-10-07 Zhenlin Xu , Marc Niethammer , Colin Raffel

Open World Compositional Zero-Shot Learning (OW-CZSL) is known to be an extremely challenging task, which aims to recognize unseen compositions formed from seen attributes and objects without any prior assumption of the output space. In…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Lingyu Zhang , Ting Hua , Yilin Shen , Hongxia Jin

In Zero-Shot Learning (ZSL), embedding-based methods enable knowledge transfer from seen to unseen classes by learning a visual-semantic mapping from seen-class images to class-level semantic prototypes (e.g., attributes). However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Lei Wang , Shiming Chen , Guo-Sen Xie , Ziming Hong , Chaojian Yu , Qinmu Peng , Xinge You

We introduce a novel problem of scene sketch zero-shot learning (SSZSL), which is a challenging task, since (i) different from photo, the gap between common semantic domain (e.g., word vector) and sketch is too huge to exploit common…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yao Xie , Peng Xu , Zhanyu Ma

The recent advance in deep generative models outlines a promising perspective in the realm of Zero-Shot Learning (ZSL). Most generative ZSL methods use category semantic attributes plus a Gaussian noise to generate visual features. After…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Xiaojie Zhao , Yuming Shen , Shidong Wang , Haofeng Zhang

Recently, zero-shot learning (ZSL) emerged as an exciting topic and attracted a lot of attention. ZSL aims to classify unseen classes by transferring the knowledge from seen classes to unseen classes based on the class description. Despite…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Zero shot learning (ZSL) has seen a surge in interest over the decade for its tight links with the mechanism making young children recognize novel objects. Although different paradigms of visual semantic embedding models are designed to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yue Jiao , Jonathon Hare , Adam Prügel-Bennett

Zero-shot recognition (ZSR) aims to recognize target-domain data instances of unseen classes based on the models learned from associated pairs of seen-class source and target domain data. One of the key challenges in ZSR is the relative…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Ziming Zhang , Venkatesh Saligrama

Although zero-shot learning (ZSL) has an inferential capability of recognizing new classes that have never been seen before, it always faces two fundamental challenges of the cross modality and crossdomain challenges. In order to alleviate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Cheng Xie , Hongxin Xiang , Ting Zeng , Yun Yang , Beibei Yu , Qing Liu

Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Bowen Tang , Long Yan , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Generalized Zero-Shot Learning (GZSL) aims to recognize both seen and unseen classes by training only the seen classes, in which the instances of unseen classes tend to be biased towards the seen class. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Yi Gao , Chenwei Tang , Jiancheng Lv

Zero-shot learning (ZSL) aims to identify unseen classes with zero samples during training. Broadly speaking, present ZSL methods usually adopt class-level semantic labels and compare them with instance-level semantic predictions to infer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zihan Ye , Guanyu Yang , Xiaobo Jin , Youfa Liu , Kaizhu Huang

Vision-language (VL) pretrained models have achieved impressive performance on multimodal reasoning and zero-shot recognition tasks. Many of these VL models are pretrained on unlabeled image and caption pairs from the internet. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Tian Yun , Usha Bhalla , Ellie Pavlick , Chen Sun

Zero-Shot Learning (ZSL) is typically achieved by resorting to a class semantic embedding space to transfer the knowledge from the seen classes to unseen ones. Capturing the common semantic characteristics between the visual modality and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Yunlong Yu , Zhong Ji , Jichang Guo , Zhongfei , Zhang

Recently, many zero-shot learning (ZSL) methods focused on learning discriminative object features in an embedding feature space, however, the distributions of the unseen-class features learned by these methods are prone to be partly…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Bo Liu , Qiulei Dong , Zhanyi Hu

Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable, but they often struggle in data-scarce settings where insufficient training samples lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Zhong Ji , Rongshuai Wei , Jingren Liu , Yanwei Pang , Jungong Han