English
Related papers

Related papers: What Remains of Visual Semantic Embeddings

200 papers

Large scale vision and language models can achieve impressive zero-shot recognition performance by mapping class specific text queries to image content. Two distinct challenges that remain however, are high sensitivity to the choice of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Sarah Parisot , Yongxin Yang , Steven McDonagh

Zero-shot learning is a new paradigm to classify objects from classes that are not available at training time. Zero-shot learning (ZSL) methods have attracted considerable attention in recent years because of their ability to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Many recent advances in computer vision are the result of a healthy competition among researchers on high quality, task-specific, benchmarks. After a decade of active research, zero-shot learning (ZSL) models accuracy on the Imagenet…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Tristan Hascoet , Yasuo Ariki , Tetsuya Takiguchi

Zero-shot learning aims to recognize unseen objects using their semantic representations. Most existing works use visual attributes labeled by humans, not suitable for large-scale applications. In this paper, we revisit the use of documents…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jihyung Kil , Wei-Lun Chao

We propose a novel framework called Semantics-Preserving Adversarial Embedding Network (SP-AEN) for zero-shot visual recognition (ZSL), where test images and their classes are both unseen during training. SP-AEN aims to tackle the inherent…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Long Chen , Hanwang Zhang , Jun Xiao , Wei Liu , Shih-Fu Chang

Semantic Image Interpretation is the task of extracting a structured semantic description from images. This requires the detection of visual relationships: triples (subject,relation,object) describing a semantic relation between a subject…

Machine Learning · Computer Science 2019-10-02 Ivan Donadello , Luciano Serafini

While there has been a number of studies on Zero-Shot Learning (ZSL) for 2D images, its application to 3D data is still recent and scarce, with just a few methods limited to classification. We present the first generative approach for both…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Björn Michele , Alexandre Boulch , Gilles Puy , Maxime Bucher , Renaud Marlet

Compositional Zero-Shot Learning (CZSL) aims to recognize novel compositions using knowledge learned from seen attribute-object compositions in the training set. Previous works mainly project an image and a composition into a common…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tian Zhang , Kongming Liang , Ruoyi Du , Xian Sun , Zhanyu Ma , Jun Guo

Zero-shot learning has gained popularity due to its potential to scale recognition models without requiring additional training data. This is usually achieved by associating categories with their semantic information like attributes.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Yashas Annadani , Soma Biswas

Transductive Zero-shot learning (ZSL) targets to recognize the unseen categories by aligning the visual and semantic information in a joint embedding space. There exist four kinds of domain biases in Transductive ZSL, i.e., visual bias and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Hantao Yao , Shaobo Min , Yongdong Zhang , Changsheng Xu

In Zero-shot learning (ZSL), we classify unseen categories using textual descriptions about their expected appearance when observed (class embeddings) and a disjoint pool of seen classes, for which annotated visual data are accessible. We…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Jacopo Cavazza

Recently, many zero-shot learning (ZSL) methods focused on learning discriminative object features in an embedding feature space, however, the distributions of the unseen-class features learned by these methods are prone to be partly…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Bo Liu , Qiulei Dong , Zhanyi Hu

We present a novel deep zero-shot learning (ZSL) model for inferencing human-object-interaction with verb-object (VO) query. While the previous two-stream ZSL approaches only use the semantic/textual information to be fed into the query…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Sungmin Eum , Heesung Kwon

Zero-Shot Learning (ZSL) has attracted huge research attention over the past few years; it aims to learn the new concepts that have never been seen before. In classical ZSL algorithms, attributes are introduced as the intermediate semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Yanwei Fu , Rui Liang , Jiahong Wu , Yonggang Wang , Yizhou Wang

Zero-shot Learning (ZSL) classification categorizes or predicts classes (labels) that are not included in the training set (unseen classes). Recent works proposed different semantic autoencoder (SAE) models where the encoder embeds a visual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 William Heyden , Habib Ullah , M. Salman Siddiqui , Fadi Al Machot

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are highly local,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Yang Liu , Lei Zhou , Xiao Bai , Yifei Huang , Lin Gu , Jun Zhou , Tatsuya Harada

In this paper, we propose a novel deep learning architecture for multi-label zero-shot learning (ML-ZSL), which is able to predict multiple unseen class labels for each input instance. Inspired by the way humans utilize semantic knowledge…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Chung-Wei Lee , Wei Fang , Chih-Kuan Yeh , Yu-Chiang Frank Wang

Generalized zero-shot learning (GZSL) is a technique to train a deep learning model to identify unseen classes using the attribute. In this paper, we put forth a new GZSL technique that improves the GZSL classification performance greatly.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Junhan Kim , Kyuhong Shim , Byonghyo Shim

Zero-shot learning (ZSL) aims to recognize the unseen classes in the open-world guided by the side-information (e.g., attributes). Its key task is how to infer the latent semantic knowledge between visual and attribute features on seen…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Shiming Chen , Shuhuang Chen , Guo-Sen Xie , Xinge You

Recent mask proposal models have significantly improved the performance of zero-shot semantic segmentation. However, the use of a `background' embedding during training in these methods is problematic as the resulting model tends to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Son Duy Dao , Hengcan Shi , Dinh Phung , Jianfei Cai