English
Related papers

Related papers: Preserving Semantic Relations for Zero-Shot Learni…

200 papers

We present a novel latent embedding model for learning a compatibility function between image and class embeddings, in the context of zero-shot classification. The proposed method augments the state-of-the-art bilinear compatibility model…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Yongqin Xian , Zeynep Akata , Gaurav Sharma , Quynh Nguyen , Matthias Hein , Bernt Schiele

In this paper we propose a non-metric ranking-based representation of semantic similarity that allows natural aggregation of semantic information from multiple heterogeneous sources. We apply the ranking-based representation to zero-shot…

Machine Learning · Computer Science 2015-03-02 Jihun Hamm , Mikhail Belkin

It is expensive and difficult to obtain the large number of sentence-level intent and token-level slot label annotations required to train neural network (NN)-based Natural Language Understanding (NLU) components of task-oriented dialog…

Computation and Language · Computer Science 2022-12-16 Rashmi Gangadharaiah , Balakrishnan Narayanaswamy

Zero-shot skeleton-based action recognition aims to recognize actions of unseen categories after training on data of seen categories. The key is to build the connection between visual and semantic space from seen to unseen classes. Previous…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yujie Zhou , Wenwen Qiang , Anyi Rao , Ning Lin , Bing Su , Jiaqi Wang

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by learning seen classes and known attributes, but correlations in attributes were ignored by previous study which lead to classification results confused. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang

We propose a novel framework called Semantics-Preserving Adversarial Embedding Network (SP-AEN) for zero-shot visual recognition (ZSL), where test images and their classes are both unseen during training. SP-AEN aims to tackle the inherent…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Long Chen , Hanwang Zhang , Jun Xiao , Wei Liu , Shih-Fu Chang

We propose a zero-shot learning relation classification (ZSLRC) framework that improves on state-of-the-art by its ability to recognize novel relations that were not present in training data. The zero-shot learning approach mimics the way…

Computation and Language · Computer Science 2021-11-22 Jiaying Gong , Hoda Eldardiry

The performance of generative zero-shot methods mainly depends on the quality of generated features and how well the model facilitates knowledge transfer between visual and semantic domains. The quality of generated features is a direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Shivam Chandhok , Vineeth N Balasubramanian

Zero-shot entity and relation classification models leverage available external information of unseen classes -- e.g., textual descriptions -- to annotate input text data. Thanks to the minimum data requirement, Zero-Shot Learning (ZSL)…

Computation and Language · Computer Science 2024-06-05 Gabriele Picco , Leopold Fuchs , Marcos Martínez Galindo , Alberto Purpura , Vanessa López , Hoang Thanh Lam

In this paper, we address an open problem of zero-shot learning. Its principle is based on learning a mapping that associates feature vectors extracted from i.e. images and attribute vectors that describe objects and/or scenes of interest.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Hongguang Zhang , Piotr Koniusz

Zero-shot learning (ZSL) aims at recognizing unseen classes with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space (FS) shared by both seen and unseen classes, i.e., attributes or…

Machine Learning · Computer Science 2019-04-15 Jingcai Guo , Song Guo

Zero-shot learning enables the model to recognize unseen categories with the aid of auxiliary semantic information such as attributes. Current works proposed to detect attributes from local image regions and align extracted features with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Junzhe Xu , Suling Duan , Chenwei Tang , Zhenan He , Jiancheng Lv

We study the problem of compositional zero-shot learning for object-attribute recognition. Prior works use visual features extracted with a backbone network, pre-trained for object classification and thus do not capture the subtly distinct…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Nirat Saini , Khoi Pham , Abhinav Shrivastava

As we move towards large-scale object detection, it is unrealistic to expect annotated training data, in the form of bounding box annotations around objects, for all object classes at sufficient scale, and so methods capable of unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

In principle, zero-shot learning makes it possible to train a recognition model simply by specifying the category's attributes. For example, with classifiers for generic attributes like \emph{striped} and \emph{four-legged}, one can…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Dinesh Jayaraman , Kristen Grauman

Knowledge transfer, zero-shot learning and semantic image retrieval are methods that aim at improving accuracy by utilizing semantic information, e.g. from WordNet. It is assumed that this information can augment or replace missing visual…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Clemens-Alexander Brust , Joachim Denzler

State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information. In these formulations the current best complement to visual features are attributes: manually encoded…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Scott Reed , Zeynep Akata , Bernt Schiele , Honglak Lee

Vision-Language Models (VLMs) have demonstrated impressive capabilities in zero-shot action recognition by learning to associate video embeddings with class embeddings. However, a significant challenge arises when relying solely on action…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yehna Kim , Young-Eun Kim , Seong-Whan Lee

Visual Semantic Embedding (VSE) models, which map images into a rich semantic embedding space, have been a milestone in object recognition and zero-shot learning. Current approaches to VSE heavily rely on static word em-bedding techniques.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yue Jiao , Jonathon Hare , Adam Prügel-Bennett

Zero-Shot Learning (ZSL) has received extensive attention and successes in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. Key to ZSL is to transfer knowledge from the seen to the unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Xingxing Zhang , Shupeng Gui , Zhenfeng Zhu , Yao Zhao , Ji Liu