English
Related papers

Related papers: Attribute Prototype Network for Zero-Shot Learning

200 papers

Vision-language models trained on large, randomly collected data had significant impact in many areas since they appeared. But as they show great performance in various fields, such as image-text-retrieval, their inner workings are still…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Felix Vogel , Nina Shvetsova , Leonid Karlinsky , Hilde Kuehne

Current approaches in Generalized Zero-Shot Learning (GZSL) are built upon base models which consider only a single class attribute vector representation over the entire image. This is an oversimplification of the process of novel category…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Joshua Feinglass , Jayaraman J. Thiagarajan , Rushil Anirudh , T. S. Jayram , Yezhou Yang

We present a cross-modal Transformer-based framework, which jointly encodes video data and text labels for zero-shot action recognition (ZSAR). Our model employs a conceptually new pipeline by which visual representations are learned in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Chung-Ching Lin , Kevin Lin , Linjie Li , Lijuan Wang , Zicheng Liu

We introduce the isoperimetric loss as a regularization criterion for learning the map from a visual representation to a semantic embedding, to be used to transfer knowledge to unknown classes in a zero-shot learning setting. We use a…

Machine Learning · Computer Science 2019-12-05 Shay Deutsch , Andrea Bertozzi , Stefano Soatto

In this report we present an unsupervised image registration framework, using a pre-trained deep neural network as a feature extractor. We refer this to zero-shot learning, due to nonoverlap between training and testing dataset (none of the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Avinash Kori , Ganapathi Krishnamurthi

Zero-shot recognition (ZSR) aims to recognize target-domain data instances of unseen classes based on the models learned from associated pairs of seen-class source and target domain data. One of the key challenges in ZSR is the relative…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Ziming Zhang , Venkatesh Saligrama

Zero-shot learning (ZSL) aims to recognize the novel object categories using the semantic representation of categories, and the key idea is to explore the knowledge of how the novel class is semantically related to the familiar classes.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Ying Shi , Wei Wei , Zhiming Zheng

Generalized compositional zero-shot learning means to learn composed concepts of attribute-object pairs in a zero-shot fashion, where a model is trained on a set of seen concepts and tested on a combined set of seen and unseen concepts.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 He Huang , Wei Tang , Jiawei Zhang , Philip S. Yu

Scaling up visual category recognition to large numbers of classes remains challenging. A promising research direction is zero-shot learning, which does not require any training data to recognize new classes, but rather relies on some form…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Zeynep Akata , Mateusz Malinowski , Mario Fritz , Bernt Schiele

Zero-shot learning (ZSL) aims to discriminate images from unseen classes by exploiting relations to seen classes via their attribute-based descriptions. Since attributes are often related to specific parts of objects, many recent works…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Shiqi Yang , Kai Wang , Luis Herranz , Joost van de Weijer

Given semantic descriptions of object classes, zero-shot learning aims to accurately recognize objects of the unseen classes, from which no examples are available at the training stage, by associating them to the seen classes, from which…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

Supervised learning methods can solve the given problem in the presence of a large set of labeled data. However, the acquisition of a dataset covering all the target classes typically requires manual labeling which is expensive and…

Sound · Computer Science 2022-06-13 Duygu Dogan , Huang Xie , Toni Heittola , Tuomas Virtanen

One-shot learning focuses on adapting pretrained models to recognize newly introduced and unseen classes based on a single labeled image. While variations of few-shot and zero-shot learning exist, one-shot learning remains a challenging yet…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Kyle Stein , Andrew A. Mahyari , Guillermo Francia , Eman El-Sheikh

A classic approach toward zero-shot learning (ZSL) is to map the input domain to a set of semantically meaningful attributes that could be used later on to classify unseen classes of data (e.g. visual data). In this paper, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-13 Soheil Kolouri , Mohammad Rostami , Yuri Owechko , Kyungnam Kim

Several recent publications have proposed methods for mapping images into continuous semantic embedding spaces. In some cases the embedding space is trained jointly with the image transformation. In other cases the semantic embedding space…

Machine Learning · Computer Science 2017-02-28 Mohammad Norouzi , Tomas Mikolov , Samy Bengio , Yoram Singer , Jonathon Shlens , Andrea Frome , Greg S. Corrado , Jeffrey Dean

Attribute-based recognition models, due to their impressive performance and their ability to generalize well on novel categories, have been widely adopted for many computer vision applications. However, usually both the attribute vocabulary…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Ziad Al-Halah , Rainer Stiefelhagen

We propose a novel approach for unsupervised zero-shot learning (ZSL) of classes based on their names. Most existing unsupervised ZSL methods aim to learn a model for directly comparing image features and class names. However, this proves…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Berkan Demirel , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Zero-shot learning uses semantic attributes to connect the search space of unseen objects. In recent years, although the deep convolutional network brings powerful visual modeling capabilities to the ZSL task, its visual features have…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Yang Hu , Guihua Wen , Adriane Chapman , Pei Yang , Mingnan Luo , Yingxue Xu , Dan Dai , Wendy Hall

Many of the existing methods for learning joint embedding of images and text use only supervised information from paired images and its textual attributes. Taking advantage of the recent success of unsupervised learning in deep neural…

Computer Vision and Pattern Recognition · Computer Science 2017-03-21 Yao-Hung Hubert Tsai , Liang-Kang Huang , Ruslan Salakhutdinov

Zero-shot learning relies on semantic class representations such as hand-engineered attributes or learned embeddings to predict classes without any labeled examples. We propose to learn class representations by embedding nodes from common…

Machine Learning · Computer Science 2022-08-29 Nihal V. Nayak , Stephen H. Bach