English
Related papers

Related papers: Zero-Shot Learning Through Cross-Modal Transfer

200 papers

Zero-shot learning (ZSL) aims at recognizing classes for which no visual sample is available at training time. To address this issue, one can rely on a semantic description of each class. A typical ZSL model learns a mapping between the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Celina Hanouti , Hervé Le Borgne

Current Zero-Shot Learning (ZSL) approaches are restricted to recognition of a single dominant unseen object category in a test image. We hypothesize that this setting is ill-suited for real-world applications where unseen objects appear…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Shafin Rahman , Salman Khan , Fatih Porikli

In some of object recognition problems, labeled data may not be available for all categories. Zero-shot learning utilizes auxiliary information (also called signatures) describing each category in order to find a classifier that can…

Computer Vision and Pattern Recognition · Computer Science 2016-06-01 Seyed Mohsen Shojaee , Mahdieh Soleymani Baghshah

This work focuses on the semantic relations between scenes and objects for visual object recognition. Semantic knowledge can be a powerful source of information especially in scenarios with few or no annotated training samples. These…

Computer Vision and Pattern Recognition · Computer Science 2016-12-23 Rene Grzeszick , Gernot A. Fink

In this paper we consider a version of the zero-shot learning problem where seen class source and target domain data are provided. The goal during test-time is to accurately predict the class label of an unseen target domain instance based…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Ziming Zhang , Venkatesh Saligrama

Many data sets (e.g., reviews, forums, news, etc.) exist parallelly in multiple languages. They all cover the same content, but the linguistic differences make it impossible to use traditional, bag-of-word-based topic models. Models have to…

Computation and Language · Computer Science 2021-02-05 Federico Bianchi , Silvia Terragni , Dirk Hovy , Debora Nozza , Elisabetta Fersini

Zero-shot learning extends the conventional object classification to the unseen class recognition by introducing semantic representations of classes. Existing approaches predominantly focus on learning the proper mapping function for…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Yizhe Zhu , Jianwen Xie , Zhiqiang Tang , Xi Peng , Ahmed Elgammal

Music classification and tagging is conducted through categorical supervised learning with a fixed set of labels. In principle, this cannot make predictions on unseen labels. Zero-shot learning is an approach to solve the problem by using…

Multimedia · Computer Science 2019-06-21 Jeong Choi , Jongpil Lee , Jiyoung Park , Juhan Nam

Recent advancements in text-to-image generative models have demonstrated a remarkable ability to capture a deep semantic understanding of images. In this work, we leverage this semantic knowledge to transfer the visual appearance between…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yuval Alaluf , Daniel Garibi , Or Patashnik , Hadar Averbuch-Elor , Daniel Cohen-Or

Zero-shot learning (ZL) is crucial for tasks involving unseen categories, such as natural language processing, image classification, and cross-lingual transfer.Current applications often fail to accurately infer and handle new relations…

Artificial Intelligence · Computer Science 2025-04-08 Bingchen Liu , Jingchen Li , Yuanyuan Fang , Xin Li

Zero-shot learning (ZSL) aims to recognize unseen image categories by learning an embedding space between image and semantic representations. For years, among existing works, it has been the center task to learn the proper mapping matrices…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yan Li , Junge Zhang , Jianguo Zhang , Kaiqi Huang

This paper presents a method of zero-shot learning (ZSL) which poses ZSL as the missing data problem, rather than the missing label problem. Specifically, most existing ZSL methods focus on learning mapping functions from the image feature…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Botong Wu , Tianfu Wu , Yizhou Wang

Semantic segmentation models are limited in their ability to scale to large numbers of object classes. In this paper, we introduce the new task of zero-shot semantic segmentation: learning pixel-wise classifiers for never-seen object…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Maxime Bucher , Tuan-Hung Vu , Matthieu Cord , Patrick Pérez

The existing zero-shot detection approaches project visual features to the semantic domain for seen objects, hoping to map unseen objects to their corresponding semantics during inference. However, since the unseen objects are never…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nasir Hayat , Munawar Hayat , Shafin Rahman , Salman Khan , Syed Waqas Zamir , Fahad Shahbaz Khan

This paper addresses the task of zero-shot image classification. The key contribution of the proposed approach is to control the semantic embedding of images -- one of the main ingredients of zero-shot learning -- by formulating it as a…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Maxime Bucher , Stéphane Herbin , Frédéric Jurie

Zero-shot learning (ZSL) has received increasing attention in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. The key to ZSL is to transfer knowledge from the seen to the unseen classes…

Machine Learning · Computer Science 2020-02-12 Zhizhe Liu , Xingxing Zhang , Zhenfeng Zhu , Shuai Zheng , Yao Zhao , Jian Cheng

From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image representation with…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Wenjia Xu , Yongqin Xian , Jiuniu Wang , Bernt Schiele , Zeynep Akata

In this report we present an unsupervised image registration framework, using a pre-trained deep neural network as a feature extractor. We refer this to zero-shot learning, due to nonoverlap between training and testing dataset (none of the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Avinash Kori , Ganapathi Krishnamurthi

Tactile sensing plays an irreplaceable role in robotic material recognition. It enables robots to distinguish material properties such as their local geometry and textures, especially for materials like textiles. However, most tactile…

Robotics · Computer Science 2023-06-23 Guanqun Cao , Jiaqi Jiang , Danushka Bollegala , Min Li , Shan Luo

In Computer Vision, Zero-Shot Learning (ZSL) aims at classifying unseen classes -- classes for which no matching training image exists. Most of ZSL works learn a cross-modal mapping between images and class labels for seen classes. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Patrick Bordes , Eloi Zablocki , Benjamin Piwowarski , Patrick Gallinari