English
Related papers

Related papers: What Remains of Visual Semantic Embeddings

200 papers

We present a new embedding-based framework for zero-shot learning (ZSL). Most embedding-based methods aim to learn the correspondence between an image classifier (visual representation) and its class prototype (semantic representation) for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Mei-Chen Yeh , Fang Li

Zero-shot learning (ZSL) aims to recognize unseen classes by generalizing the relation between visual features and semantic attributes learned from the seen classes. A recent paradigm called transductive zero-shot learning further leverages…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Zhengbo Wang , Jian Liang , Zilei Wang , Tieniu Tan

In image recognition, there are many cases where training samples cannot cover all target classes. Zero-shot learning (ZSL) utilizes the class semantic information to classify samples of the unseen categories that have no corresponding…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Fan Wu , Kai Tian , Jihong Guan , Shuigeng Zhou

The need to address the scarcity of task-specific annotated data has resulted in concerted efforts in recent years for specific settings such as zero-shot learning (ZSL) and domain generalization (DG), to separately address the issues of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shivam Chandhok , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Vineeth N Balasubramanian , Fahad Shahbaz Khan , Ling Shao

Zero-shot learning (ZSL) aims to identify unseen classes with zero samples during training. Broadly speaking, present ZSL methods usually adopt class-level semantic labels and compare them with instance-level semantic predictions to infer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zihan Ye , Guanyu Yang , Xiaobo Jin , Youfa Liu , Kaizhu Huang

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Fully supervised semantic segmentation technologies bring a paradigm shift in scene understanding. However, the burden of expensive labeling cost remains as a challenge. To solve the cost problem, recent studies proposed language model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Sungguk Cha , Yooseung Wang

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Zero-shot learning (ZSL) aims to leverage additional semantic information to recognize unseen classes. To transfer knowledge from seen to unseen classes, most ZSL methods often learn a shared embedding space by simply aligning visual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Bowen Duan , Shiming Chen , Yufei Guo , Guo-Sen Xie , Weiping Ding , Yisong Wang

Zero-shot learning (ZSL) recognizes the unseen classes by conducting visual-semantic interactions to transfer semantic knowledge from seen classes to unseen ones, supported by semantic information (e.g., attributes). However, existing ZSL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shiming Chen , Wenjin Hou , Salman Khan , Fahad Shahbaz Khan

Zero-shot learning, which studies the problem of object classification for categories for which we have no training examples, is gaining increasing attention from community. Most existing ZSL methods exploit deterministic transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Yanan Li , Donghui Wang

To bridge the gap between supervised semantic segmentation and real-world applications that acquires one model to recognize arbitrary new concepts, recent zero-shot segmentation attracts a lot of attention by exploring the relationships…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Quande Liu , Youpeng Wen , Jianhua Han , Chunjing Xu , Hang Xu , Xiaodan Liang

Zero-Shot Learning (ZSL) promises to scale visual recognition by bypassing the conventional model training requirement of annotated examples for every category. This is achieved by establishing a mapping connecting low-level features and a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xun Xu , Timothy M. Hospedales , Shaogang Gong

Recent work shows that documents from encyclopedias serve as helpful auxiliary information for zero-shot learning. Existing methods align the entire semantics of a document with corresponding images to transfer knowledge. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Xiangyan Qu , Jing Yu , Keke Gai , Jiamin Zhuang , Yuanmin Tang , Gang Xiong , Gaopeng Gou , Qi Wu

Zero-shot learning (ZSL) enables solving a task without the need to see its examples. In this paper, we propose two ZSL frameworks that learn to synthesize parameters for novel unseen classes. First, we propose to cast the problem of ZSL as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

The number of categories for action recognition is growing rapidly. It is thus becoming increasingly hard to collect sufficient training data to learn conventional models for each category. This issue may be ameliorated by the increasingly…

Computer Vision and Pattern Recognition · Computer Science 2015-11-17 Xun Xu , Timothy Hospedales , Shaogang Gong

Zero-shot object detection (ZSD), the task that extends conventional detection models to detecting objects from unseen categories, has emerged as a new challenge in computer vision. Most existing approaches tackle the ZSD task with a strict…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Caixia Yan , Xiaojun Chang , Minnan Luo , Huan Liu , Xiaoqin Zhang , Qinghua Zheng

Generalised zero-shot learning (GZSL) is a classification problem where the learning stage relies on a set of seen visual classes and the inference stage aims to identify both the seen visual classes and a new set of unseen visual classes.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Rafael Felix , Ben Harwood , Michele Sasdelli , Gustavo Carneiro

We propose a novel approach to improve a visual-semantic embedding model by incorporating concept representations captured from an external structured knowledge base. We investigate its performance on image classification under both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Mirantha Jayathilaka , Tingting Mu , Uli Sattler

Generalized Zero-Shot Learning (GZSL) and Open-Set Recognition (OSR) are two mainstream settings that greatly extend conventional visual object recognition. However, the limitations of their problem settings are not negligible. The novel…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Zhaonan Li , Hongfu Liu