English
Related papers

Related papers: AlignZeg: Mitigating Objective Misalignment for Ze…

200 papers

Recent approaches have shown that training deep neural networks directly on large-scale image-text pair collections enables zero-shot transfer on various recognition tasks. One central issue is how this can be generalized to object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Johnathan Xie , Shuai Zheng

The advancement of Zero-Shot Learning in the medical domain has been driven forward by using pre-trained models on large-scale image-text pairs, focusing on image-text alignment. However, existing methods primarily rely on cosine similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Haoran Lai , Qingsong Yao , Zihang Jiang , Rongsheng Wang , Zhiyang He , Xiaodong Tao , S. Kevin Zhou

Zero-shot classification is a promising paradigm to solve an applicable problem when the training classes and test classes are disjoint. Achieving this usually needs experts to externalize their domain knowledge by manually specifying a…

Human-Computer Interaction · Computer Science 2021-08-17 Shichao Jia , Zeyu Li , Nuo Chen , Jiawan Zhang

The crux of learning vision-language models is to extract semantically aligned information from visual and linguistic data. Existing attempts usually face the problem of coarse alignment, e.g., the vision encoder struggles in localizing an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Qinying Liu , Wei Wu , Kecheng Zheng , Zhan Tong , Jiawei Liu , Yu Liu , Wei Chen , Zilei Wang , Yujun Shen

Zero-shot learning (ZSL) aims to recognize unseen object classes without any training samples, which can be regarded as a form of transfer learning from seen classes to unseen ones. This is made possible by learning a projection between a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 An Zhao , Mingyu Ding , Jiechao Guan , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

Many recent advances in computer vision are the result of a healthy competition among researchers on high quality, task-specific, benchmarks. After a decade of active research, zero-shot learning (ZSL) models accuracy on the Imagenet…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Tristan Hascoet , Yasuo Ariki , Tetsuya Takiguchi

Methods for object detection and segmentation often require abundant instance-level annotations for training, which are time-consuming and expensive to collect. To address this, the task of zero-shot object detection (or segmentation) aims…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Siddhesh Khandelwal , Anirudth Nambirajan , Behjat Siddiquie , Jayan Eledath , Leonid Sigal

Recent advances in object segmentation have demonstrated that deep neural networks excel at object segmentation for specific classes in color and depth images. However, their performance is dictated by the number of classes and objects used…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Chahat Deep Singh , Nitin J. Sanket , Chethan M. Parameshwara , Cornelia Fermüller , Yiannis Aloimonos

Zero-shot Learning (ZSL) aims to enable classifiers to identify unseen classes. This is typically achieved by generating visual features for unseen classes based on learned visual-semantic correlations from seen classes. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Zihan Ye , Shreyank N. Gowda , Xiaowei Huang , Haotian Xu , Yaochu Jin , Kaizhu Huang , Xiaobo Jin

Despite the great progress made by deep CNNs in image semantic segmentation, they typically require a large number of densely-annotated images for training and are difficult to generalize to unseen object categories. Few-shot segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Kaixin Wang , Jun Hao Liew , Yingtian Zou , Daquan Zhou , Jiashi Feng

Zero-shot learning (ZSL) aims to recognize unseen classes based on the knowledge of seen classes. Previous methods focused on learning direct embeddings from global features to the semantic space in hope of knowledge transfer from seen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Ziyang Wang , Yunhao Gou , Jingjing Li , Yu Zhang , Yang Yang

Zero-Shot Learning (ZSL) aims at classifying unlabeled objects by leveraging auxiliary knowledge, such as semantic representations. A limitation of previous approaches is that only intrinsic properties of objects, e.g. their visual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Eloi Zablocki , Patrick Bordes , Benjamin Piwowarski , Laure Soulier , Patrick Gallinari

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by learning seen classes and known attributes, but correlations in attributes were ignored by previous study which lead to classification results confused. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang

We study zero-shot instance navigation, in which the agent navigates to a specific object without using object annotations for training. Previous object navigation approaches apply the image-goal navigation (ImageNav) task (go to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xinyu Sun , Lizhao Liu , Hongyan Zhi , Ronghe Qiu , Junwei Liang

Zero-Shot Learning (ZSL) seeks to recognize a sample from either seen or unseen domain by projecting the image data and semantic labels into a joint embedding space. However, most existing methods directly adapt a well-trained projection…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Shaobo Min , Hantao Yao , Hongtao Xie , Zheng-Jun Zha , Yongdong Zhang

Few-shot semantic segmentation aims to segment novel-class objects in a given query image with only a few labeled support images. Most advanced solutions exploit a metric learning framework that performs segmentation through matching each…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Jiacheng Chen , Bin-Bin Gao , Zongqing Lu , Jing-Hao Xue , Chengjie Wang , Qingmin Liao

The pre-trained vision-language model, exemplified by CLIP, advances zero-shot semantic segmentation by aligning visual features with class embeddings through a transformer decoder to generate semantic masks. Despite its effectiveness,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zicheng Zhang , Tong Zhang , Yi Zhu , Jianzhuang Liu , Xiaodan Liang , QiXiang Ye , Wei Ke

Zero-shot learning (ZSL) aims to transfer knowledge from seen classes to unseen ones so that the latter can be recognised without any training samples. This is made possible by learning a projection function between a feature space and a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Aoxue Li , Zhiwu Lu , Jiechao Guan , Tao Xiang , Liwei Wang , Ji-Rong Wen

Zero-shot learning (ZSL) aims to recognize unseen objects using disjoint seen objects via sharing attributes. The generalization performance of ZSL is governed by the attributes, which transfer semantic information from seen classes to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xiaofeng Xu , Ivor W. Tsang , Chuancai Liu

Few-shot learning is a fundamental and challenging problem since it requires recognizing novel categories from only a few examples. The objects for recognition have multiple variants and can locate anywhere in images. Directly comparing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Congqi Cao , Yanning Zhang