English
Related papers

Related papers: Conterfactual Generative Zero-Shot Semantic Segmen…

200 papers

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor

Zero-shot referring image segmentation is a challenging task because it aims to find an instance segmentation mask based on the given referring descriptions, without training on this type of paired data. Current zero-shot methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Minheng Ni , Yabo Zhang , Kailai Feng , Xiaoming Li , Yiwen Guo , Wangmeng Zuo

Many recent methods of zero-shot learning (ZSL) attempt to utilize generative model to generate the unseen visual samples from semantic descriptions and random noise. Therefore, the ZSL problem becomes a traditional supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Shibing Xu , Zishu Gao , Guojun Xie

In this paper we propose a non-metric ranking-based representation of semantic similarity that allows natural aggregation of semantic information from multiple heterogeneous sources. We apply the ranking-based representation to zero-shot…

Machine Learning · Computer Science 2015-03-02 Jihun Hamm , Mikhail Belkin

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks(GANs) to generate images, we instead leverage GANs to imagine unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yizhe Zhu , Mohamed Elhoseiny , Bingchen Liu , Xi Peng , Ahmed Elgammal

Zero-shot learning, which studies the problem of object classification for categories for which we have no training examples, is gaining increasing attention from community. Most existing ZSL methods exploit deterministic transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Yanan Li , Donghui Wang

Learning novel concepts, remembering previous knowledge, and adapting it to future tasks occur simultaneously throughout a human's lifetime. To model such comprehensive abilities, continual zero-shot learning (CZSL) has recently been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Wenxuan Zhang , Paul Janson , Kai Yi , Ivan Skorokhodov , Mohamed Elhoseiny

This paper addresses the task of learning an image clas-sifier when some categories are defined by semantic descriptions only (e.g. visual attributes) while the others are defined by exemplar images as well. This task is often referred to…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Maxime Bucher , Stéphane Herbin , Frédéric Jurie

While most existing segmentation methods usually combined the powerful feature extraction capabilities of CNNs with Conditional Random Fields (CRFs) post-processing, the result always limited by the fault of CRFs . Due to the notoriously…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 ZengShun Zhaoa , Yulong Wang , Ke Liu , Haoran Yang , Qian Sun , Heng Qiao

We present a novel counterfactual framework for both Zero-Shot Learning (ZSL) and Open-Set Recognition (OSR), whose common challenge is generalizing to the unseen-classes by only training on the seen-classes. Our idea stems from the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Zhongqi Yue , Tan Wang , Hanwang Zhang , Qianru Sun , Xian-Sheng Hua

We introduce the first zero-shot approach for Video Semantic Segmentation (VSS) based on pre-trained diffusion models. A growing research direction attempts to employ diffusion models to perform downstream vision tasks by exploiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Qian Wang , Abdelrahman Eldesokey , Mohit Mendiratta , Fangneng Zhan , Adam Kortylewski , Christian Theobalt , Peter Wonka

Large-scale knowledge graphs (KGs) are shown to become more important in current information systems. To expand the coverage of KGs, previous studies on knowledge graph completion need to collect adequate training instances for newly-added…

Computation and Language · Computer Science 2020-01-09 Pengda Qin , Xin Wang , Wenhu Chen , Chunyun Zhang , Weiran Xu , William Yang Wang

Adversarial training has been shown to produce state of the art results for generative image modeling. In this paper we propose an adversarial training approach to train semantic segmentation models. We train a convolutional semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Pauline Luc , Camille Couprie , Soumith Chintala , Jakob Verbeek

Zero-shot object detection (ZSD), the task that extends conventional detection models to detecting objects from unseen categories, has emerged as a new challenge in computer vision. Most existing approaches tackle the ZSD task with a strict…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Caixia Yan , Xiaojun Chang , Minnan Luo , Huan Liu , Xiaoqin Zhang , Qinghua Zheng

Zero-shot learning relies on semantic class representations such as hand-engineered attributes or learned embeddings to predict classes without any labeled examples. We propose to learn class representations by embedding nodes from common…

Machine Learning · Computer Science 2022-08-29 Nihal V. Nayak , Stephen H. Bach

Recent research on Generalized Zero-Shot Learning (GZSL) has focused primarily on generation-based methods. However, current literature has overlooked the fundamental principles of these methods and has made limited progress in a complex…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Dubing Chen , Yuming Shen , Haofeng Zhang , Philip H. S. Torr

Zero-shot learning (ZSL) is to handle the prediction of those unseen classes that have no labeled training data. Recently, generative methods like Generative Adversarial Networks (GANs) are being widely investigated for ZSL due to their…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Yuxia Geng , Jiaoyan Chen , Zhuo Chen , Zhiquan Ye , Zonggang Yuan , Yantao Jia , Huajun Chen

We investigate transductive zero-shot point cloud semantic segmentation, where the network is trained on seen objects and able to segment unseen objects. The 3D geometric elements are essential cues to imply a novel 3D object type. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Runnan Chen , Xinge Zhu , Nenglun Chen , Wei Li , Yuexin Ma , Ruigang Yang , Wenping Wang

Existing semantic segmentation models heavily rely on dense pixel-wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero-shot semantic segmentation, which aims to segment unseen objects with zero…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Zhangxuan Gu , Siyuan Zhou , Li Niu , Zihan Zhao , Liqing Zhang

Existing methods using generative adversarial approaches for Zero-Shot Learning (ZSL) aim to generate realistic visual features from class semantics by a single generative network, which is highly under-constrained. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhi Chen , Jingjing Li , Yadan Luo , Zi Huang , Yang Yang