English
Related papers

Related papers: Zero-Shot Semantic Segmentation

200 papers

With the recent renaissance of deep convolution neural networks, encouraging breakthroughs have been achieved on the supervised recognition tasks, where each class has sufficient training data and fully annotated training data. However, to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-16 Yanwei Fu , Tao Xiang , Yu-Gang Jiang , Xiangyang Xue , Leonid Sigal , Shaogang Gong

Zero-shot learning (ZSL) can be defined by correctly solving a task where no training data is available, based on previous acquired knowledge from different, but related tasks. So far, this area has mostly drawn the attention from computer…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Joao Reis , Gil Gonçalves

Zero-shot learning (ZSL) aims to identify unseen classes with zero samples during training. Broadly speaking, present ZSL methods usually adopt class-level semantic labels and compare them with instance-level semantic predictions to infer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zihan Ye , Guanyu Yang , Xiaobo Jin , Youfa Liu , Kaizhu Huang

Recent deep learning architectures can recognize instances of 3D point cloud objects of previously seen classes quite well. At the same time, current 3D depth camera technology allows generating/segmenting a large amount of 3D point cloud…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Ali Cheraghian , Shafin Rahman , Lars Petersson

We introduce a simple yet effective episode-based training framework for zero-shot learning (ZSL), where the learning system requires to recognize unseen classes given only the corresponding class semantics. During training, the model is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Yunlong Yu , Zhong Ji , Zhongfei Zhang , Jungong Han

Recent approaches have shown that training deep neural networks directly on large-scale image-text pair collections enables zero-shot transfer on various recognition tasks. One central issue is how this can be generalized to object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Johnathan Xie , Shuai Zheng

Zero Shot Learning (ZSL) enables a learning model to classify instances of an unseen class during training. While most research in ZSL focuses on single-label classification, few studies have been done in multi-label ZSL, where an instance…

Machine Learning · Computer Science 2016-06-02 Ubai Sandouk , Ke Chen

Classification based on Zero-shot Learning (ZSL) is the ability of a model to classify inputs into novel classes on which the model has not previously seen any training examples. Providing an auxiliary descriptor in the form of a set of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Samuele Ruffino , Geethan Karunaratne , Michael Hersche , Luca Benini , Abu Sebastian , Abbas Rahimi

The rapid development of deep learning has driven significant progress in image semantic segmentation - a fundamental task in computer vision. Semantic segmentation algorithms often depend on the availability of pixel-level labels (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zhaozheng Chen , Qianru Sun

Existing zero-shot learning (ZSL) models typically learn a projection function from a feature space to a semantic embedding space (e.g.~attribute space). However, such a projection function is only concerned with predicting the training…

Computer Vision and Pattern Recognition · Computer Science 2017-04-28 Elyor Kodirov , Tao Xiang , Shaogang Gong

Prevalent semantic segmentation solutions, despite their different network designs (FCN based or attention based) and mask decoding strategies (parametric softmax based or pixel-query based), can be placed in one category, by considering…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tianfei Zhou , Wenguan Wang , Ender Konukoglu , Luc Van Gool

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are highly local,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Yang Liu , Lei Zhou , Xiao Bai , Yifei Huang , Lin Gu , Jun Zhou , Tatsuya Harada

Comprehensive scene understanding is a critical enabler of robot autonomy. Semantic segmentation is one of the key scene understanding tasks which is pivotal for several robotics applications including autonomous driving, domestic service…

Robotics · Computer Science 2024-01-17 Juana Valeria Hurtado , Abhinav Valada

Recently, groundbreaking results have been presented on open-vocabulary semantic image segmentation. Such methods segment each pixel in an image into arbitrary categories provided at run-time in the form of text prompts, as opposed to a…

Robotics · Computer Science 2023-03-21 Kenneth Blomqvist , Francesco Milano , Jen Jen Chung , Lionel Ott , Roland Siegwart

Deep neural networks have enabled major progresses in semantic segmentation. However, even the most advanced neural architectures suffer from important limitations. First, they are vulnerable to catastrophic forgetting, i.e. they perform…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Fabio Cermelli , Massimiliano Mancini , Samuel Rota Buló , Elisa Ricci , Barbara Caputo

Visual Semantic Embedding (VSE) models, which map images into a rich semantic embedding space, have been a milestone in object recognition and zero-shot learning. Current approaches to VSE heavily rely on static word em-bedding techniques.…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yue Jiao , Jonathon Hare , Adam Prügel-Bennett

Zero-shot neural scene segmentation, which reconstructs 3D neural segmentation field without manual annotations, serves as an effective way for scene understanding. However, existing models, especially the efficient 3D Gaussian-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bin Dou , Tianyu Zhang , Zhaohui Wang , Yongjia Ma , Zejian Yuan

Zero-shot learning (ZSL) aims to leverage additional semantic information to recognize unseen classes. To transfer knowledge from seen to unseen classes, most ZSL methods often learn a shared embedding space by simply aligning visual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Bowen Duan , Shiming Chen , Yufei Guo , Guo-Sen Xie , Weiping Ding , Yisong Wang

Semantic segmentation is fundamental to vision systems requiring pixel-level scene understanding, yet deploying it on resource-constrained devices demands efficient architectures. Although existing methods achieve real-time inference…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Shi-Chen Zhang , Yunheng Li , Yu-Huan Wu , Qibin Hou , Ming-Ming Cheng

We present LSeg, a novel model for language-driven semantic image segmentation. LSeg uses a text encoder to compute embeddings of descriptive input labels (e.g., "grass" or "building") together with a transformer-based image encoder that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Boyi Li , Kilian Q. Weinberger , Serge Belongie , Vladlen Koltun , René Ranftl