English
Related papers

Related papers: What a MESS: Multi-Domain Evaluation of Zero-Shot …

200 papers

We introduce the first zero-shot approach for Video Semantic Segmentation (VSS) based on pre-trained diffusion models. A growing research direction attempts to employ diffusion models to perform downstream vision tasks by exploiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Qian Wang , Abdelrahman Eldesokey , Mohit Mendiratta , Fangneng Zhan , Adam Kortylewski , Christian Theobalt , Peter Wonka

Training deep networks for semantic segmentation requires large amounts of labeled training data, which presents a major challenge in practice, as labeling segmentation masks is a highly labor-intensive process. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Lukas Hoyer , Dengxin Dai , Yuhua Chen , Adrian Köring , Suman Saha , Luc Van Gool

Semantic segmentation, which aims to acquire a detailed understanding of images, is an essential issue in computer vision. However, in practical scenarios, new categories that are different from the categories in training usually appear.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Haiyang Liu , Yichen Wang , Jiayi Zhao , Guowu Yang , Fengmao Lv

Training semantic segmentation models requires a large amount of finely annotated data, making it hard to quickly adapt to novel classes not satisfying this condition. Few-Shot Segmentation (FS-Seg) tackles this problem with many…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Zhuotao Tian , Xin Lai , Li Jiang , Shu Liu , Michelle Shu , Hengshuang Zhao , Jiaya Jia

Zero-shot learning aims at recognizing unseen classes (no training example) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-01 Jingcai Guo , Song Guo

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

Computation and Language · Computer Science 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

We explore semantic segmentation beyond the conventional, single-dataset homogeneous training and bring forward the problem of Heterogeneous Training of Semantic Segmentation (HTSS). HTSS involves simultaneous training on multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Panagiotis Meletis , Gijs Dubbelman

Deep learning has significantly improved the precision of instance segmentation with abundant labeled data. However, in many areas like medical and manufacturing, collecting sufficient data is extremely hard and labeling this data requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Ye Zheng , Jiahong Wu , Yongqiang Qin , Faen Zhang , Li Cui

Current research in semantic bird's-eye view segmentation for autonomous driving focuses solely on optimizing neural network models using a single dataset, typically nuScenes. This practice leads to the development of highly specialized…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Manuel Alejandro Diaz-Zapata , Wenqian Liu , Robin Baruffa , Christian Laugier

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks

The rapid development of deep learning has driven significant progress in image semantic segmentation - a fundamental task in computer vision. Semantic segmentation algorithms often depend on the availability of pixel-level labels (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zhaozheng Chen , Qianru Sun

The Segment Anything Model (SAM) exhibits remarkable versatility and zero-shot learning abilities, owing largely to its extensive training data (SA-1B). Recognizing SAM's dependency on manual guidance given its category-agnostic nature, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Xiyu Qi , Yifan Wu , Yongqiang Mao , Wenhui Zhang , Yidan Zhang

Semantic Segmentation is a significant research field in Computer Vision. Despite being a widely studied subject area, many visualization tools do not exist that capture segmentation quality and dataset statistics such as a class imbalance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Sourajit Saha , Shubhashis Roy Dipta

Open-vocabulary semantic segmentation (OVSS) involves assigning labels to each pixel in an image based on textual descriptions, leveraging world models like CLIP. However, they encounter significant challenges in cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Aniruddh Sikdar , Aditya Gandhamal , Suresh Sundaram

Learning with limited labelled data is a challenging problem in various applications, including remote sensing. Few-shot semantic segmentation is one approach that can encourage deep learning models to learn from few labelled examples for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Clifford Broni-Bediako , Junshi Xia , Jian Song , Hongruixuan Chen , Mennatullah Siam , Naoto Yokoya

This paper investigates a challenging problem of zero-shot learning in the multi-label scenario (MLZSL), wherein the model is trained to recognize multiple unseen classes within a sample (e.g., an image) based on seen classes and auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziming Liu , Jingcai Guo , Song Guo , Xiaocheng Lu

General purpose semantic segmentation relies on a backbone CNN network to extract discriminative features that help classify each image pixel into a 'seen' object class (ie., the object classes available during training) or a background…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Ce Wang , Moshiur Farazi , Nick Barnes

Reliable classification and detection of certain medical conditions, in images, with state-of-the-art semantic segmentation networks, require vast amounts of pixel-wise annotation. However, the public availability of such datasets is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Erik Ostrowski , Bharath Srinivas Prabakaran , Muhammad Shafique

Semantic segmentation of remote sensing images plays a vital role in a wide range of Earth Observation applications, such as land use land cover mapping, environment monitoring, and sustainable development. Driven by rapid developments in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Libo Wang , Sijun Dong , Ying Chen , Xiaoliang Meng , Shenghui Fang , Songlin Fei

In this paper we consider a version of the zero-shot learning problem where seen class source and target domain data are provided. The goal during test-time is to accurately predict the class label of an unseen target domain instance based…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Ziming Zhang , Venkatesh Saligrama