English
Related papers

Related papers: Exploring Open-Vocabulary Semantic Segmentation wi…

200 papers

Traditional 3D scene understanding approaches rely on labeled 3D datasets to train a model for a single task with supervision. We propose OpenScene, an alternative approach where a model predicts dense features for 3D scene points that are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Songyou Peng , Kyle Genova , Chiyu "Max" Jiang , Andrea Tagliasacchi , Marc Pollefeys , Thomas Funkhouser

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of text-defined categories, demanding reliable generalization to unseen classes at inference. Although modern vision-language models (VLMs) support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Saikat Dutta , Biplab Banerjee , Hamid Rezatofighi

Interpreting camera data is key for autonomously acting systems, such as autonomous vehicles. Vision systems that operate in real-world environments must be able to understand their surroundings and need the ability to deal with novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Matteo Sodano , Federico Magistri , Lucas Nunes , Jens Behley , Cyrill Stachniss

Few-shot semantic segmentation aims to learn to segment unseen class objects with the guidance of only a few support images. Most previous methods rely on the pixel-level label of support images. In this paper, we focus on a more…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Haohan Wang , Liang Liu , Wuhao Zhang , Jiangning Zhang , Zhenye Gan , Yabiao Wang , Chengjie Wang , Haoqian Wang

This paper presents a new method for the zero-shot open-vocabulary semantic segmentation (OVSS) of 3D automotive lidar data. To circumvent the recognized image-text modality gap that is intrinsic to approaches based on Vision Language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Nermin Samet , Gilles Puy , Renaud Marlet

Semantic segmentation is a core computer vision problem, but the high costs of data annotation have hindered its wide application. Weakly-Supervised Semantic Segmentation (WSSS) offers a cost-efficient workaround to extensive labeling in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Elham Ravanbakhsh , Cheng Niu , Yongqing Liang , J. Ramanujam , Xin Li

Recent mask proposal models have significantly improved the performance of zero-shot semantic segmentation. However, the use of a `background' embedding during training in these methods is problematic as the resulting model tends to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Son Duy Dao , Hengcan Shi , Dinh Phung , Jianfei Cai

Semantic segmentation is one of the most challenging tasks in computer vision. However, in many applications, a frequent obstacle is the lack of labeled images, due to the high cost of pixel-level labeling. In this scenario, it makes sense…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Adrian Peláez-Vegas , Pablo Mesejo , Julián Luengo

Existing semantic segmentation models heavily rely on dense pixel-wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero-shot semantic segmentation, which aims to segment unseen objects with zero…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Zhangxuan Gu , Siyuan Zhou , Li Niu , Zihan Zhao , Liqing Zhang

Foundation segmentation models achieve reasonable leaf instance extraction from top-view crop images without training (i.e., zero-shot). However, segmenting entire plant individuals with each consisting of multiple overlapping leaves…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Junhao Xing , Ryohei Miyakawa , Yang Yang , Xinpeng Liu , Risa Shinoda , Hiroaki Santo , Yosuke Toda , Fumio Okura

Pixel-level vision tasks, such as semantic segmentation, require extensive and high-quality annotated data, which is costly to obtain. Semi-supervised semantic segmentation (SSSS) has emerged as a solution to alleviate the labeling burden…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Danhui Chen , Ziquan Liu , Chuxi Yang , Dan Wang , Yan Yan , Yi Xu , Xiangyang Ji

The global rise in the number of people with physical disabilities, in part due to improvements in post-trauma survivorship and longevity, has amplified the demand for advanced assistive technologies to improve mobility and independence.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yifan Xu , Vineet Kamat , Carol Menassa

Zero-shot point cloud segmentation aims to make deep models capable of recognizing novel objects in point cloud that are unseen in the training phase. Recent trends favor the pipeline which transfers knowledge from seen classes with labels…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhang Lu , Qi Jiang , Runnan Chen , Yuenan Hou , Xinge Zhu , Yuexin Ma

We propose a novel method for unsupervised semantic image segmentation based on mutual information maximization between local and global high-level image features. The core idea of our work is to leverage recent progress in self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Robert Harb , Patrick Knöbelreiter

State of the art methods for semantic image segmentation are trained in a supervised fashion using a large corpus of fully labeled training images. However, gathering such a corpus is expensive, due to human annotation effort, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Radek Mackowiak , Philip Lenz , Omair Ghori , Ferran Diego , Oliver Lange , Carsten Rother

Open-Vocabulary Semantic Segmentation (OVSS) has advanced with recent vision-language models (VLMs), enabling segmentation beyond predefined categories through various learning schemes. Notably, training-free methods offer scalable, easily…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Chanyoung Kim , Dayun Ju , Woojung Han , Ming-Hsuan Yang , Seong Jae Hwang

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

Identifying labels that did not appear during training, known as multi-label zero-shot learning, is a non-trivial task in computer vision. To this end, recent studies have attempted to explore the multi-modal knowledge of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Xuelin Zhu , Jian Liu , Dongqi Tang , Jiawei Ge , Weijia Liu , Bo Liu , Jiuxin Cao

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Debasmit Das , C. S. George Lee

In the realm of food computing, segmenting ingredients from images poses substantial challenges due to the large intra-class variance among the same ingredients, the emergence of new ingredients, and the high annotation costs associated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiongwei Wu , Sicheng Yu , Ee-Peng Lim , Chong-Wah Ngo