English
Related papers

Related papers: Exploring Efficient Open-Vocabulary Segmentation i…

200 papers

Semantic segmentation in videos has been a focal point of recent research. However, existing models encounter challenges when faced with unfamiliar categories. To address this, we introduce the Open Vocabulary Video Semantic Segmentation…

Multimedia · Computer Science 2024-12-13 Xinhao Li , Yun Liu , Guolei Sun , Min Wu , Le Zhang , Ce Zhu

Audio-visual semantic segmentation (AVSS) aims to segment and classify sounding objects in videos with acoustic cues. However, most approaches operate on the close-set assumption and only identify pre-defined categories from training data,…

Multimedia · Computer Science 2024-08-01 Ruohao Guo , Liao Qu , Dantong Niu , Yanyu Qi , Wenzhen Yue , Ji Shi , Bowei Xing , Xianghua Ying

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of text-defined categories, demanding reliable generalization to unseen classes at inference. Although modern vision-language models (VLMs) support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Saikat Dutta , Biplab Banerjee , Hamid Rezatofighi

We present Seg-TTO, a novel framework for zero-shot, open-vocabulary semantic segmentation (OVSS), designed to excel in specialized domain tasks. While current open-vocabulary approaches show impressive performance on standard segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ulindu De Silva , Didula Samaraweera , Sasini Wanigathunga , Kavindu Kariyawasam , Kanchana Ranasinghe , Muzammal Naseer , Ranga Rodrigo

Open-vocabulary semantic segmentation (OVSS) aims to segment objects from arbitrary text categories without requiring densely annotated datasets. Although contrastive learning based models enable zero-shot segmentation, they often lose fine…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Huy Che , Vinh-Tiep Nguyen

Referring Remote Sensing Image Segmentation (RRSIS) is critical for ecological monitoring, urban planning, and disaster management, requiring precise segmentation of objects in remote sensing imagery guided by textual descriptions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Tianxiang Zhang , Zhaokun Wen , Bo Kong , Kecheng Liu , Yisi Zhang , Peixian Zhuang , Jiangyun Li

High-resolution remote sensing images contain densely distributed objects with pronounced scale variations and complex boundaries, which impose higher demands on both the geometric localization and semantic prediction capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jianzheng Wang , Huan Ni

Open-Vocabulary Part Segmentation (OVPS) is an emerging field for recognizing fine-grained parts in unseen categories. We identify two primary challenges in OVPS: (1) the difficulty in aligning part-level image-text correspondence, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jiho Choi , Seonho Lee , Minhyun Lee , Seungho Lee , Hyunjung Shim

Open-vocabulary segmentation aims to achieve segmentation of arbitrary categories given unlimited text inputs as guidance. To achieve this, recent works have focused on developing various technical routes to exploit the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yong Liu , SongLi Wu , Sule Bai , Jiahao Wang , Yitong Wang , Yansong Tang

Open-Vocabulary Semantic Segmentation (OVSS) has advanced with recent vision-language models (VLMs), enabling segmentation beyond predefined categories through various learning schemes. Notably, training-free methods offer scalable, easily…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Chanyoung Kim , Dayun Ju , Woojung Han , Ming-Hsuan Yang , Seong Jae Hwang

In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS), which aims to segment objects of arbitrary classes instead of pre-defined, closed-set categories. The main contributions are as follows: First, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Jilan Xu , Junlin Hou , Yuejie Zhang , Rui Feng , Yi Wang , Yu Qiao , Weidi Xie

Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jie Qin , Jie Wu , Pengxiang Yan , Ming Li , Ren Yuxi , Xuefeng Xiao , Yitong Wang , Rui Wang , Shilei Wen , Xin Pan , Xingang Wang

Segmenting and recognizing diverse object parts is a crucial ability in applications spanning various computer vision and robotic tasks. While significant progress has been made in object-level Open-Vocabulary Semantic Segmentation (OVSS),…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Meng Wei , Xiaoyu Yue , Wenwei Zhang , Shu Kong , Xihui Liu , Jiangmiao Pang

Change detection is a fundamental task in remote sensing, aiming to quantify the impacts of human activities and ecological dynamics on land-cover changes. Existing change detection methods are limited to predefined classes in training…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 You Su , Yonghong Song , Jingqi Chen , Zehan Wen

Training-free open-vocabulary semantic segmentation (OVS) aims to segment images given a set of arbitrary textual categories without costly model fine-tuning. Existing solutions often explore attention mechanisms of pre-trained models, such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Xiwei Xuan , Ziquan Deng , Kwan-Liu Ma

Open-vocabulary scene understanding using 3D Gaussian (3DGS) representations has garnered considerable attention. However, existing methods mostly lift knowledge from large 2D vision models into 3DGS on a scene-by-scene basis, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Runnan Chen , Xiangyu Sun , Zhaoqing Wang , Youquan Liu , Jiepeng Wang , Lingdong Kong , Jiankang Deng , Mingming Gong , Liang Pan , Wenping Wang , Tongliang Liu

Open-vocabulary semantic segmentation has become an important direction in remote sensing, as it enables recognition beyond predefined land-cover categories. However, existing methods mainly depend on passive visual-text matching and often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chufeng Zhou , Jian Wang , Xinyuan Liu , Xiaokang Zhang

Object-Counting for remote-sensing (RS) imagery is attracting increasing research interest due to its crucial role in a wide and diverse set of applications. While several promising methods for RS object-counting have been proposed,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Tamir Shor , George Leifman , Genady Beryozkin

Understanding open-world semantics is critical for robotic planning and control, particularly in unstructured outdoor environments. Existing vision-language mapping approaches typically rely on object-centric segmentation priors, which…

Robotics · Computer Science 2025-09-23 Simon Schwaiger , Stefan Thalhammer , Wilfried Wöber , Gerald Steinbauer-Wagner

Open-Vocabulary Segmentation (OVS) aims to segment classes that are not present in the training dataset. However, most existing studies assume that the training data is fixed in advance, overlooking more practical scenarios where new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Dongjun Hwang , Yejin Kim , Minyoung Lee , Seong Joon Oh , Junsuk Choe