English
Related papers

Related papers: Towards Realistic Open-Vocabulary Remote Sensing S…

200 papers

Open-vocabulary semantic segmentation (OVSS) underpins many vision and robotics tasks that require generalizable semantic understanding. Existing approaches either rely on limited segmentation training data, which hinders generalization, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Omar Alama , Darshil Jariwala , Avigyan Bhattacharya , Seungchan Kim , Wenshan Wang , Sebastian Scherer

Audio-visual semantic segmentation (AVSS) aims to segment and classify sounding objects in videos with acoustic cues. However, most approaches operate on the close-set assumption and only identify pre-defined categories from training data,…

Multimedia · Computer Science 2024-08-01 Ruohao Guo , Liao Qu , Dantong Niu , Yanyu Qi , Wenzhen Yue , Ji Shi , Bowei Xing , Xianghua Ying

Open-vocabulary learning has emerged as a cutting-edge research area, particularly in light of the widespread adoption of vision-based foundational models. Its primary objective is to comprehend novel concepts that are not encompassed…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Chunlei Wang , Wenquan Feng , Xiangtai Li , Guangliang Cheng , Shuchang Lyu , Binghao Liu , Lijiang Chen , Qi Zhao

Open-vocabulary semantic segmentation (OVSS) is an open-world task that aims to assign each pixel within an image to a specific class defined by arbitrary text descriptions. While large-scale vision-language models have shown remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Lin Chen , Qi Yang , Kun Ding , Zhihao Li , Gang Shen , Fei Li , Qiyuan Cao , Shiming Xiang

Semantic segmentation of remote sensing (RS) images is pivotal for comprehensive Earth observation, but the demand for interpreting new object categories, coupled with the high expense of manual annotation, poses significant challenges.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Kaiyu Li , Xiangyong Cao , Ruixun Liu , Shihong Wang , Zixuan Jiang , Zhi Wang , Deyu Meng

Open-vocabulary semantic segmentation (OVSS) aims to segment objects from arbitrary text categories without requiring densely annotated datasets. Although contrastive learning based models enable zero-shot segmentation, they often lose fine…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Huy Che , Vinh-Tiep Nguyen

Open-vocabulary segmentation (OVS) extends the zero-shot recognition capabilities of vision-language models (VLMs) to pixel-level prediction, enabling segmentation of arbitrary categories specified by text prompts. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tilemachos Aravanis , Vladan Stojnić , Bill Psomas , Nikos Komodakis , Giorgos Tolias

Open-world referring segmentation requires grounding unconstrained language expressions to precise pixel-level regions. Existing multimodal large language models (MLLMs) exhibit strong open-world visual grounding, but their outputs remain…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuan Yao , Qiushi Yang , Humen Zhong , Jiangning Wei , Yifang Men , Shuai Bai , Miaomiao Cui , Zhibo Yang

In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS), which aims to segment objects of arbitrary classes instead of pre-defined, closed-set categories. The main contributions are as follows: First, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Jilan Xu , Junlin Hou , Yuejie Zhang , Rui Feng , Yi Wang , Yu Qiao , Weidi Xie

Object detection (OD) in computer vision has made significant progress in recent years, transitioning from closed-set labels to open-vocabulary detection (OVD) based on large-scale vision-language pre-training (VLP). However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yiyang Yao , Peng Liu , Tiancheng Zhao , Qianqian Zhang , Jiajia Liao , Chunxin Fang , Kyusong Lee , Qing Wang

Training-free open-vocabulary semantic segmentation (OVS) aims to segment images given a set of arbitrary textual categories without costly model fine-tuning. Existing solutions often explore attention mechanisms of pre-trained models, such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Xiwei Xuan , Ziquan Deng , Kwan-Liu Ma

Remote Sensing Image Captioning (RSIC) is a cross-modal field bridging vision and language, aimed at automatically generating natural language descriptions of features and scenes in remote sensing imagery. Despite significant advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Qing Zhou , Tao Yang , Junyu Gao , Weiping Ni , Junzheng Wu , Qi Wang

Video Instance Segmentation (VIS) aims at segmenting and categorizing objects in videos from a closed set of training categories, lacking the generalization ability to handle novel categories in real-world videos. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Haochen Wang , Cilin Yan , Shuai Wang , Xiaolong Jiang , XU Tang , Yao Hu , Weidi Xie , Efstratios Gavves

Domain Generalization in Semantic Segmentation (DG-SS) aims to enable segmentation models to perform robustly in unseen environments. However, conventional DG-SS methods are restricted to a fixed set of known categories, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Dong Zhao , Qi Zang , Nan Pu , Wenjing Li , Nicu Sebe , Zhun Zhong

Increasing attention is being diverted to data-efficient problem settings like Open Vocabulary Semantic Segmentation (OVSS) which deals with segmenting an arbitrary object that may or may not be seen during training. The closest standard…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Prashant Pandey , Mustafa Chasmai , Monish Natarajan , Brejesh Lall

Open-vocabulary scene understanding using 3D Gaussian (3DGS) representations has garnered considerable attention. However, existing methods mostly lift knowledge from large 2D vision models into 3DGS on a scene-by-scene basis, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Runnan Chen , Xiangyu Sun , Zhaoqing Wang , Youquan Liu , Jiepeng Wang , Lingdong Kong , Jiankang Deng , Mingming Gong , Liang Pan , Wenping Wang , Tongliang Liu

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

Open-Vocabulary Semantic Segmentation (OVSS) has advanced with recent vision-language models (VLMs), enabling segmentation beyond predefined categories through various learning schemes. Notably, training-free methods offer scalable, easily…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Chanyoung Kim , Dayun Ju , Woojung Han , Ming-Hsuan Yang , Seong Jae Hwang

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi