English
Related papers

Related papers: Exploring Efficient Open-Vocabulary Segmentation i…

200 papers

Recent success of pre-trained foundation vision-language models makes Open-Vocabulary Segmentation (OVS) possible. Despite the promising performance, this approach introduces heavy computational overheads for two challenges: 1) large model…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jingxuan Xu , Wuyang Chen , Yao Zhao , Yunchao Wei

Open-Vocabulary Segmentation (OVS) methods are capable of performing semantic segmentation without relying on a fixed vocabulary, and in some cases, without training or fine-tuning. However, OVS methods typically require a human in the loop…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Osman Ülger , Maksymilian Kulicki , Yuki Asano , Martin R. Oswald

Referring remote sensing image segmentation (RRSIS) enables the precise delineation of regions within remote sensing imagery through natural language descriptions, serving critical applications in disaster response, urban development, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zhe Dong , Yuzhe Sun , Tianzhu Liu , Yanfeng Gu

As the most fundamental scene understanding tasks, object detection and segmentation have made tremendous progress in deep learning era. Due to the expensive manual labeling cost, the annotated categories in existing datasets are often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chaoyang Zhu , Long Chen

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

The application of Vision-Language Models (VLMs) in remote sensing (RS) has demonstrated significant potential in traditional tasks such as scene classification, object detection, and image captioning. However, current models, which excel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zilun Zhang , Haozhan Shen , Tiancheng Zhao , Bin Chen , Zian Guan , Yuhao Wang , Xu Jia , Yuxiang Cai , Yongheng Shang , Jianwei Yin

From image-text pairs, large-scale vision-language models (VLMs) learn to implicitly associate image regions with words, which prove effective for tasks like visual question answering. However, leveraging the learned association for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiayun Luo , Siddhesh Khandelwal , Leonid Sigal , Boyang Li

Remote sensing object detection has made significant progress, but most studies still focus on closed-set detection, limiting generalization across diverse datasets. Open-vocabulary object detection (OVD) provides a solution by leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Ziyue Huang , Yongchao Feng , Shuai Yang , Ziqi Liu , Qingjie Liu , Yunhong Wang

Event cameras, known for low-latency operation and superior performance in challenging lighting conditions, are suitable for sensitive computer vision tasks such as semantic segmentation in autonomous driving. However, challenges arise due…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Muhammad Rameez Ur Rahman , Jhony H. Giraldo , Indro Spinelli , Stéphane Lathuilière , Fabio Galasso

Open-vocabulary semantic segmentation (OVSS) aims to segment and recognize objects universally. Trained on extensive high-quality segmentation data, the segment anything model (SAM) has demonstrated remarkable universal segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Lin Chen , Yingjian Zhu , Qi Yang , Xin Niu , Kun Ding , Shiming Xiang

Open-vocabulary semantic segmentation enables models to segment objects or image regions beyond fixed class sets, offering flexibility in dynamic environments. However, existing methods often rely on single-view images and struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Thomas Campagnolo , Ezio Malis , Philippe Martinet , Gaétan Bahl

Open-vocabulary part segmentation (OVPS) is an emerging research area focused on segmenting fine-grained entities using diverse and previously unseen vocabularies. Our study highlights the inherent complexities of part segmentation due to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Jiho Choi , Seonho Lee , Seungho Lee , Minhyun Lee , Hyunjung Shim

Open-Vocabulary semantic segmentation (OVSS) and domain generalization in semantic segmentation (DGSS) highlight a subtle complementarity that motivates Open-Vocabulary Domain-Generalized Semantic Segmentation (OV-DGSS). OV-DGSS aims to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Siyu Chen , Ting Han , Chengzheng Fu , Changshe Zhang , Chaolei Wang , Jinhe Su , Guorong Cai , Meiliu Wu

In this paper, we propose ReSeg-CLIP, a new training-free Open-Vocabulary Semantic Segmentation method for remote sensing data. To compensate for the problems of vision language models, such as CLIP in semantic segmentation caused by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mohammadreza Heidarianbaei , Mareike Dorozynski , Hubert Kanyamahanga , Max Mehltretter , Franz Rottensteiner

Open-Vocabulary Aerial Detection (OVAD) and Remote Sensing Visual Grounding (RSVG) have emerged as two key paradigms for aerial scene understanding. However, each paradigm suffers from inherent limitations when operating in isolation: OVAD…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guoting Wei , Xia Yuan , Yang Zhou , Haizhao Jing , Yu Liu , Xianbiao Qi , Chunxia Zhao , Haokui Zhang , Rong Xiao

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Most existing methods for training-free open-vocabulary semantic segmentation are based on CLIP. While these approaches have made progress, they often face challenges in precise localization or require complex pipelines to combine separate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Kaiyu Li , Shengqi Zhang , Yujie Wang , Yupeng Deng , Zhi Wang , Deyu Meng , Xiangyong Cao

Recently, Vision-Language Models (VLMs) have advanced segmentation techniques by shifting from the traditional segmentation of a closed-set of predefined object classes to open-vocabulary segmentation (OVS), allowing users to segment novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Gonca Yilmaz , Songyou Peng , Marc Pollefeys , Francis Engelmann , Hermann Blum

Recent progress in VLMs has demonstrated impressive capabilities across a variety of tasks in the natural image domain. Motivated by these advancements, the remote sensing community has begun to adopt VLMs for remote sensing vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Congcong Wen , Yiting Lin , Xiaokang Qu , Nan Li , Yong Liao , Xiang Li , Hui Lin

Open-vocabulary semantic segmentation (OVSS) aims to segment arbitrary category regions in images using open-vocabulary prompts, necessitating that existing methods possess pixel-level vision-language alignment capability. Typically, this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jiahao Li , Yang Lu , Yachao Zhang , Fangyong Wang , Yuan Xie , Yanyun Qu