English
Related papers

Related papers: Exploring Efficient Open-Vocabulary Segmentation i…

200 papers

Open-vocabulary image segmentation is attracting increasing attention due to its critical applications in the real world. Traditional closed-vocabulary segmentation methods are not able to characterize novel objects, whereas several recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xi Chen , Shuang Li , Ser-Nam Lim , Antonio Torralba , Hengshuang Zhao

Remote sensing visual grounding (RSVG) aims to localize specific targets in remote sensing images using natural language expressions. However, existing methods are restricted to single-sensor domains, i.e., either optical or synthetic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xiaoyu Tang , Jun Dong , Jintao Cheng , Rui Fan

Out-of-distribution (OOD) detection represents a critical challenge in remote sensing applications, where reliable identification of novel or anomalous patterns is essential for autonomous monitoring, disaster response, and environmental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been proposed to pursue this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Xiang Li , Jian Ding , Mohamed Elhoseiny

Open-vocabulary panoptic reconstruction is crucial for advanced robotics and simulation. However, existing 3D reconstruction methods, such as NeRF or Gaussian Splatting variants, often struggle to achieve the real-time inference frequency…

Robotics · Computer Science 2026-04-14 Xuan Yu , Yuxuan Xie , Shichao Zhai , Shuhao Ye , Rong Xiong , Yue Wang

The complexity of scenes and variations in image quality result in significant variability in the performance of semantic segmentation methods of remote sensing imagery (RSI) in supervised real-world scenarios. This makes the evaluation of…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Huiying Shi , Zhihong Tan , Zhihan Zhang , Hongchen Wei , Yaosi Hu , Yingxue Zhang , Zhenzhong Chen

Open-vocabulary semantic segmentation models aim to accurately assign a semantic label to each pixel in an image from a set of arbitrary open-vocabulary texts. In order to learn such pixel-level alignment, current approaches typically rely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zihang Lai

Open-Vocabulary Semantic Segmentation (OVSS) assigns pixel-level labels from an open set of categories, requiring generalization to unseen and unlabelled objects. Using vision-language models (VLMs) to correlate local image patches with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jiayi Lin , Jiabo Huang , Shaogang Gong

Benefiting from the inductive biases learned from large-scale datasets, open-vocabulary semantic segmentation (OVSS) leverages the power of vision-language models, such as CLIP, to achieve remarkable progress without requiring task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiming Huang , Hao Ai , Jianbo Jiao

Open-vocabulary panoptic segmentation aims to segment and classify everything in diverse scenes across an unbounded vocabulary. Existing methods typically employ two-stage or single-stage framework. The two-stage framework involves cropping…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hongwei Niu , Jie Hu , Jianghang Lin , Guannan Jiang , Shengchuan Zhang

Audio-visual segmentation aims to separate sounding objects from videos by predicting pixel-level masks based on audio signals. Existing methods primarily concentrate on closed-set scenarios and direct audio-visual alignment and fusion,…

Machine Learning · Computer Science 2026-03-31 Shengkai Chen , Yifang Yin , Jinming Cao , Shili Xiang , Zhenguang Liu , Roger Zimmermann

The advancement of remote sensing, including satellite systems, facilitates the continuous acquisition of remote sensing imagery globally, introducing novel challenges for achieving open-world tasks. Deployed models need to continuously…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xiang Xiang , Zhuo Xu , Yao Deng , Qinhao Zhou , Yifan Liang , Ke Chen , Qingfang Zheng , Yaowei Wang , Xilin Chen , Wen Gao

Open-vocabulary object detection (OVD) requires solid modeling of the region-semantic relationship, which could be learned from massive region-text pairs. However, such data is limited in practice due to significant annotation costs. In…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Fangyi Chen , Han Zhang , Zhantao Yang , Hao Chen , Kai Hu , Marios Savvides

The development of high-resolution remote sensing satellites has provided great convenience for research work related to remote sensing. Segmentation and extraction of specific targets are essential tasks when facing the vast and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Jie Zhang , Xubing Yang , Rui Jiang , Wei Shao , Li Zhang

Pretrained vision-language models (VLMs), \eg CLIP, are increasingly used to bridge the gap between open- and close-vocabulary recognition in open-vocabulary image segmentation. As VLMs are generally pretrained with low-resolution images…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Yuanbing Zhu , Bingke Zhu , Yingying Chen , Yunfang Niu , Ming Tang , Jinqiao Wang

In the realm of food computing, segmenting ingredients from images poses substantial challenges due to the large intra-class variance among the same ingredients, the emergence of new ingredients, and the high annotation costs associated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiongwei Wu , Sicheng Yu , Ee-Peng Lim , Chong-Wah Ngo

This paper presents a novel training-free framework for open-vocabulary image segmentation and object recognition (OVSR), which leverages EfficientNetB0, a convolutional neural network, for unsupervised segmentation and CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ying Dai , Wei Yu Chen

In this paper, we introduce the task of visual grounding for remote sensing data (RSVG). RSVG aims to localize the referred objects in remote sensing (RS) images with the guidance of natural language. To retrieve rich information from RS…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Yang Zhan , Zhitong Xiong , Yuan Yuan

Remote sensing visual grounding (RSVG) aims to localize objects in remote sensing images based on free-form natural language expressions. Existing approaches are typically constrained to closed-set vocabularies, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Ke Li , Di Wang , Ting Wang , Fuyu Dong , Yiming Zhang , Luyao Zhang , Xiangyu Wang , Shaofeng Li , Quan Wang

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao