English
Related papers

Related papers: Zero-shot Referring Image Segmentation with Global…

200 papers

Zero-shot referring expression comprehension (REC) aims to locate target objects in images given natural language queries without relying on task-specific training data, demanding strong visual understanding capabilities. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yike Wu , Necva Bolucu , Stephen Wan , Dadong Wang , Jiahao Xia , Jian Zhang

In this paper, we tackle an emerging computer vision task, open-vocabulary universal image segmentation, that aims to perform semantic/instance/panoptic segmentation (background semantic labeling + foreground instance segmentation) for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Zheng Ding , Jieke Wang , Zhuowen Tu

Recently, Referring Remote Sensing Image Segmentation (RRSIS) has aroused wide attention. To handle drastic scale variation of remote targets, existing methods only use the full image as input and nest the saliency-preferring techniques of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiaxing Yang , Lihe Zhang , Huchuan Lu

Large-scale vision-language models like CLIP have demonstrated impressive open-vocabulary capabilities for image-level tasks, excelling in recognizing what objects are present. However, they struggle with pixel-level recognition tasks like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Heeseong Shin , Chaehyun Kim , Sunghwan Hong , Seokju Cho , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao

The availability of large-scale remote sensing video data underscores the importance of high-quality interactive segmentation. However, challenges such as small object sizes, ambiguous features, and limited generalization make it difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhe Shan , Yang Liu , Lei Zhou , Cheng Yan , Heng Wang , Xia Xie

Referring Image Segmentation (RIS), aims to segment the object referred by a given sentence in an image by understanding both visual and linguistic information. However, existing RIS methods tend to explore top-performance models,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Xiaoyan Jiang , Hang Yang , Kaiying Zhu , Xihe Qiu , Shibo Zhao , Sifan Zhou

Generalized Zero-shot Semantic Segmentation aims to segment both seen and unseen categories only under the supervision of the seen ones. To tackle this, existing methods adopt the large-scale Vision Language Models (VLMs) which obtain…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jialei Chen , Daisuke Deguchi , Chenkai Zhang , Xu Zheng , Hiroshi Murase

One-shot medical image segmentation (MIS) is crucial for medical analysis due to the burden of medical experts on manual annotation. The recent emergence of the segment anything model (SAM) has demonstrated remarkable adaptation in MIS but…

Image and Video Processing · Electrical Eng. & Systems 2025-04-30 Jia Wang , Yunan Mei , Jiarui Liu , Xin Fan

Interactive image segmentation aims at segmenting a target region through a way of human-computer interaction. Recent works based on deep learning have achieved excellent performance, while most of them focus on improving the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Yuying Hao , Yi Liu , Juncai Peng , Haoyi Xiong , Guowei Chen , Shiyu Tang , Zeyu Chen , Baohua Lai

Pretrained vision-language models, such as CLIP, show promising zero-shot performance across a wide variety of datasets. For closed-set classification tasks, however, there is an inherent limitation: CLIP image encoders are typically…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Piyapat Saranrittichai , Mauricio Munoz , Volker Fischer , Chaithanya Kumar Mummadi

Referring Image Segmentation (RIS) is a challenging task that aims to segment objects in an image based on natural language expressions. While prior studies have predominantly concentrated on improving vision-language interactions and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ming Dai , Wenxuan Cheng , Jiang-jiang Liu , Sen Yang , Wenxiao Cai , Yanpeng Sun , Wankou Yang

Referring Expression Comprehension (REC) aims to localize the target objects specified by free-form natural language descriptions in images. While state-of-the-art methods achieve impressive performance, they perform a dense perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Wei Su , Peihan Miao , Huanzhang Dou , Xi Li

The scarcity of labeled data often impedes the application of deep learning to the segmentation of medical images. Semi-supervised learning seeks to overcome this limitation by exploiting unlabeled examples in the learning process. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Jizong Peng , Marco Pedersoli , Christian Desrosiers

Most existing approaches to referring segmentation achieve strong performance only through fine-tuning or by composing multiple pre-trained models, often at the cost of additional training and architectural modifications. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Anna Kukleva , Enis Simsar , Alessio Tonioni , Muhammad Ferjad Naeem , Federico Tombari , Jan Eric Lenssen , Bernt Schiele

Recent advances in Vision Language Models (VLMs) and Vision Foundation Models (VFMs) have opened new opportunities for zero-shot text-guided segmentation of remote sensing imagery. However, most existing approaches still rely on additional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Jose Sosa , Danila Rukhovich , Anis Kacem , Djamila Aouada

Referring Expression Segmentation (RES) aims to generate a segmentation mask for the object described by a given language expression. Existing classic RES datasets and methods commonly support single-target expressions only, i.e., one…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Chang Liu , Henghui Ding , Xudong Jiang

In this work, we address the task of referring image segmentation (RIS), which aims at predicting a segmentation mask for the object described by a natural language expression. Most existing methods focus on establishing unidirectional or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Jianhua Yang , Yan Huang , Zhanyu Ma , Liang Wang

As a novel and challenging task, referring segmentation combines computer vision and natural language processing to localize and segment objects based on textual descriptions. While referring image segmentation (RIS) has been extensively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Rui Li , Xiaowei Zhao

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks