English
Related papers

Related papers: Two-stage Visual Cues Enhancement Network for Refe…

200 papers

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Referring Image Segmentation (RIS) is a cross-modal task that aims to segment an instance described by a natural language expression. Recent methods leverage large-scale pretrained unimodal models as backbones along with fusion techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Seoyeon Kim , Minguk Kang , Dongwon Kim , Jaesik Park , Suha Kwak

Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yichen Yan , Xingjian He , Wenxuan Wan , Jing Liu

Robot-assisted surgery has made significant progress, with instrument segmentation being a critical factor in surgical intervention quality. It serves as the building block to facilitate surgical robot navigation and surgical education for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hongqiu Wang , Lei Zhu , Guang Yang , Yike Guo , Shichen Zhang , Bo Xu , Yueming Jin

Referring image segmentation (RIS) aims to segment an object mentioned in natural language from an image. The main challenge is text-to-pixel fine-grained correlation. In the previous methods, the final results are obtained by convolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yichen Yan , Xingjian He , Wenxuan Wang , Sihan Chen , Jing Liu

We investigate Referring Image Segmentation (RIS), which outputs a segmentation map corresponding to the natural language description. Addressing RIS efficiently requires considering the interactions happening across visual and linguistic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Kanishk Jain , Vineet Gandhi

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

Referring image segmentation aims to segment the target object referred by a natural language expression. However, previous methods rely on the strong assumption that one sentence must describe one target in the image, which is often not…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yutao Hu , Qixiong Wang , Wenqi Shao , Enze Xie , Zhenguo Li , Jungong Han , Ping Luo

Referring Remote Sensing Image Segmentation (RRSIS) is a situated, task-driven cross-modal task related to the embodied perception paradigm, requiring models to align visual-spatial features with linguistic intentions for precise target…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Biaoyu Ren , Qingsheng Wang , Cun Xu , Dingkang Yang , Wenxuan Wang

Composed image retrieval (CIR) is a vision language task that retrieves a target image using a reference image and modification text, enabling intuitive specification of desired changes. While effectively fusing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Young-Eun Kim , Seong-Whan Lee

Referring Image Segmentation (RIS) aims to segment target objects expressed in natural language within a scene at the pixel level. Various recent RIS models have achieved state-of-the-art performance by generating contextual tokens to model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Minhyeok Lee , Dogyoon Lee , Jungho Lee , Suhwan Cho , Heeseung Choi , Ig-Jae Kim , Sangyoun Lee

Referring Image Segmentation is a comprehensive task to segment an object referred by a textual query from an image. In nature, the level of difficulty in this task is affected by the existence of similar objects and the complexity of the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Seongsu Ha , Chaeyun Kim , Donghwa Kim , Junho Lee , Sangho Lee , Joonseok Lee

Referring Remote Sensing Image Segmentation is a complex and challenging task that integrates the paradigms of computer vision and natural language processing. Existing datasets for RRSIS suffer from critical limitations in resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Zhigang Yang , Huiguang Yao , Linmao Tian , Xuezhi Zhao , Qiang Li , Qi Wang

Referring image segmentation (RIS) aims to precisely segment referents in images through corresponding natural language expressions, yet relying on cost-intensive mask annotations. Weakly supervised RIS thus learns from image-text pairs to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Qiyuan Dai , Sibei Yang

Precision in identifying and differentiating micro and macro blood vessels in the retina is crucial for the diagnosis of retinal diseases, although it poses a significant challenge. Current autoencoding-based segmentation approaches…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Rui Yang , Shunpu Zhang

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module and an instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Heng Liu , Guanghui Li , Mingqi Gao , Xiantong Zhen , Feng Zheng , Yang Wang

This paper explores the weakly-supervised referring image segmentation (WRIS) problem, and focuses on a challenging setup where target localization is learned directly from image-text pairs. We note that the input text description typically…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zaiquan Yang , Yuhao Liu , Jiaying Lin , Gerhard Hancke , Rynson W. H. Lau

In this work, we address the task of referring image segmentation (RIS), which aims at predicting a segmentation mask for the object described by a natural language expression. Most existing methods focus on establishing unidirectional or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Jianhua Yang , Yan Huang , Zhanyu Ma , Liang Wang

Text-to-image retrieval (TIR) aims to find relevant images based on a textual query, but existing approaches are primarily based on whole-image captions and lack interpretability. Meanwhile, referring expression segmentation (RES) enables…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Li-Cheng Shen , Jih-Kang Hsieh , Wei-Hua Li , Chu-Song Chen

Referring video object segmentation (RVOS) aims to segment video objects with the guidance of natural language reference. Previous methods typically tackle RVOS through directly grounding linguistic reference over the image lattice. Such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Chen Liang , Yu Wu , Tianfei Zhou , Wenguan Wang , Zongxin Yang , Yunchao Wei , Yi Yang