English
Related papers

Related papers: Referring Image Segmentation Using Text Supervisio…

200 papers

Referring image segmentation aims to segment the objects referred by a natural language expression. Previous methods usually focus on designing an implicit and recurrent feature interaction mechanism to fuse the visual-linguistic features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ya Jing , Tao Kong , Wei Wang , Liang Wang , Lei Li , Tieniu Tan

Referring image segmentation (RIS) aims to locate the particular region corresponding to the language expression. Existing methods incorporate features from different modalities in a \emph{bottom-up} manner. This design may get some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Mengxi Zhang , Heqing Lian , Yiming Liu , Jie Chen

Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms. However, there has been a lack of research investigating how existing algorithms should be benchmarked…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Wei Ji , Li Li , Hao Fei , Xiangyan Liu , Xun Yang , Juncheng Li , Roger Zimmermann

Referring Expression Segmentation (RES) is a widely explored multi-modal task, which endeavors to segment the pre-existing object within a single image with a given linguistic expression. However, in broader real-world scenarios, it is not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yixuan Wu , Zhao Zhang , Xie Chi , Feng Zhu , Rui Zhao

Text-driven infrared and visible image fusion has gained attention for enabling natural language to guide the fusion process. However, existing methods lack a goal-aligned task to supervise and evaluate how effectively the input text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siju Ma , Changsiyu Gong , Xiaofeng Fan , Yong Ma , Chengjie Jiang

Referring image segmentation (RIS) aims to segment a particular region based on a language expression prompt. Existing methods incorporate linguistic features into visual features and obtain multi-modal features for mask decoding. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Mengxi Zhang , Yiming Liu , Xiangjun Yin , Huanjing Yue , Jingyu Yang

In this paper, we study a challenging task of zero-shot referring image segmentation. This task aims to identify the instance mask that is most related to a referring expression without training on pixel-level annotations. Previous research…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Yucheng Suo , Linchao Zhu , Yi Yang

Referring remote sensing image segmentation (RRSIS) enables the precise delineation of regions within remote sensing imagery through natural language descriptions, serving critical applications in disaster response, urban development, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zhe Dong , Yuzhe Sun , Tianzhu Liu , Yanfeng Gu

Referring expression segmentation (RES), a task that involves localizing specific instance-level objects based on free-form linguistic descriptions, has emerged as a crucial frontier in human-AI interaction. It demands an intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Ying Zang , Chenglong Fu , Runlong Cao , Didi Zhu , Min Zhang , Wenjun Hu , Lanyun Zhu , Tianrun Chen

Referring Image Segmentation (RIS) is a challenging task that aims to segment objects in an image based on natural language expressions. While prior studies have predominantly concentrated on improving vision-language interactions and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ming Dai , Wenxuan Cheng , Jiang-jiang Liu , Sen Yang , Wenxiao Cai , Yanpeng Sun , Wankou Yang

Referring Image Segmentation (RIS) aims to segment the target object in an image given a natural language expression. While recent methods leverage pre-trained vision backbones and more training corpus to achieve impressive results, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Zhenjie Mao , Yuhuan Yang , Chaofan Ma , Dongsheng Jiang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Recently, Referring Remote Sensing Image Segmentation (RRSIS) has aroused wide attention. To handle drastic scale variation of remote targets, existing methods only use the full image as input and nest the saliency-preferring techniques of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiaxing Yang , Lihe Zhang , Huchuan Lu

Referring image segmentation (RIS) aims to precisely segment referents in images through corresponding natural language expressions, yet relying on cost-intensive mask annotations. Weakly supervised RIS thus learns from image-text pairs to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Qiyuan Dai , Sibei Yang

Referring image segmentation aims to segment the target object referred by a natural language expression. However, previous methods rely on the strong assumption that one sentence must describe one target in the image, which is often not…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yutao Hu , Qixiong Wang , Wenqi Shao , Enze Xie , Zhenguo Li , Jungong Han , Ping Luo

Most state-of-the-art semi-supervised video object segmentation methods rely on a pixel-accurate mask of a target object provided for the first frame of a video. However, obtaining a detailed segmentation mask is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-06 Anna Khoreva , Anna Rohrbach , Bernt Schiele

Text segmentation is a challenging vision task with many downstream applications. Current text segmentation methods require pixel-level annotations, which are expensive in the cost of human labor and limited in application scenarios. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Xinyan Zu , Haiyang Yu , Bin Li , Xiangyang Xue

Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Jiaxing Yang , Lihe Zhang , Jiayu Sun , Huchuan Lu

Referring Image Segmentation is a comprehensive task to segment an object referred by a textual query from an image. In nature, the level of difficulty in this task is affected by the existence of similar objects and the complexity of the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Seongsu Ha , Chaeyun Kim , Donghwa Kim , Junho Lee , Sangho Lee , Joonseok Lee

Using natural language to query visual information is a fundamental need in real-world applications. Text-Image Retrieval (TIR) retrieves a target image from a gallery based on an image-level description, while Referring Expression…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Xiangzhao Hao , Kuan Zhu , Hongyu Guo , Haiyun Guo , Ning Jiang , Quan Lu , Ming Tang , Jinqiao Wang

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi