English
Related papers

Related papers: RISAM: Referring Image Segmentation via Mutual-Awa…

200 papers

Referring image segmentation segments an image from a language expression. With the aim of producing high-quality masks, existing methods often adopt iterative learning approaches that rely on RNNs or stacked attention layers to refine…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Referring image segmentation aims to segment a referent via a natural linguistic expression.Due to the distinct data properties between text and image, it is challenging for a network to well align text and pixel-level features. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Zhaoqing Wang , Yu Lu , Qiang Li , Xunqiang Tao , Yandong Guo , Mingming Gong , Tongliang Liu

In this work, we address the task of referring image segmentation (RIS), which aims at predicting a segmentation mask for the object described by a natural language expression. Most existing methods focus on establishing unidirectional or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Jianhua Yang , Yan Huang , Zhanyu Ma , Liang Wang

Referring Image Segmentation (RIS) is an advanced vision-language task that involves identifying and segmenting objects within an image as described by free-form text descriptions. While previous studies focused on aligning visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Minhyun Lee , Seungho Lee , Song Park , Dongyoon Han , Byeongho Heo , Hyunjung Shim

Given a natural language expression and a remote sensing image, the goal of referring remote sensing image segmentation (RRSIS) is to generate a pixel-level mask of the target object identified by the referring expression. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zhe Dong , Yuzhe Sun , Tianzhu Liu , Wangmeng Zuo , Yanfeng Gu

Referring Image Segmentation (RIS) is a fundamental vision-language task that outputs object masks based on text descriptions. Many works have achieved considerable progress for RIS, including different fusion method designs. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jianzong Wu , Xiangtai Li , Xia Li , Henghui Ding , Yunhai Tong , Dacheng Tao

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Recently, Referring Remote Sensing Image Segmentation (RRSIS) has aroused wide attention. To handle drastic scale variation of remote targets, existing methods only use the full image as input and nest the saliency-preferring techniques of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiaxing Yang , Lihe Zhang , Huchuan Lu

The Segment Anything Model (SAM) excels at general image segmentation but has limited ability to understand natural language, which restricts its direct application in Referring Expression Segmentation (RES). Toward this end, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Wei Tang , Xuejing Liu , Yanpeng Sun , Zechao Li

Referring image segmentation aims to segment the target object referred by a natural language expression. However, previous methods rely on the strong assumption that one sentence must describe one target in the image, which is often not…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yutao Hu , Qixiong Wang , Wenqi Shao , Enze Xie , Zhenguo Li , Jungong Han , Ping Luo

Referring image segmentation (RIS) requires dense vision-language interactions between visual pixels and textual words to segment objects based on a given description. However, commonly adapted dual-encoders in RIS, e.g., Swin transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Seonghoon Yu , Ilchae Jung , Byeongju Han , Taeoh Kim , Yunho Kim , Dongyoon Wee , Jeany Son

Referring Image Segmentation (RIS) aims to segment a target object described by a natural language expression. Existing methods have evolved by leveraging the vision information into the language tokens. To more effectively exploit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yubin Cho , Hyunwoo Yu , Kyeongbo Kong , Kyomin Sohn , Bongjoon Hyun , Suk-Ju Kang

Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms. However, there has been a lack of research investigating how existing algorithms should be benchmarked…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Wei Ji , Li Li , Hao Fei , Xiangyan Liu , Xun Yang , Juncheng Li , Roger Zimmermann

Given a language expression, referring remote sensing image segmentation (RRSIS) aims to identify ground objects and assign pixel-wise labels within the imagery. The one of key challenges for this task is to capture discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Lei , Xinyu Xiao , Tianlin Zhang , Heng-Chao Li , Zhenwei Shi , Qing Zhu

We consider the problem of referring segmentation in images and videos with natural language. Given an input image (or video) and a referring expression, the goal is to segment the entity referred by the expression in the image or video. In…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Xiaoqin Zhang , Yang Wang

Interactive medical segmentation reduces annotation effort by refining predictions through user feedback. Vision Transformer (ViT)-based models, such as the Segment Anything Model (SAM), achieve state-of-the-art performance using user…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mauricio Orbes-Arteaga , Oeslle Lucena , Sabastien Ourselin , M. Jorge Cardoso

Existing Referring Image Segmentation (RIS) methods typically require expensive pixel-level or box-level annotations for supervision. In this paper, we observe that the referring texts used in RIS already provide sufficient information to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Fang Liu , Yuhao Liu , Yuqiu Kong , Ke Xu , Lihe Zhang , Baocai Yin , Gerhard Hancke , Rynson Lau

Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yichen Yan , Xingjian He , Wenxuan Wan , Jing Liu