English
Related papers

Related papers: Towards Robust Referring Image Segmentation

200 papers

Referring image segmentation (RIS) aims to segment objects in an image conditioning on free-from text descriptions. Despite the overwhelming progress, it still remains challenging for current approaches to perform well on cases with various…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yajie Liu , Pu Ge , Haoxiang Ma , Shichao Fan , Qingjie Liu , Di Huang , Yunhong Wang

Existing Referring Image Segmentation (RIS) methods typically require expensive pixel-level or box-level annotations for supervision. In this paper, we observe that the referring texts used in RIS already provide sufficient information to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Fang Liu , Yuhao Liu , Yuqiu Kong , Ke Xu , Lihe Zhang , Baocai Yin , Gerhard Hancke , Rynson Lau

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

Referring Image Segmentation (RIS) requires identifying objects from images based on textual descriptions. We observe that existing methods significantly underperform on motion-related queries compared to appearance-based ones. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Chaeyun Kim , Seunghoon Yi , Yejin Kim , Yohan Jo , Joonseok Lee

Referring Image Segmentation (RIS) is an advanced vision-language task that involves identifying and segmenting objects within an image as described by free-form text descriptions. While previous studies focused on aligning visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Minhyun Lee , Seungho Lee , Song Park , Dongyoon Han , Byeongho Heo , Hyunjung Shim

Referring Image Segmentation (RIS) aims to segment an object described in natural language from an image, with the main challenge being a text-to-pixel correlation. Previous methods typically rely on single-modality features, such as vision…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yichen Yan , Xingjian He , Sihan Chen , Shichen Lu , Jing Liu

Text-driven infrared and visible image fusion has gained attention for enabling natural language to guide the fusion process. However, existing methods lack a goal-aligned task to supervise and evaluate how effectively the input text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siju Ma , Changsiyu Gong , Xiaofeng Fan , Yong Ma , Chengjie Jiang

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

Referring image segmentation (RIS) aims to find a segmentation mask given a referring expression grounded to a region of the input image. Collecting labelled datasets for this task, however, is notoriously costly and labor-intensive. To…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Seonghoon Yu , Paul Hongsuck Seo , Jeany Son

Referring Image Segmentation (RIS) aims at segmenting the target object from an image referred by one given natural language expression. The diverse and flexible expressions as well as complex visual contents in the images raise the RIS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yang Jiao , Zequn Jie , Weixin Luo , Jingjing Chen , Yu-Gang Jiang , Xiaolin Wei , Lin Ma

Referring Expression Segmentation (RES) is a widely explored multi-modal task, which endeavors to segment the pre-existing object within a single image with a given linguistic expression. However, in broader real-world scenarios, it is not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yixuan Wu , Zhao Zhang , Xie Chi , Feng Zhu , Rui Zhao

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Referring Image Segmentation (RIS) is a cross-modal task that aims to segment an instance described by a natural language expression. Recent methods leverage large-scale pretrained unimodal models as backbones along with fusion techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Seoyeon Kim , Minguk Kang , Dongwon Kim , Jaesik Park , Suha Kwak

Referring Video Object Segmentation (R-VOS) is a challenging task that aims to segment an object in a video based on a linguistic expression. Most existing R-VOS methods have a critical assumption: the object referred to must appear in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiang Li , Jinglu Wang , Xiaohao Xu , Xiao Li , Bhiksha Raj , Yan Lu

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

Referring image segmentation aims to segment a referent via a natural linguistic expression.Due to the distinct data properties between text and image, it is challenging for a network to well align text and pixel-level features. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Zhaoqing Wang , Yu Lu , Qiang Li , Xunqiang Tao , Yandong Guo , Mingming Gong , Tongliang Liu

Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms. However, there has been a lack of research investigating how existing algorithms should be benchmarked…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Wei Ji , Li Li , Hao Fei , Xiangyan Liu , Xun Yang , Juncheng Li , Roger Zimmermann

Referring Image Segmentation (RIS) aims to segment the target object in an image given a natural language expression. While recent methods leverage pre-trained vision backbones and more training corpus to achieve impressive results, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Zhenjie Mao , Yuhuan Yang , Chaofan Ma , Dongsheng Jiang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Referring image segmentation (RIS) aims to segment an object mentioned in natural language from an image. The main challenge is text-to-pixel fine-grained correlation. In the previous methods, the final results are obtained by convolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yichen Yan , Xingjian He , Wenxuan Wang , Sihan Chen , Jing Liu
‹ Prev 1 2 3 10 Next ›