English
Related papers

Related papers: Fully Aligned Network for Referring Image Segmenta…

200 papers

Referring Image Segmentation (RIS), which aims to segment specific objects based on natural language descriptions, plays an essential role in vision-language understanding. Despite its progress in remote sensing applications, RIS in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Kai Ye , YingShi Luan , Zhudi Chen , Guangyue Meng , Pingyang Dai , Liujuan Cao

Referring Image Segmentation (RIS) requires identifying objects from images based on textual descriptions. We observe that existing methods significantly underperform on motion-related queries compared to appearance-based ones. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Chaeyun Kim , Seunghoon Yi , Yejin Kim , Yohan Jo , Joonseok Lee

Referring image segmentation aims to segment a referent via a natural linguistic expression.Due to the distinct data properties between text and image, it is challenging for a network to well align text and pixel-level features. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Zhaoqing Wang , Yu Lu , Qiang Li , Xunqiang Tao , Yandong Guo , Mingming Gong , Tongliang Liu

Referring image segmentation segments an image from a language expression. With the aim of producing high-quality masks, existing methods often adopt iterative learning approaches that rely on RNNs or stacked attention layers to refine…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Referring image segmentation (RIS) requires dense vision-language interactions between visual pixels and textual words to segment objects based on a given description. However, commonly adapted dual-encoders in RIS, e.g., Swin transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Seonghoon Yu , Ilchae Jung , Byeongju Han , Taeoh Kim , Yunho Kim , Dongyoon Wee , Jeany Son

Recent image segmentation models have advanced to segment images into high-quality masks for visual entities, and yet they cannot provide comprehensive semantic understanding for complex queries based on both language and vision. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Shengcao Cao , Zijun Wei , Jason Kuen , Kangning Liu , Lingzhi Zhang , Jiuxiang Gu , HyunJoon Jung , Liang-Yan Gui , Yu-Xiong Wang

Referring Image Segmentation (RIS) is an advanced vision-language task that involves identifying and segmenting objects within an image as described by free-form text descriptions. While previous studies focused on aligning visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Minhyun Lee , Seungho Lee , Song Park , Dongyoon Han , Byeongho Heo , Hyunjung Shim

Given a language expression, referring remote sensing image segmentation (RRSIS) aims to identify ground objects and assign pixel-wise labels within the imagery. The one of key challenges for this task is to capture discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Lei , Xinyu Xiao , Tianlin Zhang , Heng-Chao Li , Zhenwei Shi , Qing Zhu

Text-driven infrared and visible image fusion has gained attention for enabling natural language to guide the fusion process. However, existing methods lack a goal-aligned task to supervise and evaluate how effectively the input text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siju Ma , Changsiyu Gong , Xiaofeng Fan , Yong Ma , Chengjie Jiang

Existing Referring Image Segmentation (RIS) methods typically require expensive pixel-level or box-level annotations for supervision. In this paper, we observe that the referring texts used in RIS already provide sufficient information to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Fang Liu , Yuhao Liu , Yuqiu Kong , Ke Xu , Lihe Zhang , Baocai Yin , Gerhard Hancke , Rynson Lau

Referring Image Segmentation (RIS) aims to segment target objects expressed in natural language within a scene at the pixel level. Various recent RIS models have achieved state-of-the-art performance by generating contextual tokens to model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Minhyeok Lee , Dogyoon Lee , Jungho Lee , Suhwan Cho , Heeseung Choi , Ig-Jae Kim , Sangyoun Lee

The goal of referring remote sensing image segmentation (RRSIS) is to extract specific pixel-level regions within an aerial image via a natural language expression. Recent advancements, particularly Transformer-based fusion designs, have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Kun Li , George Vosselman , Michael Ying Yang

Referring Remote Sensing Image Segmentation (RRSIS) is a new challenge that combines computer vision and natural language processing, delineating specific regions in aerial images as described by textual queries. Traditional Referring Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Sihan Liu , Yiwei Ma , Xiaoqing Zhang , Haowei Wang , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Referring-based Video Object Segmentation is a multimodal problem that requires producing fine-grained segmentation results guided by external cues. Traditional approaches to this task typically involve training specialized models, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Tuyen Tran , Thao Minh Le , Truyen Tran

Referring image segmentation aims to segment the target object described by a given natural language expression. Typically, referring expressions contain complex relationships between the target and its surrounding objects. The main…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Bo Chen , Zhiwei Hu , Zhilong Ji , Jinfeng Bai , Wangmeng Zuo

Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Jiaxing Yang , Lihe Zhang , Jiayu Sun , Huchuan Lu

Referring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions. We propose FS-RVOS, a Transformer-based model with two key components: a cross-modal affinity module and an instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Heng Liu , Guanghui Li , Mingqi Gao , Xiantong Zhen , Feng Zheng , Yang Wang

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Training an object detector on a data-rich domain and applying it to a data-poor one with limited performance drop is highly attractive in industry, because it saves huge annotation cost. Recent research on unsupervised domain adaptive…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Chenfan Zhuang , Xintong Han , Weilin Huang , Matthew R. Scott