English
Related papers

Related papers: RISAM: Referring Image Segmentation via Mutual-Awa…

200 papers

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyze the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuk Heo , Yeong Jun Koh , Chang-Su Kim

Referring Remote Sensing Image Segmentation (RRSIS) is critical for ecological monitoring, urban planning, and disaster management, requiring precise segmentation of objects in remote sensing imagery guided by textual descriptions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Tianxiang Zhang , Zhaokun Wen , Bo Kong , Kecheng Liu , Yisi Zhang , Peixian Zhuang , Jiangyun Li

In this paper, we propose a novel task termed Omni-Referring Image Segmentation (OmniRIS) towards highly generalized image segmentation. Compared with existing unimodally conditioned segmentation tasks, such as RIS and visual RIS, OmniRIS…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiancheng Zheng , Yunhang Shen , Gen Luo , Baiyang Song , Xing Sun , Xiaoshuai Sun , Yiyi Zhou , Rongrong Ji

Recent advances in zero-shot referring image segmentation (RIS), driven by models such as the Segment Anything Model (SAM) and CLIP, have made substantial progress in aligning visual and textual information. Despite these successes, the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ting Liu , Siyuan Li

As a novel and challenging task, referring segmentation combines computer vision and natural language processing to localize and segment objects based on textual descriptions. While referring image segmentation (RIS) has been extensively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Rui Li , Xiaowei Zhao

Referring Remote Sensing Image Segmentation (RRSIS) aims to segment target objects in remote sensing (RS) images based on textual descriptions. Although Segment Anything Model 2 (SAM2) has shown remarkable performance in various…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

Referring remote sensing image segmentation (RRSIS) is a novel visual task in remote sensing images segmentation, which aims to segment objects based on a given text description, with great significance in practical application. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Leideng Shi , Juan Zhang

Referring image segmentation is a typical multi-modal task, which aims at generating a binary mask for referent described in given language expressions. Prior arts adopt a bimodal solution, taking images and languages as two modalities…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zizhang Li , Mengmeng Wang , Jianbiao Mei , Yong Liu

Referring image segmentation is a challenging task that involves generating pixel-wise segmentation masks based on natural language descriptions. The complexity of this task increases with the intricacy of the sentences provided. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Hai Nguyen-Truong , E-Ro Nguyen , Tuan-Anh Vu , Minh-Triet Tran , Binh-Son Hua , Sai-Kit Yeung

Referring Expression Segmentation (RES) is a widely explored multi-modal task, which endeavors to segment the pre-existing object within a single image with a given linguistic expression. However, in broader real-world scenarios, it is not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yixuan Wu , Zhao Zhang , Xie Chi , Feng Zhu , Rui Zhao

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

The reference-based object segmentation tasks, namely referring image segmentation (RIS), few-shot image segmentation (FSS), referring video object segmentation (RVOS), and video object segmentation (VOS), aim to segment a specific object…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiannan Wu , Yi Jiang , Bin Yan , Huchuan Lu , Zehuan Yuan , Ping Luo

Zero-shot Referring Image Segmentation (RIS) identifies the instance mask that best aligns with a specified referring expression without training and fine-tuning, significantly reducing the labor-intensive annotation process. Despite…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yuji Wang , Jingchen Ni , Yong Liu , Chun Yuan , Yansong Tang

The goal of referring remote sensing image segmentation (RRSIS) is to extract specific pixel-level regions within an aerial image via a natural language expression. Recent advancements, particularly Transformer-based fusion designs, have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Kun Li , George Vosselman , Michael Ying Yang

One-shot medical image segmentation (MIS) is crucial for medical analysis due to the burden of medical experts on manual annotation. The recent emergence of the segment anything model (SAM) has demonstrated remarkable adaptation in MIS but…

Image and Video Processing · Electrical Eng. & Systems 2025-04-30 Jia Wang , Yunan Mei , Jiarui Liu , Xin Fan

Referring image segmentation aims to segment the objects referred by a natural language expression. Previous methods usually focus on designing an implicit and recurrent feature interaction mechanism to fuse the visual-linguistic features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ya Jing , Tao Kong , Wei Wang , Liang Wang , Lei Li , Tieniu Tan

No-reference image quality assessment (NR-IQA) aims to simulate the process of perceiving image quality aligned with subjective human perception. However, existing NR-IQA methods either focus on global representations that leads to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Chenyue Song , Chen Hui , Haiqi Zhu , Feng Jiang , Yachun Mi , Wei Zhang , Shaohui Liu

Traditional reference segmentation tasks have predominantly focused on silent visual scenes, neglecting the integral role of multimodal perception and interaction in human experiences. In this work, we introduce a novel task called…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yaoting Wang , Peiwen Sun , Dongzhan Zhou , Guangyao Li , Honggang Zhang , Di Hu

Medical Referring Image Segmentation (MRIS) involves segmenting target regions in medical images based on natural language descriptions. While achieving promising results, recent approaches usually involve complex design of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Xinyu Chen , Yiran Wang , Gaoyang Pang , Jiafu Hao , Chentao Yue , Luping Zhou , Yonghui Li