English
Related papers

Related papers: RSRefSeg: Referring Remote Sensing Image Segmentat…

200 papers

Referring video object segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This is challenging as it involves deep vision-language understanding, pixel-level dense prediction and spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tianming Liang , Kun-Yu Lin , Chaolei Tan , Jianguo Zhang , Wei-Shi Zheng , Jian-Fang Hu

Referring remote sensing image segmentation (RRSIS) is a novel visual task in remote sensing images segmentation, which aims to segment objects based on a given text description, with great significance in practical application. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Leideng Shi , Juan Zhang

Referring medical image segmentation targets delineating lesions indicated by textual descriptions. Aligning visual and textual cues is challenging due to their distinct data properties. Inspired by large-scale pre-trained vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yaxiong Chen , Minghong Wei , Zixuan Zheng , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

Referring expression segmentation (RES), a task that involves localizing specific instance-level objects based on free-form linguistic descriptions, has emerged as a crucial frontier in human-AI interaction. It demands an intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Ying Zang , Chenglong Fu , Runlong Cao , Didi Zhu , Min Zhang , Wenjun Hu , Lanyun Zhu , Tianrun Chen

Referring Expression Comprehension (REC) aims to localize the target objects specified by free-form natural language descriptions in images. While state-of-the-art methods achieve impressive performance, they perform a dense perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Wei Su , Peihan Miao , Huanzhang Dou , Xi Li

It is widely agreed that open-vocabulary-based approaches outperform classical closed-set training solutions for recognizing unseen objects in images for semantic segmentation. Existing open-vocabulary approaches leverage vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Huadong Tang , Youpeng Zhao , Yan Huang , Min Xu , Jun Wang , Qiang Wu

As a novel and challenging task, referring segmentation combines computer vision and natural language processing to localize and segment objects based on textual descriptions. While referring image segmentation (RIS) has been extensively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Rui Li , Xiaowei Zhao

Image captioning and cross-modal retrieval are examples of tasks that involve the joint analysis of visual and linguistic information. In connection to remote sensing imagery, these tasks can help non-expert users in extracting relevant…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 João Daniel Silva , João Magalhães , Devis Tuia , Bruno Martins

Referring image segmentation aims to segment the objects referred by a natural language expression. Previous methods usually focus on designing an implicit and recurrent feature interaction mechanism to fuse the visual-linguistic features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ya Jing , Tao Kong , Wei Wang , Liang Wang , Lei Li , Tieniu Tan

The goal of this work is to segment the objects in an image that are referred to by a sequence of linguistic descriptions (referring expressions). We propose a deep neural network with recurrent layers that output a sequence of binary…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Alba Herrera-Palacio , Carles Ventura , Carina Silberer , Ionut-Teodor Sorodoc , Gemma Boleda , Xavier Giro-i-Nieto

Referring image segmentation segments an image from a language expression. With the aim of producing high-quality masks, existing methods often adopt iterative learning approaches that rely on RNNs or stacked attention layers to refine…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Visual grounding tasks, such as referring image segmentation (RIS) and referring expression comprehension (REC), aim to localize a target object based on a given textual description. The target object in an image can be described in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Seonghoon Yu , Junbeom Hong , Joonseok Lee , Jeany Son

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yichen Yan , Xingjian He , Wenxuan Wan , Jing Liu

Open-vocabulary segmentation poses significant challenges, as it requires segmenting and recognizing objects across an open set of categories in unconstrained environments. Building on the success of powerful vision-language (ViL)…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Xi Chen , Haosen Yang , Sheng Jin , Xiatian Zhu , Hongxun Yao

Visual grounding localizes regions (boxes or segments) in the image corresponding to given referring expressions. In this work we address image segmentation from referring expressions, a problem that has so far only been addressed in a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Robin Strudel , Ivan Laptev , Cordelia Schmid

Referring expression segmentation (RES) aims at segmenting the foreground masks of the entities that match the descriptive natural language expression. Previous datasets and methods for classic RES task heavily rely on the prior assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Wenxuan Wang , Tongtian Yue , Yisi Zhang , Longteng Guo , Xingjian He , Xinlong Wang , Jing Liu

Semantic segmentation of remote sensing images plays a vital role in a wide range of Earth Observation applications, such as land use land cover mapping, environment monitoring, and sustainable development. Driven by rapid developments in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Libo Wang , Sijun Dong , Ying Chen , Xiaoliang Meng , Shenghui Fang , Songlin Fei

Referring image segmentation aims to produce a pixel-level mask for the image region described by a natural-language expression. Although pretrained vision-language models have improved semantic grounding, many existing methods still rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Alaa Dalaq , Muzammil Behzad