English
Related papers

Related papers: MMNet: Multi-Mask Network for Referring Image Segm…

200 papers

Over the past few years, state-of-the-art image segmentation algorithms are based on deep convolutional neural networks. To render a deep network with the ability to understand a concept, humans need to collect a large amount of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Weide Liu , Chi Zhang , Guosheng Lin , Fayao Liu

Multimodal referring segmentation aims to segment target objects in visual scenes, such as images, videos, and 3D scenes, based on referring expressions in text or audio format. This task plays a crucial role in practical applications…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Henghui Ding , Song Tang , Shuting He , Chang Liu , Zuxuan Wu , Yu-Gang Jiang

Referring expression segmentation (RES) aims at segmenting the entities' masks that match the descriptive language expression. While traditional RES methods primarily address object-level grounding, real-world scenarios demand a more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Jing Liu , Wenxuan Wang , Yisi Zhang , Yepeng Tang , Xingjian He , Longteng Guo , Tongtian Yue , Xinlong Wang

Referring segmentation aims to generate a segmentation mask for the target instance indicated by a natural language expression. There are typically two kinds of existing methods: one-stage methods that directly perform segmentation on the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Chang Liu , Xudong Jiang , Henghui Ding

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

Referring image segmentation, the task of segmenting any arbitrary entities described in free-form texts, opens up a variety of vision applications. However, manual labeling of training data for this task is prohibitively costly, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Dongwon Kim , Namyup Kim , Cuiling Lan , Suha Kwak

In this work, we address the challenging task of referring segmentation. The query expression in referring segmentation typically indicates the target object by describing its relationship with others. Therefore, to find the target one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Henghui Ding , Chang Liu , Suchen Wang , Xudong Jiang

Referring image segmentation (RIS) aims to segment objects in an image conditioning on free-from text descriptions. Despite the overwhelming progress, it still remains challenging for current approaches to perform well on cases with various…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yajie Liu , Pu Ge , Haoxiang Ma , Shichao Fan , Qingjie Liu , Di Huang , Yunhong Wang

Referring segmentation grounds natural-language queries to pixel-level masks, but extending it to complex scenarios with multiple instances, cross-category groups, or open-ended target sets remains challenging. Previous Large Vision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zhixiong Zhang , Yizhuo Li , Shuangrui Ding , Yuhang Zang , Shengyuan Ding , Long Xing , Yibin Wang , Qiaosheng Zhang , Jiaqi Wang

In this paper, we propose a novel task termed Omni-Referring Image Segmentation (OmniRIS) towards highly generalized image segmentation. Compared with existing unimodally conditioned segmentation tasks, such as RIS and visual RIS, OmniRIS…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiancheng Zheng , Yunhang Shen , Gen Luo , Baiyang Song , Xing Sun , Xiaoshuai Sun , Yiyi Zhou , Rongrong Ji

Referring Remote Sensing Image Segmentation is a complex and challenging task that integrates the paradigms of computer vision and natural language processing. Existing datasets for RRSIS suffer from critical limitations in resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Zhigang Yang , Huiguang Yao , Linmao Tian , Xuezhi Zhao , Qiang Li , Qi Wang

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

Recent image segmentation models have advanced to segment images into high-quality masks for visual entities, and yet they cannot provide comprehensive semantic understanding for complex queries based on both language and vision. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Shengcao Cao , Zijun Wei , Jason Kuen , Kangning Liu , Lingzhi Zhang , Jiuxiang Gu , HyunJoon Jung , Liang-Yan Gui , Yu-Xiong Wang

We consider the problem of referring segmentation in images and videos with natural language. Given an input image (or video) and a referring expression, the goal is to segment the entity referred by the expression in the image or video. In…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Xiaoqin Zhang , Yang Wang

Referring expression segmentation aims to segment an object described by a language expression from an image. Despite the recent progress on this task, existing models tackling this task may not be able to fully capture semantics and visual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Li Xu , Mark He Huang , Xindi Shang , Zehuan Yuan , Ying Sun , Jun Liu

Referring expression segmentation (RES) aims at segmenting the foreground masks of the entities that match the descriptive natural language expression. Previous datasets and methods for classic RES task heavily rely on the prior assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Wenxuan Wang , Tongtian Yue , Yisi Zhang , Longteng Guo , Xingjian He , Xinlong Wang , Jing Liu

Referring Image Segmentation (RIS) aims at segmenting the target object from an image referred by one given natural language expression. The diverse and flexible expressions as well as complex visual contents in the images raise the RIS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yang Jiao , Zequn Jie , Weixin Luo , Jingjing Chen , Yu-Gang Jiang , Xiaolin Wei , Lin Ma

Segmentation is essential for medical image analysis to identify and localize diseases, monitor morphological changes, and extract discriminative features for further diagnosis. Skin cancer is one of the most common types of cancer…

Image and Video Processing · Electrical Eng. & Systems 2022-09-02 Hritam Basak , Rohit Kundu , Ram Sarkar

In supervised learning, traditional image masking faces two key issues: (i) discarded pixels are underutilized, leading to a loss of valuable contextual information; (ii) masking may remove small or critical features, especially in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jingshan Hong , Haigen Hu , Huihuang Zhang , Qianwei Zhou , Zhao Li

Recently, several Space-Time Memory based networks have shown that the object cues (e.g. video frames as well as the segmented object masks) from the past frames are useful for segmenting objects in the current frame. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Haozhe Xie , Hongxun Yao , Shangchen Zhou , Shengping Zhang , Wenxiu Sun