English
Related papers

Related papers: Fully and Weakly Supervised Referring Expression S…

200 papers

Referring Expression Segmentation (RES) is an emerging task in computer vision, which segments the target instances in images based on text descriptions. However, its development is plagued by the expensive segmentation labels. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Minglang Huang , Yiyi Zhou , Gen Luo , Guannan Jiang , Weilin Zhuang , Xiaoshuai Sun

Referring Expression Segmentation (RES) aims to generate a segmentation mask for the object described by a given language expression. Existing classic RES datasets and methods commonly support single-target expressions only, i.e., one…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Chang Liu , Henghui Ding , Xudong Jiang

Referring expression segmentation (RES) aims at segmenting the foreground masks of the entities that match the descriptive natural language expression. Previous datasets and methods for classic RES task heavily rely on the prior assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Wenxuan Wang , Tongtian Yue , Yisi Zhang , Longteng Guo , Xingjian He , Xinlong Wang , Jing Liu

Referring Expression Segmentation (RES) is a core vision-language segmentation task that enables pixel-level understanding of targets via free-form linguistic expressions, supporting critical applications such as human-robot interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Yihao Wang , Jusheng Zhang , Ziyi Tang , Keze Wang , Meng Yang

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

Referring expression segmentation (RES) aims at segmenting the entities' masks that match the descriptive language expression. While traditional RES methods primarily address object-level grounding, real-world scenarios demand a more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Jing Liu , Wenxuan Wang , Yisi Zhang , Yepeng Tang , Xingjian He , Longteng Guo , Tongtian Yue , Xinlong Wang

Referring expression segmentation (RES), a task that involves localizing specific instance-level objects based on free-form linguistic descriptions, has emerged as a crucial frontier in human-AI interaction. It demands an intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Ying Zang , Chenglong Fu , Runlong Cao , Didi Zhu , Min Zhang , Wenjun Hu , Lanyun Zhu , Tianrun Chen

Referring video object segmentation (RVOS) aims to segment the target instance in a video, referred by a text expression. Conventional approaches are mostly supervised learning, requiring expensive pixel-level mask annotations. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Miaojing Shi , Jun Huang , Zijie Yue , Hanli Wang

Existing Referring Image Segmentation (RIS) methods typically require expensive pixel-level or box-level annotations for supervision. In this paper, we observe that the referring texts used in RIS already provide sufficient information to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Fang Liu , Yuhao Liu , Yuqiu Kong , Ke Xu , Lihe Zhang , Baocai Yin , Gerhard Hancke , Rynson Lau

Visual grounding localizes regions (boxes or segments) in the image corresponding to given referring expressions. In this work we address image segmentation from referring expressions, a problem that has so far only been addressed in a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Robin Strudel , Ivan Laptev , Cordelia Schmid

Referring Expression Segmentation (RES) is a widely explored multi-modal task, which endeavors to segment the pre-existing object within a single image with a given linguistic expression. However, in broader real-world scenarios, it is not…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yixuan Wu , Zhao Zhang , Xie Chi , Feng Zhu , Rui Zhao

Referring image segmentation aims to segment the objects referred by a natural language expression. Previous methods usually focus on designing an implicit and recurrent feature interaction mechanism to fuse the visual-linguistic features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ya Jing , Tao Kong , Wei Wang , Liang Wang , Lei Li , Tieniu Tan

Referring 3D Segmentation is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. Previous works perform a two-stage paradigm, first conducting language-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xuexun Liu , Xiaoxu Xu , Jinlong Li , Qiudan Zhang , Xu Wang , Nicu Sebe , Lin Ma

Referring Expression Segmentation (RES) aims to provide a segmentation mask of the target object in an image referred to by the text (i.e., referring expression). Existing methods require large-scale mask annotations. Moreover, such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Sayan Nag , Koustava Goswami , Srikrishna Karanam

Semi-supervised referring expression segmentation (SS-RES) aims to achieve precise pixel-level language grounding under limited annotation, yet suffers from limited supervision and unreliable pseudo-labels when exploiting unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Runlong Cao , Ying Zang , Chuanwei Zhou , Tianrun Chen , Tong Zhang , Zhen Cui , Chunyan Xu

In this paper, we introduce SemiRES, a semi-supervised framework that effectively leverages a combination of labeled and unlabeled data to perform RES. A significant hurdle in applying semi-supervised techniques to RES is the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Danni Yang , Jiayi Ji , Yiwei Ma , Tianyu Guo , Haowei Wang , Xiaoshuai Sun , Rongrong Ji

Referring expression comprehension (REC) and segmentation (RES) are two highly-related tasks, which both aim at identifying the referent according to a natural language expression. In this paper, we propose a novel Multi-task Collaborative…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Gen Luo , Yiyi Zhou , Xiaoshuai Sun , Liujuan Cao , Chenglin Wu , Cheng Deng , Rongrong Ji

Referring Expression Segmentation (RES) and Comprehension (REC) respectively segment and detect the object described by an expression, while Referring Expression Generation (REG) generates an expression for the selected object. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Henghui Ding , Chang Liu , Shuting He , Xudong Jiang , Yu-Gang Jiang

Supervised object detection and semantic segmentation require object or even pixel level annotations. When there exist image level labels only, it is challenging for weakly supervised algorithms to achieve accurate predictions. The accuracy…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Weifeng Ge , Sibei Yang , Yizhou Yu

Referring Remote Sensing Image Segmentation (RRSIS) aims to segment instances in remote sensing images according to referring expressions. Unlike Referring Image Segmentation on general images, acquiring high-quality referring expressions…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Kai Ye , Bowen Liu , Jianghang Lin , Jiayi Ji , Pingyang Dai , Liujuan Cao
‹ Prev 1 2 3 10 Next ›