English
Related papers

Related papers: Zero-shot Referring Image Segmentation with Global…

200 papers

Referring Expression Segmentation (RES) is an emerging task in computer vision, which segments the target instances in images based on text descriptions. However, its development is plagued by the expensive segmentation labels. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Minglang Huang , Yiyi Zhou , Gen Luo , Guannan Jiang , Weilin Zhuang , Xiaoshuai Sun

Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Jiaxing Yang , Lihe Zhang , Jiayu Sun , Huchuan Lu

Image segmentation plays a crucial role in extracting important objects of interest from images, enabling various applications. While existing methods have shown success in segmenting clean images, they often struggle to produce accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Han Zhang , Daoping Zhang , Lok Ming Lui

Referring image segmentation (RIS) aims to precisely segment referents in images through corresponding natural language expressions, yet relying on cost-intensive mask annotations. Weakly supervised RIS thus learns from image-text pairs to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Qiyuan Dai , Sibei Yang

Semantic segmentation has a broad range of applications, but its real-world impact has been significantly limited by the prohibitive annotation costs necessary to enable deployment. Segmentation methods that forgo supervision can side-step…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Gyungin Shin , Weidi Xie , Samuel Albanie

Referring Remote Sensing Image Segmentation provides a flexible and fine-grained framework for remote sensing scene analysis via vision-language collaborative interpretation. Current approaches predominantly utilize a three-stage pipeline…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Keyan Chen , Chenyang Liu , Bowen Chen , Jiafan Zhang , Zhengxia Zou , Zhenwei Shi

Referring Image Segmentation (RIS) requires identifying objects from images based on textual descriptions. We observe that existing methods significantly underperform on motion-related queries compared to appearance-based ones. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Chaeyun Kim , Seunghoon Yi , Yejin Kim , Yohan Jo , Joonseok Lee

Referring image segmentation is a challenging task that involves generating pixel-wise segmentation masks based on natural language descriptions. The complexity of this task increases with the intricacy of the sentences provided. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Hai Nguyen-Truong , E-Ro Nguyen , Tuan-Anh Vu , Minh-Triet Tran , Binh-Son Hua , Sai-Kit Yeung

Referring Image Segmentation (RIS) aims to segment a target object described by a natural language expression. Existing methods have evolved by leveraging the vision information into the language tokens. To more effectively exploit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yubin Cho , Hyunwoo Yu , Kyeongbo Kong , Kyomin Sohn , Bongjoon Hyun , Suk-Ju Kang

Visual grounding localizes regions (boxes or segments) in the image corresponding to given referring expressions. In this work we address image segmentation from referring expressions, a problem that has so far only been addressed in a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Robin Strudel , Ivan Laptev , Cordelia Schmid

The goal of this work is to segment the objects in an image that are referred to by a sequence of linguistic descriptions (referring expressions). We propose a deep neural network with recurrent layers that output a sequence of binary…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Alba Herrera-Palacio , Carles Ventura , Carina Silberer , Ionut-Teodor Sorodoc , Gemma Boleda , Xavier Giro-i-Nieto

Vision-Language Models for remote sensing have shown promising uses thanks to their extensive pretraining. However, their conventional usage in zero-shot scene classification methods still involves dividing large images into patches and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Karim El Khoury , Maxime Zanella , Benoît Gérin , Tiffanie Godelaine , Benoît Macq , Saïd Mahmoudi , Christophe De Vleeschouwer , Ismail Ben Ayed

Medical Referring Image Segmentation (MRIS) involves segmenting target regions in medical images based on natural language descriptions. While achieving promising results, recent approaches usually involve complex design of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Xinyu Chen , Yiran Wang , Gaoyang Pang , Jiafu Hao , Chentao Yue , Luping Zhou , Yonghui Li

Reasoning Segmentation (RS) aims to delineate objects based on implicit text queries, the interpretation of which requires reasoning and knowledge integration. Unlike the traditional formulation of segmentation problems that relies on fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yiqing Shen , Chenjia Li , Fei Xiong , Jeong-O Jeong , Tianpeng Wang , Michael Latman , Mathias Unberath

Referring Image Segmentation (RIS) aims at segmenting the target object from an image referred by one given natural language expression. The diverse and flexible expressions as well as complex visual contents in the images raise the RIS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yang Jiao , Zequn Jie , Weixin Luo , Jingjing Chen , Yu-Gang Jiang , Xiaolin Wei , Lin Ma

Referring Image Segmentation (RIS) aims to segment an object described in natural language from an image, with the main challenge being a text-to-pixel correlation. Previous methods typically rely on single-modality features, such as vision…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yichen Yan , Xingjian He , Sihan Chen , Shichen Lu , Jing Liu

Referring 3D Segmentation is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. Previous works perform a two-stage paradigm, first conducting language-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xuexun Liu , Xiaoxu Xu , Jinlong Li , Qiudan Zhang , Xu Wang , Nicu Sebe , Lin Ma

This paper focuses on the Referring Image Segmentation (RIS) task, which aims to segment objects from an image based on a given language description. The critical problem of RIS is achieving fine-grained alignment between different…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yong Liu , Ruihao Xu , Yansong Tang

CLIP has enabled new and exciting joint vision-language applications, one of which is open-vocabulary segmentation, which can locate any segment given an arbitrary text query. In our research, we ask whether it is possible to discover…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Pitchaporn Rewatbowornwong , Nattanat Chatthee , Ekapol Chuangsuwanich , Supasorn Suwajanakorn

The Segment Anything Model (SAM) excels at general image segmentation but has limited ability to understand natural language, which restricts its direct application in Referring Expression Segmentation (RES). Toward this end, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Wei Tang , Xuejing Liu , Yanpeng Sun , Zechao Li