English
Related papers

Related papers: Comprehensive Multi-Modal Interactions for Referri…

200 papers

Referring image segmentation (RIS) aims to segment a particular region based on a language expression prompt. Existing methods incorporate linguistic features into visual features and obtain multi-modal features for mask decoding. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Mengxi Zhang , Yiming Liu , Xiangjun Yin , Huanjing Yue , Jingyu Yang

This paper focuses on the Referring Image Segmentation (RIS) task, which aims to segment objects from an image based on a given language description. The critical problem of RIS is achieving fine-grained alignment between different…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yong Liu , Ruihao Xu , Yansong Tang

Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Jiaxing Yang , Lihe Zhang , Jiayu Sun , Huchuan Lu

Referring image segmentation (RIS) aims to segment objects in an image conditioning on free-from text descriptions. Despite the overwhelming progress, it still remains challenging for current approaches to perform well on cases with various…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yajie Liu , Pu Ge , Haoxiang Ma , Shichao Fan , Qingjie Liu , Di Huang , Yunhong Wang

In this work, we address the task of referring image segmentation (RIS), which aims at predicting a segmentation mask for the object described by a natural language expression. Most existing methods focus on establishing unidirectional or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Jianhua Yang , Yan Huang , Zhanyu Ma , Liang Wang

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

In this paper we are interested in the problem of image segmentation given natural language descriptions, i.e. referring expressions. Existing works tackle this problem by first modeling images and sentences independently and then segment…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chenxi Liu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Alan Yuille

Referring image segmentation (RIS) aims to find a segmentation mask given a referring expression grounded to a region of the input image. Collecting labelled datasets for this task, however, is notoriously costly and labor-intensive. To…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Seonghoon Yu , Paul Hongsuck Seo , Jeany Son

Given a natural language expression and a remote sensing image, the goal of referring remote sensing image segmentation (RRSIS) is to generate a pixel-level mask of the target object identified by the referring expression. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zhe Dong , Yuzhe Sun , Tianzhu Liu , Wangmeng Zuo , Yanfeng Gu

We address the problem of referring image segmentation that aims to generate a mask for the object specified by a natural language expression. Many recent works utilize Transformer to extract features for the target object by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Chang Liu , Henghui Ding , Yulun Zhang , Xudong Jiang

Referring Image Segmentation (RIS) is a cross-modal task that aims to segment an instance described by a natural language expression. Recent methods leverage large-scale pretrained unimodal models as backbones along with fusion techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Seoyeon Kim , Minguk Kang , Dongwon Kim , Jaesik Park , Suha Kwak

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

Text-driven infrared and visible image fusion has gained attention for enabling natural language to guide the fusion process. However, existing methods lack a goal-aligned task to supervise and evaluate how effectively the input text…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Siju Ma , Changsiyu Gong , Xiaofeng Fan , Yong Ma , Chengjie Jiang

The Segment Anything Model (SAM) has gained significant attention for its impressive performance in image segmentation. However, it lacks proficiency in referring video object segmentation (RVOS) due to the need for precise user-interactive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yonglin Li , Jing Zhang , Xiao Teng , Long Lan , Xinwang Liu

Referring Image Segmentation (RIS) aims to segment an object described in natural language from an image, with the main challenge being a text-to-pixel correlation. Previous methods typically rely on single-modality features, such as vision…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yichen Yan , Xingjian He , Sihan Chen , Shichen Lu , Jing Liu

Referring Image Segmentation (RIS) is a task that segments image regions based on language expressions, requiring fine-grained alignment between two modalities. However, existing methods often struggle with multimodal misalignment and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Qianqi Lu , Yuxiang Xie , Jing Zhang , Shiwei Zou , Yan Chen , Xidao Luan

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Referring Image Segmentation (RIS) aims at segmenting the target object from an image referred by one given natural language expression. The diverse and flexible expressions as well as complex visual contents in the images raise the RIS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yang Jiao , Zequn Jie , Weixin Luo , Jingjing Chen , Yu-Gang Jiang , Xiaolin Wei , Lin Ma

Generalised 3D Referring Expression Segmentation (3D-GRES) localizes objects in 3D scenes based on natural language, even when descriptions match multiple or zero targets. Existing methods rely solely on sparse point clouds, lacking rich…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Keshen Zhou , Runnan Chen , Mingming Gong , Tongliang Liu

Referring Remote Sensing Image Segmentation (RRSIS) is a new challenge that combines computer vision and natural language processing, delineating specific regions in aerial images as described by textual queries. Traditional Referring Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Sihan Liu , Yiwei Ma , Xiaoqing Zhang , Haowei Wang , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji
‹ Prev 1 2 3 10 Next ›