English
Related papers

Related papers: Comprehensive Multi-Modal Interactions for Referri…

200 papers

Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a fine-grained manner.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hui Chen , Guiguang Ding , Xudong Liu , Zijia Lin , Ji Liu , Jungong Han

In this paper, we propose a novel task termed Omni-Referring Image Segmentation (OmniRIS) towards highly generalized image segmentation. Compared with existing unimodally conditioned segmentation tasks, such as RIS and visual RIS, OmniRIS…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiancheng Zheng , Yunhang Shen , Gen Luo , Baiyang Song , Xing Sun , Xiaoshuai Sun , Yiyi Zhou , Rongrong Ji

Referring segmentation aims to generate a segmentation mask for the target instance indicated by a natural language expression. There are typically two kinds of existing methods: one-stage methods that directly perform segmentation on the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Chang Liu , Xudong Jiang , Henghui Ding

Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms. However, there has been a lack of research investigating how existing algorithms should be benchmarked…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Wei Ji , Li Li , Hao Fei , Xiangyan Liu , Xun Yang , Juncheng Li , Roger Zimmermann

Referring Image Segmentation (RIS) aims to segment the target object in an image given a natural language expression. While recent methods leverage pre-trained vision backbones and more training corpus to achieve impressive results, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Zhenjie Mao , Yuhuan Yang , Chaofan Ma , Dongsheng Jiang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Referring Remote Sensing Image Segmentation (RRSIS) is a challenging task, aiming to segment specific target objects in remote sensing (RS) images based on a given language expression. Existing RRSIS methods typically employ coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Maofu Liu , Xin Jiang , Xiaokang Zhang

We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyze the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuk Heo , Yeong Jun Koh , Chang-Su Kim

Referring image segmentation (RIS) aims to locate the particular region corresponding to the language expression. Existing methods incorporate features from different modalities in a \emph{bottom-up} manner. This design may get some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Mengxi Zhang , Heqing Lian , Yiming Liu , Jie Chen

Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yichen Yan , Xingjian He , Wenxuan Wan , Jing Liu

Multi-modal object Re-Identification (ReID) aims to exploit complementary information from different modalities to retrieve specific objects. However, existing methods often rely on hard token filtering or simple fusion strategies, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xingguo Xu , Zhanyu Liu , Weixiang Zhou , Yuansheng Gao , Junjie Cao , Yuhao Wang , Jixiang Luo , Dell Zhang

Referring Image Segmentation (RIS) aims to segment the object in an image uniquely referred to by a natural language expression. However, RIS training often contains hard-to-align and instance-specific visual signals; optimizing on such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tongfei Chen , Shuo Yang , Yuguang Yang , Linlin Yang , Runtang Guo , Changbai Li , He Long , Chunyu Xie , Dawei Leng , Baochang Zhang

Referring Remote Sensing Image Segmentation is a complex and challenging task that integrates the paradigms of computer vision and natural language processing. Existing datasets for RRSIS suffer from critical limitations in resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Zhigang Yang , Huiguang Yao , Linmao Tian , Xuezhi Zhao , Qiang Li , Qi Wang

Referring image segmentation segments an image from a language expression. With the aim of producing high-quality masks, existing methods often adopt iterative learning approaches that rely on RNNs or stacked attention layers to refine…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Referring remote sensing image segmentation is crucial for achieving fine-grained visual understanding through free-format textual input, enabling enhanced scene and object extraction in remote sensing applications. Current research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Keyan Chen , Jiafan Zhang , Chenyang Liu , Zhengxia Zou , Zhenwei Shi

The availability of large-scale remote sensing video data underscores the importance of high-quality interactive segmentation. However, challenges such as small object sizes, ambiguous features, and limited generalization make it difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhe Shan , Yang Liu , Lei Zhou , Cheng Yan , Heng Wang , Xia Xie

Interactive medical segmentation reduces annotation effort by refining predictions through user feedback. Vision Transformer (ViT)-based models, such as the Segment Anything Model (SAM), achieve state-of-the-art performance using user…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mauricio Orbes-Arteaga , Oeslle Lucena , Sabastien Ourselin , M. Jorge Cardoso

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

Referring Image Segmentation (RIS) is a challenging task that aims to segment objects in an image based on natural language expressions. While prior studies have predominantly concentrated on improving vision-language interactions and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ming Dai , Wenxuan Cheng , Jiang-jiang Liu , Sen Yang , Wenxiao Cai , Yanpeng Sun , Wankou Yang

Referring Image Segmentation (RIS) aims to segment a target object described by a natural language expression. Existing methods have evolved by leveraging the vision information into the language tokens. To more effectively exploit visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yubin Cho , Hyunwoo Yu , Kyeongbo Kong , Kyomin Sohn , Bongjoon Hyun , Suk-Ju Kang

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu