English
Related papers

Related papers: RISAM: Referring Image Segmentation via Mutual-Awa…

200 papers

In this paper, we study a challenging task of zero-shot referring image segmentation. This task aims to identify the instance mask that is most related to a referring expression without training on pixel-level annotations. Previous research…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Yucheng Suo , Linchao Zhu , Yi Yang

Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a fine-grained manner.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hui Chen , Guiguang Ding , Xudong Liu , Zijia Lin , Ji Liu , Jungong Han

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao

Referring Image Segmentation (RIS), which aims to segment specific objects based on natural language descriptions, plays an essential role in vision-language understanding. Despite its progress in remote sensing applications, RIS in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Kai Ye , YingShi Luan , Zhudi Chen , Guangyue Meng , Pingyang Dai , Liujuan Cao

Referring segmentation aims to generate a segmentation mask for the target instance indicated by a natural language expression. There are typically two kinds of existing methods: one-stage methods that directly perform segmentation on the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Chang Liu , Xudong Jiang , Henghui Ding

Referring Image Segmentation (RIS) is a challenging task that aims to segment objects in an image based on natural language expressions. While prior studies have predominantly concentrated on improving vision-language interactions and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Ming Dai , Wenxuan Cheng , Jiang-jiang Liu , Sen Yang , Wenxiao Cai , Yanpeng Sun , Wankou Yang

In clinical practice, segmenting specific lesions based on the needs of physicians can significantly enhance diagnostic accuracy and treatment efficiency. However, conventional lesion segmentation models lack the flexibility to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuyi Ouyang , Jinyang Zhang , Xiangye Lin , Xilai Wang , Qingqing Chen , Yen-Wei Chen , Lanfen Lin

Text images are unique in their dual nature, encompassing both visual and linguistic information. The visual component encompasses structural and appearance-based features, while the linguistic dimension incorporates contextual and semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yifei Zhang , Chang Liu , Jin Wei , Xiaomeng Yang , Yu Zhou , Can Ma , Xiangyang Ji

Referring image segmentation (RIS) aims to segment an object mentioned in natural language from an image. The main challenge is text-to-pixel fine-grained correlation. In the previous methods, the final results are obtained by convolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yichen Yan , Xingjian He , Wenxuan Wang , Sihan Chen , Jing Liu

Referring Remote Sensing Image Segmentation (RRSIS) is a challenging task, aiming to segment specific target objects in remote sensing (RS) images based on a given language expression. Existing RRSIS methods typically employ coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Maofu Liu , Xin Jiang , Xiaokang Zhang

Industrial Anomaly Detection (IAD) is vital for manufacturing, yet traditional methods face significant challenges: unsupervised approaches yield rough localizations requiring manual thresholds, while supervised methods overfit due to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Pengfei Yue , Xiaokang Jiang , Yilin Lu , Jianghang Lin , Shengchuan Zhang , Liujuan Cao

The availability of large-scale remote sensing video data underscores the importance of high-quality interactive segmentation. However, challenges such as small object sizes, ambiguous features, and limited generalization make it difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhe Shan , Yang Liu , Lei Zhou , Cheng Yan , Heng Wang , Xia Xie

Referring expression segmentation (RES) aims at segmenting the entities' masks that match the descriptive language expression. While traditional RES methods primarily address object-level grounding, real-world scenarios demand a more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Jing Liu , Wenxuan Wang , Yisi Zhang , Yepeng Tang , Xingjian He , Longteng Guo , Tongtian Yue , Xinlong Wang

Visual grounding tasks, such as referring image segmentation (RIS) and referring expression comprehension (REC), aim to localize a target object based on a given textual description. The target object in an image can be described in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Seonghoon Yu , Junbeom Hong , Joonseok Lee , Jeany Son

The spatial attention is a straightforward approach to enhance the performance for remote sensing image captioning. However, conventional spatial attention approaches consider only the attention distribution on one fixed coarse grid,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Chengze Wang , Zhiyu Jiang , Yuan Yuan

Despite the progress of image segmentation for accurate visual entity segmentation, completing the diverse requirements of image editing applications for different-level region-of-interest selections remains unsolved. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lu Qi , Jason Kuen , Weidong Guo , Jiuxiang Gu , Zhe Lin , Bo Du , Yu Xu , Ming-Hsuan Yang

Referring Video Object Segmentation (RVOS) aims to segment objects in videos based on textual queries. Current methods mainly rely on large-scale supervised fine-tuning (SFT) of Multi-modal Large Language Models (MLLMs). However, this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Haichao Jiang , Tianming Liang , Wei-Shi Zheng , Jian-Fang Hu

Referring image segmentation (RIS) aims to precisely segment referents in images through corresponding natural language expressions, yet relying on cost-intensive mask annotations. Weakly supervised RIS thus learns from image-text pairs to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Qiyuan Dai , Sibei Yang

Referring 3D Segmentation is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. Previous works perform a two-stage paradigm, first conducting language-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xuexun Liu , Xiaoxu Xu , Jinlong Li , Qiudan Zhang , Xu Wang , Nicu Sebe , Lin Ma

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr