English
Related papers

Related papers: Cross-Modal Bidirectional Interaction Model for Re…

200 papers

Referring expression grounding is an important and challenging task in computer vision. To avoid the laborious annotation in conventional referring grounding, unpaired referring grounding is introduced, where the training data only contains…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Hengcan Shi , Munawar Hayat , Jianfei Cai

Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yichen Yan , Xingjian He , Wenxuan Wan , Jing Liu

Referring video object segmentation (RVOS) relies on natural language expressions to segment target objects in video, emphasizing modeling dense text-video relations. The current RVOS methods typically use independently pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Feiyu Pan , Hao Fang , Xiankai Lu

In this paper, we propose a novel multimodal framework, Multimodal Language-Guided Network (MMLGNet), to align heterogeneous remote sensing modalities like Hyperspectral Imaging (HSI) and LiDAR with natural language semantics using…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Aditya Chaudhary , Sneha Barman , Mainak Singha , Ankit Jha , Girish Mishra , Biplab Banerjee

The development of high-resolution remote sensing satellites has provided great convenience for research work related to remote sensing. Segmentation and extraction of specific targets are essential tasks when facing the vast and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Jie Zhang , Xubing Yang , Rui Jiang , Wei Shao , Li Zhang

Reconfigurable Intelligent Surfaces (RISs) are regarded as a key technology for future wireless communications, enabling programmable radio propagation environments. However, the passive reflecting feature of RISs induces notable challenges…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Liuhang Wang , Nir Shlezinger , George C. Alexandropoulos , Haiyang Zhang , Baoyun Wang , Yonina C. Elda

Referring image segmentation aims to segment the target object described by a given natural language expression. Typically, referring expressions contain complex relationships between the target and its surrounding objects. The main…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Bo Chen , Zhiwei Hu , Zhilong Ji , Jinfeng Bai , Wangmeng Zuo

Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms. However, there has been a lack of research investigating how existing algorithms should be benchmarked…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Wei Ji , Li Li , Hao Fei , Xiangyan Liu , Xun Yang , Juncheng Li , Roger Zimmermann

Referring expression segmentation (RES) aims at segmenting the foreground masks of the entities that match the descriptive natural language expression. Previous datasets and methods for classic RES task heavily rely on the prior assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Wenxuan Wang , Tongtian Yue , Yisi Zhang , Longteng Guo , Xingjian He , Xinlong Wang , Jing Liu

Remote Sensing Image-Text Retrieval (RSITR) is pivotal for knowledge services and data mining in the remote sensing (RS) domain. Considering the multi-scale representations in image content and text vocabulary can enable the models to learn…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Rui Yang , Shuang Wang , Yingping Han , Yuanheng Li , Dong Zhao , Dou Quan , Yanhe Guo , Licheng Jiao

Medical referring image segmentation (MRIS) requires pixel-level masks aligned with textual descriptions of anatomical locations, making annotation costly in low-label regimes. Semi-supervised learning (SSL) can mitigate this burden by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuchen Li , Zhen Zhao , Yi Liu , Luping Zhou

In clinical practice, segmenting specific lesions based on the needs of physicians can significantly enhance diagnostic accuracy and treatment efficiency. However, conventional lesion segmentation models lack the flexibility to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuyi Ouyang , Jinyang Zhang , Xiangye Lin , Xilai Wang , Qingqing Chen , Yen-Wei Chen , Lanfen Lin

Referring image segmentation aims to localize and segment a target object in an image based on a free-form referring expression. The core challenge lies in effectively bridging linguistic descriptions with object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiachen Li , Hongyun Wang , Jinyu Xu , Wenbo Jiang , Yanchun Ma , Yongjian Liu , Qing Xie , Bolong Zheng

Single-modal object detection tasks often experience performance degradation when encountering diverse scenarios. In contrast, multimodal object detection tasks can offer more comprehensive information about object features by integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Chang Liu , Xin Ma , Xiaochen Yang , Yuxiang Zhang , Yanni Dong

Given an image and a natural language expression as input, the goal of referring image segmentation is to segment the foreground masks of the entities referred by the expression. Existing methods mainly focus on interactive learning between…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jianjian Cao , Beiya Dai , Yulin Li , Xiameng Qin , Jingdong Wang

A novel reconfigurable intelligent surface (RIS)-aided hybrid reflection/transmitter design is proposed for achieving information exchange in cross-media communications. In pursuit of the balance between energy efficiency and low-cost…

Signal Processing · Electrical Eng. & Systems 2022-11-08 Mingming Wu , Yue Xiao , Yulan Gao , Ming Xiao

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

Multi-organ medical segmentation is a crucial component of medical image processing, essential for doctors to make accurate diagnoses and develop effective treatment plans. Despite significant progress in this field, current multi-organ…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Xinlei Yu , Changmiao Wang , Hui Jin , Ahmed Elazab , Gangyong Jia , Xiang Wan , Changqing Zou , Ruiquan Ge

We consider referring image segmentation. It is a problem at the intersection of computer vision and natural language understanding. Given an input image and a referring expression in the form of a natural language sentence, the goal is to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Linwei Ye , Zhi Liu , Yang Wang

High-resolution remote sensing image semantic segmentation (HRSS) is a fundamental yet critical task in the field of Earth observation. However, it has long faced the challenges of high inter-class similarity and large intra-class…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Jinghao Shi , Jianing Song