English
Related papers

Related papers: TFANet: Three-Stage Image-Text Feature Alignment N…

200 papers

Referring Image Segmentation (RIS) is a cross-modal task that aims to segment an instance described by a natural language expression. Recent methods leverage large-scale pretrained unimodal models as backbones along with fusion techniques…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Seoyeon Kim , Minguk Kang , Dongwon Kim , Jaesik Park , Suha Kwak

Image-text retrieval is a widely studied topic in the field of computer vision due to the exponential growth of multimedia data, whose core concept is to measure the similarity between images and text. However, most existing retrieval…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yang Zhang

Semantic segmentation in complex scenes relies not only on object appearance but also on object location and the surrounding environment. Nonetheless, it is difficult to model long-range context in the format of pairwise point correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xin Kang , Chaoqun Wang , Xuejin Chen

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Few-shot learning aims to recognize novel concepts by leveraging prior knowledge learned from a few samples. However, for visually intensive tasks such as few-shot semantic segmentation, pixel-level annotations are time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Ma , Guo-Sen Xie , Fang Zhao , Zechao Li

Multimodal fusion of remote sensing images serves as a core technology for overcoming the limitations of single-source data and improving the accuracy of surface information extraction, which exhibits significant application value in fields…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Siyu Zhang , Lianlei Shan , Runhe Qiu

Image-text matching tasks have recently attracted a lot of attention in the computer vision field. The key point of this cross-domain problem is how to accurately measure the similarity between the visual and the textual contents, which…

Computation and Language · Computer Science 2019-07-24 Yaxiong Wang , Hao Yang , Xueming Qian , Lin Ma , Jing Lu , Biao Li , Xin Fan

Recent CLIP-based few-shot semantic segmentation methods introduce class-level textual priors to assist segmentation by typically using a single prompt (e.g., a photo of class). However, these approaches often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Qiang Jiao , Bin Yan , Yi Yang , Mengrui Shi , Qiang Zhang

Accurate segmentation of lesions plays a critical role in medical image analysis and diagnosis. Traditional segmentation approaches that rely solely on visual features often struggle with the inherent uncertainty in lesion distribution and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-03 Dandan Shan , Zihan Li , Yunxiang Li , Qingde Li , Jie Tian , Qingqi Hong

Referring Image Segmentation (RIS) consistently requires language and appearance semantics to more understand each other. The need becomes acute especially under hard situations. To achieve, existing works tend to resort to various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Jiaxing Yang , Lihe Zhang , Jiayu Sun , Huchuan Lu

Event-based semantic segmentation explores the potential of event cameras, which offer high dynamic range and fine temporal resolution, to achieve robust scene understanding in challenging environments. Despite these advantages, the task…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhijiang Li , Haoran He

Accurate automatic medical image segmentation relies on high-quality, dense annotations, which are costly and time-consuming. Weakly supervised learning provides a more efficient alternative by leveraging sparse and coarse annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Dongdong Meng , Sheng Li , Hao Wu , Suqing Tian , Wenjun Ma , Guoping Wang , Xueqing Yan

We consider the problem of referring segmentation in images and videos with natural language. Given an input image (or video) and a referring expression, the goal is to segment the entity referred by the expression in the image or video. In…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Xiaoqin Zhang , Yang Wang

Image-text matching plays a central role in bridging the semantic gap between vision and language. The key point to achieve precise visual-semantic alignment lies in capturing the fine-grained cross-modal correspondence between image and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Zhong Ji , Kexin Chen , Haoran Wang

Semantic segmentation is important for scene understanding. To address the scenes of adverse illumination conditions of natural images, thermal infrared (TIR) images are introduced. Most existing RGB-T semantic segmentation methods follow…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Gongyang Li , Yike Wang , Zhi Liu , Xinpeng Zhang , Dan Zeng

Referring Remote Sensing Image Segmentation is a complex and challenging task that integrates the paradigms of computer vision and natural language processing. Existing datasets for RRSIS suffer from critical limitations in resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Zhigang Yang , Huiguang Yao , Linmao Tian , Xuezhi Zhao , Qiang Li , Qi Wang

Medical image segmentation plays a crucial role in clinical medicine, serving as a key tool for auxiliary diagnosis, treatment planning, and disease monitoring. However, traditional segmentation methods such as U-Net are often limited by…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Gaoyu Chen , Haixia Pan

Learning semantic correspondence between image and text is significant as it bridges the semantic gap between vision and language. The key challenge is to accurately find and correlate shared semantics in image and text. Most existing…

Multimedia · Computer Science 2019-09-26 Chunxiao Liu , Zhendong Mao , An-An Liu , Tianzhu Zhang , Bin Wang , Yongdong Zhang

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

Referring image segmentation (RIS) aims to segment an object mentioned in natural language from an image. The main challenge is text-to-pixel fine-grained correlation. In the previous methods, the final results are obtained by convolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yichen Yan , Xingjian He , Wenxuan Wang , Sihan Chen , Jing Liu