English
Related papers

Related papers: TFANet: Three-Stage Image-Text Feature Alignment N…

200 papers

Referring image segmentation segments an image from a language expression. With the aim of producing high-quality masks, existing methods often adopt iterative learning approaches that rely on RNNs or stacked attention layers to refine…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Image dehazing has been a popular topic of research for a long time. Previous deep learning-based image dehazing methods have failed to achieve satisfactory dehazing effects on both synthetic datasets and real-world datasets, exhibiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Xiaolin Gong , Zehan Zheng , Heyuan Du

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Over the past few years, deep convolutional neural network-based methods have made great progress in semantic segmentation of street scenes. Some recent methods align feature maps to alleviate the semantic gap between them and achieve high…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Xi Weng , Yan Yan , Si Chen , Jing-Hao Xue , Hanzi Wang

Textual-visual matching aims at measuring similarities between sentence descriptions and images. Most existing methods tackle this problem without effectively utilizing identity-level annotations. In this paper, we propose an identity-aware…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Shuang Li , Tong Xiao , Hongsheng Li , Wei Yang , Xiaogang Wang

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng

For many computer vision applications such as image captioning, visual question answering, and person search, learning discriminative feature representations at both image and text level is an essential yet challenging problem. Its…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Nikolaos Sarafianos , Xiang Xu , Ioannis A. Kakadiaris

Computational modeling of human multimodal language is an emerging research area in natural language processing spanning the language, visual and acoustic modalities. Comprehending multimodal language requires modeling not only the…

Machine Learning · Computer Science 2018-08-14 Paul Pu Liang , Ziyin Liu , Amir Zadeh , Louis-Philippe Morency

This paper introduces a two-phase deep feature engineering framework for efficient learning of semantics enhanced joint embedding, which clearly separates the deep feature engineering in data preprocessing from training the text-image joint…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Zhongwei Xie , Ling Liu , Yanzhao Wu , Luo Zhong , Lin Li

Reliable semantic segmentation of open environments is essential for intelligent systems, yet significant problems remain: 1) Existing RGB-T semantic segmentation models mainly rely on low-level visual features and lack high-level textual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Meng Yu , Te Cui , Qitong Chu , Wenjie Song , Yi Yang , Yufeng Yue

Although deep learning has advanced remote sensing change detection (RSCD), most methods rely solely on image modality, limiting feature representation, change pattern modeling, and generalization especially under illumination and noise…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yijun Zhou , Yikui Zhai , Zilu Ying , Tingfeng Xian , Wenlve Zhou , Zhiheng Zhou , Xiaolin Tian , Xudong Jia , Hongsheng Zhang , C. L. Philip Chen

Semantic segmentation, a crucial task in computer vision, often relies on labor-intensive and costly annotated datasets for training. In response to this challenge, we introduce FuseNet, a dual-stream framework for self-supervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Amirhossein Kazerouni , Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Video semantic segmentation aims to generate accurate semantic maps for each video frame. To this end, many works dedicate to integrate diverse information from consecutive frames to enhance the features for prediction, where a feature…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Jiafan Zhuang , Zilei Wang , Junjie Li

Text-to-image retrieval (TIR) aims to find relevant images based on a textual query, but existing approaches are primarily based on whole-image captions and lack interpretability. Meanwhile, referring expression segmentation (RES) enables…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Li-Cheng Shen , Jih-Kang Hsieh , Wei-Hua Li , Chu-Song Chen

Referring image segmentation aims to segment the target object described by a given natural language expression. Typically, referring expressions contain complex relationships between the target and its surrounding objects. The main…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Bo Chen , Zhiwei Hu , Zhilong Ji , Jinfeng Bai , Wangmeng Zuo

Referring Image Segmentation (RIS) - the problem of identifying objects in images through natural language sentences - is a challenging task currently mostly solved through supervised learning. However, while collecting referred annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Francisco Eiras , Kemal Oksuz , Adel Bibi , Philip H. S. Torr , Puneet K. Dokania

Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a fine-grained manner.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hui Chen , Guiguang Ding , Xudong Liu , Zijia Lin , Ji Liu , Jungong Han

Efficient vision-language understanding of large Remote Sensing Images (RSIs) is meaningful but challenging. Current Large Vision-Language Models (LVLMs) typically employ limited pre-defined grids to process images, leading to information…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Junwei Luo , Yingying Zhang , Xue Yang , Kang Wu , Qi Zhu , Lei Liang , Jingdong Chen , Yansheng Li

Weakly supervised semantic segmentation (WSSS) approaches typically rely on class activation maps (CAMs) for initial seed generation, which often fail to capture global context due to limited supervision from image-level labels. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soojin Jang , Jungmin Yun , Junehyoung Kwon , Eunju Lee , Youngbin Kim

We propose unsupervised multi-scenario (UMS) person re-identification (ReID) as a new task that expands ReID across diverse scenarios (cross-resolution, clothing change, etc.) within a single coherent framework. To tackle UMS-ReID, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Zhiqi Pang , Lingling Zhao , Yang Liu , Chunyu Wang , Gaurav Sharma