English
Related papers

Related papers: Missing No More: Dictionary-Guided Cross-Modal Ima…

200 papers

Referring Image Segmentation (RIS) is a fundamental vision-language task that outputs object masks based on text descriptions. Many works have achieved considerable progress for RIS, including different fusion method designs. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jianzong Wu , Xiangtai Li , Xia Li , Henghui Ding , Yunhai Tong , Dacheng Tao

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images given a multimodal query (comprising a reference image and a modification text), without training on annotated triplets. Existing methods typically convert the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Tianyue Wang , Leigang Qu , Tianyu Yang , Xiangzhao Hao , Yifan Xu , Haiyun Guo , Jinqiao Wang

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

Infrared and visible image fusion aims to integrate complementary multi-modal information into a single fused result. However, existing methods 1) fail to account for the degradation visible images under adverse weather conditions, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jing Li , Yifan Wang , Jiafeng Yan , Renlong Zhang , Bin Yang

Image fusion plays a key role in a variety of multi-sensor-based vision systems, especially for enhancing visual quality and/or extracting aggregated features for perception. However, most existing methods just consider image fusion as an…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Risheng Liu , Zhu Liu , Jinyuan Liu , Xin Fan , Zhongxuan Luo

Incomplete multi-view unsupervised feature selection (IMUFS), which aims to identify representative features from unlabeled multi-view data containing missing values, has received growing attention in recent years. Despite their promising…

Machine Learning · Computer Science 2025-11-18 Zongxin Shen , Yanyong Huang , Dongjie Wang , Jinyuan Chang , Fengmao Lv , Tianrui Li , Xiaoyi Jiang

Composed image retrieval (CIR) is the task of retrieving a target image specified by a query image and a relative text that describes a semantic modification to the query image. Existing methods in CIR struggle to accurately represent the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Eric Xing , Pranavi Kolouju , Robert Pless , Abby Stylianou , Nathan Jacobs

Infrared and Visible Image Fusion (IVIF) has shown promise in visual tasks under challenging environments, but fusion under unregistered conditions faces inherent misalignments. Current studies to solve them either predict the deformation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Xingyuan Li , Haoyuan Xu , Xingyue Zhu , Jun Ma , Yang Zou , Zhiying Jiang , Jinyuan Liu

In recent years, object detection utilizing both visible (RGB) and thermal infrared (IR) imagery has garnered extensive attention and has been widely implemented across a diverse array of fields. By leveraging the complementary properties…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Tianyi Zhao , Maoxun Yuan , Feng Jiang , Nan Wang , Xingxing Wei

Visible and infrared image fusion (VIF) aims to combine information from visible and infrared images into a single fused image. Previous VIF methods usually employ a color space transformation to keep the hue and saturation from the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Hesong Li , Ying Fu

Integrating visual features has been proved useful for natural language understanding tasks. Nevertheless, in most existing multimodal language models, the alignment of visual and textual data is expensive. In this paper, we propose a novel…

Computation and Language · Computer Science 2020-08-14 Lisai Zhang , Qingcai Chen , Dongfang Li , Buzhou Tang

Semantic segmentation is a fundamental problem in computer vision. It is considered as a pixel-wise classification problem in practice, and most segmentation models use a pixel-wise loss as their optimization riterion. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Shuai Zhao , Yang Wang , Zheng Yang , Deng Cai

In this paper, we study the cross-modal image retrieval, where the inputs contain a source image plus some text that describes certain modifications to this image and the desired image. Prior work usually uses a three-stage strategy to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Chunbin Gu , Jiajun Bu , Xixi Zhou , Chengwei Yao , Dongfang Ma , Zhi Yu , Xifeng Yan

Due to an increase in the number of image achieves, Content-Based Image Retrieval (CBIR) has gained attention for research community of computer vision. The image visual contents are represented in a feature space in the form of numerical…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Atif Nazir , Kashif Nazir

Evaluation is essential in image fusion research, yet most existing metrics are directly borrowed from other vision tasks without proper adaptation. These traditional metrics, often based on complex image transformations, not only fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Tao Zhou , Hui Li , Zhangyong Tang , Josef Kittler

Visible-infrared person re-identification (ReID) aims to recognize a same person of interest across a network of RGB and IR cameras. Some deep learning (DL) models have directly incorporated both modalities to discriminate persons in a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Mahdi Alehdaghi , Arthur Josi , Rafael M. O. Cruz , Eric Granger

Most existing learning-based multi-modality image fusion (MMIF) methods suffer from significant structure inconsistency due to their inappropriate usage of structural features at the semantic level. To alleviate these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Qiao Yang , Yu Zhang , Yutong Chen , Jian Zhang , Shunli Zhang

Most of the existing bi-modal (RGB-D and RGB-T) salient object detection methods utilize the convolution operation and construct complex interweave fusion structures to achieve cross-modal information integration. The inherent local…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Youwei Pang , Xiaoqi Zhao , Lihe Zhang , Huchuan Lu

Class-Incremental Learning (CIL) or continual learning is a desired capability in the real world, which requires a learning system to adapt to new tasks without forgetting former ones. While traditional CIL methods focus on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Da-Wei Zhou , Yuanhan Zhang , Yan Wang , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu