English
Related papers

Related papers: Missing No More: Dictionary-Guided Cross-Modal Ima…

200 papers

The target representation learned by convolutional neural networks plays an important role in Thermal Infrared (TIR) tracking. Currently, most of the top-performing TIR trackers are still employing representations learned by the model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Jingxian Sun , Lichao Zhang , Yufei Zha , Abel Gonzalez-Garcia , Peng Zhang , Wei Huang , Yanning Zhang

Joint RGB-infrared perception is essential for achieving robustness under diverse weather and illumination conditions. Although foundation models excel within single modalities, they suffer from substantial cross-modal degradation, an issue…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Fangyuan Mao , Shuo Wang , Jilin Mei , Shun Lu , Chen Min , Fuyang Liu , Xiaokun Feng , Meiqi Wu , Yu Hu

Marine scene understanding and segmentation plays a vital role in maritime monitoring and navigation safety. However, prevalent factors like fog and strong reflections in maritime environments cause severe image degradation, significantly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Weichao Cai , Weiliang Huang , Biao Xue , Chao Huang , Fei Yuan , Bob Zhang

Integrating multispectral data in object detection, especially visible and infrared images, has received great attention in recent years. Since visible (RGB) and infrared (IR) images can provide complementary information to handle light…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Maoxun Yuan , Yinyan Wang , Xingxing Wei

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jun Yue , Leyuan Fang , Shaobo Xia , Yue Deng , Jiayi Ma

Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chunyang Cheng , Tianyang Xu , Xiao-Jun Wu , Hui Li , Xi Li , Zhangyong Tang , Josef Kittler

Multispectral and Hyperspectral Image Fusion (MHIF) is a practical task that aims to fuse a high-resolution multispectral image (HR-MSI) and a low-resolution hyperspectral image (LR-HSI) of the same scene to obtain a high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 ShangQi Deng , RuoCheng Wu , Liang-Jian Deng , Ran Ran , Gemine Vivone

Infrared and visible image fusion integrates information from distinct spectral bands to enhance image quality by leveraging the strengths and mitigating the limitations of each modality. Existing approaches typically treat image fusion and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jinyuan Liu , Bowei Zhang , Qingyun Mei , Xingyuan Li , Yang Zou , Zhiying Jiang , Long Ma , Risheng Liu , Xin Fan

Infrared and visible images, as multi-modal image pairs, show significant differences in the expression of the same scene. The image fusion task is faced with two problems: one is to maintain the unique features between different…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zixuan Wang , Bin Sun

Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available.…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Yamin Arefeen , Brett Levac , Zach Stoebner , Jonathan Tamir

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Acquiring accurately aligned multi-modal image pairs is fundamental for achieving high-quality multi-modal image fusion. To address the lack of ground truth in current multi-modal image registration and fusion methods, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Timing Li , Bing Cao , Pengfei Zhu , Bin Xiao , Qinghua Hu

Image retrieval with hybrid-modality queries, also known as composing text and image for image retrieval (CTI-IR), is a retrieval task where the search intention is expressed in a more complex query format, involving both vision and text…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yida Zhao , Yuqing Song , Qin Jin

Hyperspectral and multispectral image (HSI-MSI) fusion involves combining a low-resolution hyperspectral image (LR-HSI) with a high-resolution multispectral image (HR-MSI) to generate a high-resolution hyperspectral image (HR-HSI). Most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jian Zhu , He Wang , Yang Xu , Zebin Wu , Zhihui Wei

Given an image and a target modification (e.g an image of the Eiffel tower and the text "without people and at night-time"), Compositional Image Retrieval (CIR) aims to retrieve the relevant target image in a database. While supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Retrieval is being redefined by agentic AI, demanding multimodal reasoning beyond conventional similarity-based paradigms. Composed Image Retrieval (CIR) exemplifies this shift as each query combines a reference image with textual…

Information Retrieval · Computer Science 2026-03-02 Zhongyu Yang , Wei Pang , Yingfang Yuan

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Brandon Yushan Feng , Susmija Jabbireddy , Amitabh Varshney

Underwater images suffer from severe degradations, including color distortions, reduced visibility, and loss of structural details due to wavelength-dependent attenuation and scattering. Existing enhancement methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jaskaran Singh Walia , Shravan Venkatraman , Pavithra LK

Early wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. Deep Learning (DL) models that can leverage both visible and infrared information have the potential to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 J. F. Ciprián-Sánchez , G. Ochoa-Ruiz , M. Gonzalez-Mendoza , L. Rossi

Referring image segmentation aims to segment a referent via a natural linguistic expression.Due to the distinct data properties between text and image, it is challenging for a network to well align text and pixel-level features. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Zhaoqing Wang , Yu Lu , Qiang Li , Xunqiang Tao , Yandong Guo , Mingming Gong , Tongliang Liu