English
Related papers

Related papers: Dynamic Brightness Adaptation for Robust Multi-mod…

200 papers

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the existing fusion algorithms tend to symmetrically fuse the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingxue Huang , Xilai Li , Tianshu Tan , Xiaosong Li , Tao Ye

Underwater images suffer from severe degradations, including color distortions, reduced visibility, and loss of structural details due to wavelength-dependent attenuation and scattering. Existing enhancement methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jaskaran Singh Walia , Shravan Venkatraman , Pavithra LK

Generative models are widely utilized to model the distribution of fused images in the field of infrared and visible image fusion. However, current generative models based fusion methods often suffer from unstable training and slow…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Zhiming Meng , Hui Li , Zeyang Zhang , Zhongwei Shen , Yunlong Yu , Xiaoning Song , Xiaojun Wu

Detecting hidden or partially concealed objects remains a fundamental challenge in multimodal environments, where factors like occlusion, camouflage, and lighting variations significantly hinder performance. Traditional RGB-based detection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Harris Song , Tuan-Anh Vu , Sanjith Menon , Sriram Narasimhan , M. Khalid Jawed

Visible images offer rich texture details, while infrared images emphasize salient targets. Fusing these complementary modalities enhances scene understanding, particularly for advanced vision tasks under challenging conditions. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Beining Xu , Junxian Li

Purely RGB-based vision models often fail to provide reliable cues in challenging scenarios such as nighttime and fog, leading to degraded performance and safety risks. Infrared imaging captures heat-emitting sources and provides critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yuchen Guo , Junli Gong , Wenjun Dong , Yiuming Cheung , Weifeng Su

Beam prediction is critical for reducing beam-training overhead in millimeter-wave (mmWave) systems, especially in high-mobility vehicular scenarios. This paper presents a BEV-Fusion based framework that unifies camera, LiDAR, radar, and…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Jiaming Zeng , Cunhua Pan , Haoyang Weng , Ruijing Liu , Hong Ren , Jiangzhou Wang

Multi-modal image fusion aims to integrate complementary information from multiple source images to produce high-quality fused images with enriched content. Although existing approaches based on state space model have achieved satisfied…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yiming Sun , Zifan Ye , Qinghua Hu , Pengfei Zhu

The goal of multi-modal learning is to use complimentary information on the relevant task provided by the multiple modalities to achieve reliable and robust performance. Recently, deep learning has led significant improvement in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Jaekyum Kim , Junho Koh , Yecheol Kim , Jaehyung Choi , Youngbae Hwang , Jun Won Choi

Recent years have witnessed the remarkable progress of 3D multi-modality object detection methods based on the Bird's-Eye-View (BEV) perspective. However, most of them overlook the complementary interaction and guidance between LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xiaotian Li , Baojie Fan , Jiandong Tian , Huijie Fan

Infrared and visible image fusion aims to combine complementary information from both modalities to provide a more comprehensive scene understanding. However, due to the significant differences between the two modalities, preserving key…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jian Xu , Xin He

Infrared and visible image fusion has emerged as a prominent research area in computer vision. However, little attention has been paid to the fusion task in complex scenes, leading to sub-optimal results under interference. To fill this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Xilai Li , Xiaosong Li , Tianshu Tan , Huafeng Li , Tao Ye

Nowadays, an increasing number of works fuse LiDAR and RGB data in the bird's-eye view (BEV) space for 3D object detection in autonomous driving systems. However, existing methods suffer from over-reliance on the LiDAR branch, with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Kang Luo , Xin Chen , Yangyi Xiao , Hesheng Wang

Overexposure frequently occurs in practical scenarios, causing the loss of critical visual information. However, existing infrared and visible fusion methods still exhibit unsatisfactory performance in highly bright regions. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zhiwei Wang , Yayu Zheng , Defeng He , Li Zhao , Xiaoqin Zhang , Yuxing Li , Edmund Y. Lam

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yu Shi , Yu Liu , Zhong-Cheng Wu , Juan Cheng , Huafeng Li , Xun Chen

An important paradigm in 3D object detection is the use of multiple modalities to enhance accuracy in both normal and challenging conditions, particularly for long-tail scenarios. To address this, recent studies have explored two directions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Minkyoung Cho , Yulong Cao , Jiachen Sun , Qingzhao Zhang , Marco Pavone , Jeong Joon Park , Heng Yang , Z. Morley Mao

Multispectral image pairs can provide the combined information, making object detection applications more reliable and robust in the open world. To fully exploit the different modalities, we present a simple yet effective cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Fang Qingyun , Han Dapeng , Wang Zhaokui

The dynamic range limitation of conventional RGB cameras reduces global contrast and causes loss of high-frequency details such as textures and edges in complex traffic environments (e.g., nighttime driving, tunnels), hindering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zhanwen Liu , Yujing Sun , Yang Wang , Nan Yang , Shengbo Eben Li , Xiangmo Zhao

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang