English
Related papers

Related papers: Dynamic Brightness Adaptation for Robust Multi-mod…

200 papers

Image fusion aims to integrate structural and complementary information from multi-source images. However, existing fusion methods are often either highly task-specific, or general frameworks that apply uniform strategies across diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Kunjing Yang , Zhiwei Wang , Minru Bai

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Infrared and visible image fusion, a hot topic in the field of image processing, aims at obtaining fused images keeping the advantages of source images. This paper proposes a novel auto-encoder (AE) based fusion network. The core idea is…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Zixiang Zhao , Shuang Xu , Chunxia Zhang , Junmin Liu , Pengfei Li , Jiangshe Zhang

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs. While existing methods exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mario Bijelic , Tobias Gruber , Fahim Mannan , Florian Kraus , Werner Ritter , Klaus Dietmayer , Felix Heide

General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Fan Zhao , Wenda Zhao , Huchuan Lu

Fusing the camera and LiDAR information has become a de-facto standard for 3D object detection tasks. Current methods rely on point clouds from the LiDAR sensor as queries to leverage the feature from the image space. However, people…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Tingting Liang , Hongwei Xie , Kaicheng Yu , Zhongyu Xia , Zhiwei Lin , Yongtao Wang , Tao Tang , Bing Wang , Zhi Tang

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

The primary value of infrared and visible image fusion technology lies in applying the fusion results to downstream tasks. However, existing methods face challenges such as increased training complexity and significantly compromised…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Zengyi Yang , Yafei Zhang , Huafeng Li , Yu Liu

Traffic object detection under variable illumination is challenging due to the information loss caused by the limited dynamic range of conventional frame-based cameras. To address this issue, we introduce bio-inspired event cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhanwen Liu , Nan Yang , Yang Wang , Yuke Li , Xiangmo Zhao , Fei-Yue Wang

Thermal imaging has numerous advantages over regular visible-range imaging since it performs well in low-light circumstances. Super-Resolution approaches can broaden their usefulness by replicating accurate high-resolution thermal pictures…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Aditya Kasliwal , Pratinav Seth , Sriya Rallabandi , Sanchit Singhal

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zeyang Zhang , Hui Li , Tianyang Xu , Xiaojun Wu , Josef Kittler

The inherent challenge of multimodal fusion is to precisely capture the cross-modal correlation and flexibly conduct cross-modal interaction. To fully release the value of each modality and mitigate the influence of low-quality multimodal…

Machine Learning · Computer Science 2023-06-07 Qingyang Zhang , Haitao Wu , Changqing Zhang , Qinghua Hu , Huazhu Fu , Joey Tianyi Zhou , Xi Peng

Noise has always been nonnegligible trouble in object detection by creating confusion in model reasoning, thereby reducing the informativeness of the data. It can lead to inaccurate recognition due to the shift in the observed pattern, that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Xinyu Zhang , Zhiwei Li , Zhenhong Zou , Xin Gao , Yijin Xiong , Dafeng Jin , Jun Li , Huaping Liu

The rise of autonomous vehicles has significantly increased the demand for robust 3D object detection systems. While cameras and LiDAR sensors each offer unique advantages--cameras provide rich texture information and LiDAR offers precise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zitian Wang , Zehao Huang , Yulu Gao , Naiyan Wang , Si Liu

Most existing video anomaly detectors rely solely on RGB frames, which lack the temporal resolution needed to capture abrupt or transient motion cues, key indicators of anomalous events. To address this limitation, we propose Image-Event…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Sungheon Jeong , Jihong Park , Mohsen Imani

We present the first work demonstrating that a pure Mamba block can achieve efficient Dense Global Fusion, meanwhile guaranteeing top performance for camera-LiDAR multi-modal 3D object detection. Our motivation stems from the observation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanshi Wang , Jin Gao , Weiming Hu , Zhipeng Zhang

Leveraging the complementary characteristics of visible (RGB) and infrared (IR) imagery offers significant potential for improving object detection. In this paper, we propose WaveMamba, a cross-modality fusion method that efficiently…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Haodong Zhu , Wenhao Dong , Linlin Yang , Hong Li , Yuguang Yang , Yangyang Ren , Qingcheng Zhu , Zichao Feng , Changbai Li , Shaohui Lin , Runqi Wang , Xiaoyan Luo , Baochang Zhang

Although fusing multiple sensor modalities can enhance object detection performance, existing fusion approaches often overlook subtle variations in environmental conditions and sensor inputs. As a result, they struggle to adaptively weight…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Aditya Taparia , Noel Ngu , Mario Leiva , Joshua Shay Kricheli , John Corcoran , Nathaniel D. Bastian , Gerardo Simari , Paulo Shakarian , Ransalu Senanayake

Conventional infrared and visible image fusion(IVIF) methods often assume high-quality inputs, neglecting real-world degradations such as low-light and noise, which limits their practical applicability. To address this, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Tianpei Zhang , Jufeng Zhao , Yiming Zhu , Guangmang Cui , Yuxin Jing