English
Related papers

Related papers: Frequency-Guided Fusion For RGB-Thermal Semantic S…

200 papers

This paper focuses on the inconsistency in salient regions between RGB and thermal images. To address this issue, we propose the Region-guided Selective Optimization Network for RGB-T Salient Object Detection, which consists of the region…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Bin Wan , Runmin Cong , Xiaofei Zhou , Hao Fang , Chengtao Lv , Sam Kwong

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Fayaz Ali Dharejo , Sharif S. M. A. , Aiman Khalil , Nachiket Chaudhary , Rizwan Ali Naqvi , Radu Timofte

Semantic segmentation generates comprehensive understanding of scenes through densely predicting the category for each pixel. High-level features from Deep Convolutional Neural Networks already demonstrate their effectiveness in semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Xiangtai Li , Houlong Zhao , Lei Han , Yunhai Tong , Kuiyuan Yang

The main problem in RGB-T tracking is the correct and optimal merging of the cross-modal features of visible and thermal images. Some previous methods either do not fully exploit the potential of RGB and TIR information for channel and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yunfeng Li , Bo Wang , Ye Li

Leveraging multiple sensors is crucial for robust semantic perception in autonomous driving, as each sensor type has complementary strengths and weaknesses. However, existing sensor fusion methods often treat sensors uniformly across all…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tim Broedermann , Christos Sakaridis , Yuqian Fu , Luc Van Gool

Image fusion methods and metrics for their evaluation have conventionally used pixel-based or low-level features. However, for many applications, the aim of image fusion is to effectively combine the semantic content of the input images.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 P. R. Hill , D. R. Bull

Although fusing multiple sensor modalities can enhance object detection performance, existing fusion approaches often overlook subtle variations in environmental conditions and sensor inputs. As a result, they struggle to adaptively weight…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Aditya Taparia , Noel Ngu , Mario Leiva , Joshua Shay Kricheli , John Corcoran , Nathaniel D. Bastian , Gerardo Simari , Paulo Shakarian , Ransalu Senanayake

Monocular depth estimation from RGB images plays a pivotal role in 3D vision. However, its accuracy can deteriorate in challenging environments such as nighttime or adverse weather conditions. While long-wave infrared cameras offer stable…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jialei Xu , Xianming Liu , Junjun Jiang , Kui Jiang , Rui Li , Kai Cheng , Xiangyang Ji

Efficient RGB-D semantic segmentation has received considerable attention in mobile robots, which plays a vital role in analyzing and recognizing environmental information. According to previous studies, depth information can provide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yang Zhang , Chenyun Xiong , Junjie Liu , Xuhui Ye , Guodong Sun

The emergence of different sensors (Near-Infrared, Depth, etc.) is a remedy for the limited application scenarios of traditional RGB camera. The RGB-X tasks, which rely on RGB input and another type of data input to resolve specific…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Jin Ma , Jinlong Li , Qing Guo , Tianyun Zhang , Yuewei Lin , Hongkai Yu

Transmission line defect detection remains challenging for automated UAV inspection due to the dominance of small-scale defects, complex backgrounds, and illumination variations. Existing RGB-based detectors, despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Jiaming Cui , Wenqiang Li , Shuai Zhou , Ruifeng Qin , Feng Shen

Infrared and visible image fusion generates all-weather perception-capable images by combining complementary modalities, enhancing environmental awareness for intelligent unmanned systems. Existing methods either focus on pixel-level fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yiming Sun , Yuan Ruan , Qinghua Hu , Pengfei Zhu

Thermal infrared (TIR) image has proven effectiveness in providing temperature cues to the RGB features for multispectral pedestrian detection. Most existing methods directly inject the TIR modality into the RGB-based framework or simply…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Xiaoxiao Yang , Yeqian Qiang , Huijie Zhu , Chunxiang Wang , Ming Yang

RGB-D saliency detection integrates information from both RGB images and depth maps to improve prediction of salient regions under challenging conditions. The key to RGB-D saliency detection is to fully mine and fuse information at multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Yue Wang , Xu Jia , Lu Zhang , Yuke Li , James Elder , Huchuan Lu

Indoor semantic segmentation is fundamental to computer vision and robotics, supporting applications such as autonomous navigation, augmented reality, and smart environments. Although RGB-D fusion leverages complementary appearance and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yan Gong , Jianli Lu , Yongsheng Gao , Jie Zhao , Xiaojuan Zhang , Susanto Rahardja

Providing machines with the ability to recognize objects like humans has always been one of the primary goals of machine vision. The introduction of RGB-D cameras has paved the way for a significant leap forward in this direction thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Mohammad Reza Loghmani , Mirco Planamente , Barbara Caputo , Markus Vincze

How to effectively fuse cross-modal information is the key problem for RGB-D salient object detection. Early fusion and the result fusion schemes fuse RGB and depth information at the input and output stages, respectively, hence incur the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Nian Liu , Ni Zhang , Ling Shao , Junwei Han

The multi-modal salient object detection model based on RGB-D information has better robustness in the real world. However, it remains nontrivial to better adaptively balance effective multi-modal information in the feature fusion phase. In…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Jinchao Zhu , Xiaoyu Zhang , Xian Fang , Feng Dong , Qiu Yu

Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jinlin You , Muyu Li , Xudong Zhao