English
Related papers

Related papers: Multimodal Sensor Fusion In Single Thermal image S…

200 papers

Recent research is trying to leverage occupants' demand in the building's control loop to consider individuals' well-being and the buildings' energy savings. To that end, a real-time feedback system is needed to provide data about…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Roshanak Ashrafi , Mona Azarbayjani , Hamed Tabkhi

Image Super-Resolution (SR) is an important class of image processing techniques to enhance the resolution of images and videos in computer vision. Recent years have witnessed remarkable progress of image super-resolution using deep…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Zhihao Wang , Jian Chen , Steven C. H. Hoi

Thermal images have various applications in security, medical and industrial domains. This paper proposes a practical deep-learning approach for thermal image classification. Accurate and efficient classification of thermal images poses a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Prosenjit Chatterjee , ANK Zaman

Image fusion combines data from different heterogeneous sources to obtain more precise information about an underlying scene. Hyperspectral-multispectral (HS-MS) image fusion is currently attracting great interest in remote sensing since it…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ricardo Augusto Borsoi , Tales Imbiriba , José Carlos Moreira Bermudez

Image-text matching is a key multimodal task that aims to model the semantic association between images and text as a matching relationship. With the advent of the multimedia information age, image, and text data show explosive growth, and…

Machine Learning · Computer Science 2024-06-24 Jinyin Wang , Haijing Zhang , Yihao Zhong , Yingbin Liang , Rongwei Ji , Yiru Cang

With the rapid progression of deep learning technologies, multi-modality image fusion has become increasingly prevalent in object detection tasks. Despite its popularity, the inherent disparities in how different sources depict scene…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Xingyuan Li , Yang Zou , Jinyuan Liu , Zhiying Jiang , Long Ma , Xin Fan , Risheng Liu

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

Visible images offer rich texture details, while infrared images emphasize salient targets. Fusing these complementary modalities enhances scene understanding, particularly for advanced vision tasks under challenging conditions. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Beining Xu , Junxian Li

Hyperspectral imaging can help better understand the characteristics of different materials, compared with traditional image systems. However, only high-resolution multispectral (HrMS) and low-resolution hyperspectral (LrHS) images can…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Qi Xie , Minghao Zhou , Qian Zhao , Deyu Meng , Wangmeng Zuo , Zongben Xu

Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understanding what the model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

Infrared and visible images, as multi-modal image pairs, show significant differences in the expression of the same scene. The image fusion task is faced with two problems: one is to maintain the unique features between different…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zixuan Wang , Bin Sun

Deep learning-based detection networks have made remarkable progress in autonomous driving systems (ADS). ADS should have reliable performance across a variety of ambient lighting and adverse weather conditions. However, luminance…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Shruthi Gowda , Bahram Zonooz , Elahe Arani

In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails high costs and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yijia Chen , Pinghua Chen , Xiangxin Zhou , Yingtie Lei , Ziyang Zhou , Mingxian Li

The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolution input to a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

Thermal images model the long-infrared range of the electromagnetic spectrum and provide meaningful information even when there is no visible illumination. Yet, unlike imagery that represents radiation from the visible continuum, infrared…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Nolan B. Gutierrez , William J. Beksi

Multi-modal sensor data fusion takes advantage of complementary or reinforcing information from each sensor and can boost overall performance in applications such as scene classification and target detection. This paper presents a new…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Hersh Vakharia , Xiaoxiao Du

Vision-language models (VLMs) often fail under low illumination because their visual grounding is learned predominantly from RGB imagery, whereas thermal infrared preserves complementary scene structure when visible cues degrade. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Rusiru Thushara , Yasiru Ranasinghe , Jay Paranjape , Vishal M. Patel

Semantic segmentation in complex environments such as urban driving scenes remains challenging under adverse lighting conditions, where RGB images alone provide insufficient information. RGB-Thermal fusion leverages the complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 İsmail Emre Canıtez , Özgür Erkent

In photogrammetry, accurately fusing infrared (IR) and visible (VIS) spectra while preserving the geometric fidelity of visible features and incorporating thermal radiation is a significant challenge, particularly under extreme conditions.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jing Tao , Yonghong Zong , Banglei Guan , Pengju Sun , Taihang Lei , Yang Shanga , Qifeng Yu

Can we improve detection in the thermal domain by borrowing features from rich domains like visual RGB? In this paper, we propose a pseudo-multimodal object detector trained on natural image domain data to help improve the performance of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Chaitanya Devaguptapu , Ninad Akolekar , Manuj M Sharma , Vineeth N Balasubramanian