English
Related papers

Related papers: Visible and infrared self-supervised fusion traine…

200 papers

Across a wide range of applications, from autonomous vehicles to medical imaging, multi-spectral images provide an opportunity to extract additional information not present in color images. One of the most important steps in making this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Celyn Walters , Oscar Mendez , Mark Johnson , Richard Bowden

While today's high dynamic range (HDR) image fusion algorithms are capable of blending multiple exposures, the acquisition is often controlled so that the dynamic range within one exposure is narrow. For HDR imaging in photon-limited…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Yiheng Chi , Xingguang Zhang , Stanley H. Chan

Self-supervised learning (SSL) is a reliable learning mechanism in which a robot enhances its perceptual capabilities. Typically, in SSL a trusted, primary sensor cue provides supervised training data to a secondary sensor cue. In this…

Robotics · Computer Science 2017-10-10 G. C. H. E. de Croon

This paper introduces a novel method for RGB-Guided Resolution Enhancement of infrared (IR) images called Guided IR Resolution Enhancement (GIRRE). In the area of single image super resolution (SISR) there exists a wide variety of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-13 Marcel Trammer , Nils Genser , Jürgen Seiler

Recently, convolutional neural networks (CNN) have been successfully applied to many remote sensing problems. However, deep learning techniques for multi-image super-resolution from multitemporal unregistered imagery have received little…

Image and Video Processing · Electrical Eng. & Systems 2020-01-16 Andrea Bordone Molini , Diego Valsesia , Giulia Fracastoro , Enrico Magli

Hyperspectral image (HSI) denoising is an essential procedure for HSI applications. Unfortunately, the existing Transformer-based methods mainly focus on non-local modeling, neglecting the importance of locality in image denoising.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Hao Liang , Chengjie , Kun Li , Xin Tian

Limited by the cost and technology, the resolution of depth map collected by depth camera is often lower than that of its associated RGB camera. Although there have been many researches on RGB image super-resolution (SR), a major problem…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Chuhua Xian , Kun Qian , Zitian Zhang , Charlie C. L. Wang

Detecting and classifying targets in video streams from surveillance cameras is a cumbersome, error-prone and expensive task. Often, the incurred costs are prohibitive for real-time monitoring. This leads to data being stored locally or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Lukas Cavigelli , Dominic Bernath , Michele Magno , Luca Benini

The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Li Ke , Liu Yukai

Depth-guided multimodal fusion combines depth information from visible and infrared images, significantly enhancing the performance of 3D reconstruction and robotics applications. Existing thermal-visible image fusion mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jinchang Zhang , Zijun Li , Guoyu Lu

Near-infrared (NIR) hyperspectral imaging is widely used to reveal morphological and chemical information. However, conventional spectral imagers usually rely on costly focal plane arrays and suffer from data redundancy and inefficiencies…

Optics · Physics 2026-05-26 Ben Sun , Kun Huang , Zhibin Zhao , Beibei Dong , Jianan Fang , Heping Zeng

Infrared and visible (IR-VIS) image fusion has gained significant attention for its broad application value. However, existing methods often neglect the complementary role of infrared image in restoring visible image features under hazy…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Huafeng Li , Jiaqi Fang , Yafei Zhang , Yu Liu

Deep convolution neural networks (CNNs) play a critical role in single image super-resolution (SISR) since the amazing improvement of high performance computing. However, most of the super-resolution (SR) methods only focus on recovering…

Image and Video Processing · Electrical Eng. & Systems 2020-09-29 Dong Huo , Yee-Hong Yang

Hyperspectral sensors capture dense spectra per pixel but suffer from low spatial resolution, causing blurred boundaries and mixed-pixel effects. Co-registered companion sensors such as multispectral, RGB, or panchromatic cameras provide…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ritik Shah , Marco F Duarte

Hyperspectral image has become increasingly crucial due to its abundant spectral information. However, It has poor spatial resolution with the limitation of the current imaging mechanism. Nowadays, many convolutional neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng

In this work we propose long wave infrared (LWIR) imagery as a viable supporting modality for semantic segmentation using learning-based techniques. We first address the problem of RGB-thermal camera calibration by proposing a passive…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Shreyas S. Shivakumar , Neil Rodrigues , Alex Zhou , Ian D. Miller , Vijay Kumar , Camillo J. Taylor

High resolution magnetic resonance (MR) imaging is desirable in many clinical applications due to its contribution to more accurate subsequent analyses and early clinical diagnoses. Single image super resolution (SISR) is an effective and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Xiaole Zhao , Yulun Zhang , Tao Zhang , Xueming Zou

Different from traditional hyperspectral super-resolution approaches that focus on improving the spatial resolution, spectral super-resolution aims at producing a high-resolution hyperspectral image from the RGB observation with…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yiqi Yan , Lei Zhang , Jun Li , Wei Wei , Yanning Zhang

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

Current self-supervised denoising methods for paired noisy images typically involve mapping one noisy image through the network to the other noisy image. However, after measuring the spectral bias of such methods using our proposed Image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Wang Zhang , Huaqiu Li , Xiaowan Hu , Tao Jiang , Zikang Chen , Haoqian Wang