English
Related papers

Related papers: Spatial-Spectral Fusion by Combining Deep Learning…

200 papers

The blind fusion of unregistered hyperspectral images (HSIs) and multispectral images (MSIs) has attracted growing attention recently. To address the registration challenge, most existing methods employ spatial transformations on the HSI to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Kunjing Yang , Libin Zheng , Minru Bai , Ting Lu , Leyuan Fang

Archetypal scenarios for change detection generally consider two images acquired through sensors of the same modality. However, in some specific cases such as emergency situations, the only images available may be those acquired through…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Vinicius Ferraris , Nicolas Dobigeon , Qi Wei , Marie Chabert

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

Despite their simpler information fusion designs compared with Vision Transformers and Convolutional Neural Networks, Vision MLP architectures have demonstrated strong performance and high data efficiency in recent research. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jonathan Cui , David A. Araujo , Suman Saha , Md. Faisal Kabir

Hyperspectral image (HSI) super-resolution is commonly used to overcome the hardware limitations of existing hyperspectral imaging systems on spatial resolution. It fuses a low-resolution (LR) HSI and a high-resolution (HR) conventional…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Xiuheng Wang , Jie Chen , Qi Wei , Cédric Richard

Most satellites decouple the acquisition of a panchromatic image at high spatial resolution from the acquisition of a multispectral image at lower spatial resolution. Pansharpening is a fusion technique used to increase the spatial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Joan Duran , Antoni Buades , Bartomeu Coll , Catalina Sbert , Gwendoline Blanchet

The analysis of multi-modality positron emission tomography and computed tomography (PET-CT) images for computer aided diagnosis applications requires combining the sensitivity of PET to detect abnormal regions with anatomical localization…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Ashnil Kumar , Michael Fulham , Dagan Feng , Jinman Kim

This paper addresses the problem of reconstructing a high-resolution hyperspectral image from a low-resolution multispectral observation. While spatial super-resolution and spectral super-resolution have been extensively studied, joint…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Ivan Pereira-Sánchez , Julia Navarro , Ana Belén Petro , Joan Duran

This paper addresses the fusion of a pair of spatially unregistered hyperspectral image (HSI) and multispectral image (MSI) covering roughly overlapping regions. HSIs offer high spectral but low spatial resolution, while MSIs provide the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-02 Jiahui Song , Sagar Shrestha , Xiao Fu

A novel multi-focus image fusion algorithm performed in spatial domain based on similarity characteristics is proposed incorporating with region segmentation. In this paper, a new similarity measure is developed based on the structural…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Ya-Qiong Zhang , Xiao-Jun Wu , Hui Li

Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few. Recently, deep learning has emerged as an important tool for image fusion. This paper presents…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Shuang Xu , Zixiang Zhao , Yicheng Wang , Chunxia Zhang , Junmin Liu , Jiangshe Zhang

This paper presents a multi-band image fusion algorithm based on unsupervised spectral unmixing for combining a high-spatial low-spectral resolution image and a low-spatial high-spectral resolution image. The widely used linear observation…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Qi Wei , Jose Bioucas-Dias , Nicolas Dobigeon , Jean-Yves Tourneret , Marcus Chen , Simon Godsill

The fusion of hyperspectral image (HSI) with multispectral image (MSI) provides an effective way to enhance the spatial resolution of HSI. However, due to different acquisition conditions, there may exist spectral variability and spatially…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yue Wen , Kunjing Yang , Minru Bai

Due to the limitations of hyperspectral imaging systems, hyperspectral imagery (HSI) often suffers from poor spatial resolution, thus hampering many applications of the imagery. Hyperspectral super-resolution refers to fusing HSI and MSI to…

Image and Video Processing · Electrical Eng. & Systems 2020-07-29 Ke Zheng , Lianru Gao , Wenzhi Liao , Danfeng Hong , Bing Zhang , Ximin Cui , Jocelyn Chanussot

Hyperspectral images (HSI) with abundant spectral information reflected materials property usually perform low spatial resolution due to the hardware limits. Meanwhile, multispectral images (MSI), e.g., RGB images, have a high spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Shuaikai Shi , Lijun Zhang , Yoann Altmann , Jie Chen

Convolution neural network (CNN) has been widely used in Single Image Super Resolution (SISR) so that SISR has been a great success recently. As the network deepens, the learning ability of network becomes more and more powerful. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-17 Jiawen Lyn

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Pan-sharpening aims to increase the spatial resolution of the low-resolution multispectral (LrMS) image with the guidance of the corresponding panchromatic (PAN) image. Although deep learning (DL)-based pan-sharpening methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Mingsong Li , Yikun Liu , Tao Xiao , Yuwen Huang , Gongping Yang

Satellite imaging has a central role in monitoring, detecting and estimating the intensity of key natural phenomena. One important feature of satellite images is the trade-off between spatial/spectral resolution and their revisiting time, a…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Haoqing Li , Bhavia Duvviri , Ricardo Borsoi , Tales Imbiriba , Edward Beighley , Deniz Erdogmus , Pau Closas