English
Related papers

Related papers: SESF-Fuse: An Unsupervised Deep Model for Multi-Fo…

200 papers

Refining raw disparity maps from different algorithms to exploit their complementary advantages is still challenging. Uncertainty estimation and complex disparity relationships among pixels limit the accuracy and robustness of existing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Can Pu , Runzi Song , Radim Tylecek , Nanbo Li , Robert B Fisher

Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 Kai Zhang , Luc Van Gool , Radu Timofte

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Latent representations are critical for the performance and robustness of machine learning models, as they encode the essential features of data in a compact and informative manner. However, in vision tasks, these representations are often…

Machine Learning · Computer Science 2025-10-03 Bruno Corcuera , Carlos Eiras-Franco , Brais Cancela

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Depth-from-defocus (DFD), modeling the relationship between depth and defocus pattern in images, has demonstrated promising performance in depth estimation. Recently, several self-supervised works try to overcome the difficulties in…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Haozhe Si , Bin Zhao , Dong Wang , Yunpeng Gao , Mulin Chen , Zhigang Wang , Xuelong Li

The deep-learning-based image restoration and fusion methods have achieved remarkable results. However, the existing restoration and fusion methods paid little research attention to the robustness problem caused by dynamic degradation. In…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

Recent advances in camera design and imaging technology have enabled the capture of high-quality images using smartphones. However, due to the limited dynamic range of digital cameras, the quality of photographs captured in environments…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Lucas Nedel Kirsten , Zhicheng Fu , Nikhil Ambha Madhusudhana

Advanced visual localization techniques encompass image retrieval challenges and 6 Degree-of-Freedom (DoF) camera pose estimation, such as hierarchical localization. Thus, they must extract global and local features from input images.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Wenzheng Song , Ran Yan , Boshu Lei , Takayuki Okatani

Fusion of a panchromatic (PAN) image and corresponding multispectral (MS) image is also known as pansharpening, which aims to combine abundant spatial details of PAN and spectral information of MS. Due to the absence of high-resolution MS…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yinghui Xing , Litao Qu , Shizhou Zhang , Kai Zhang , Yanning Zhang

Multi-modal image fusion aims to integrate complementary information from multiple source images to produce high-quality fused images with enriched content. Although existing approaches based on state space model have achieved satisfied…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yiming Sun , Zifan Ye , Qinghua Hu , Pengfei Zhu

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jun Yue , Leyuan Fang , Shaobo Xia , Yue Deng , Jiayi Ma

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

Visible and infrared image fusion is one of the most crucial tasks in the field of image fusion, aiming to generate fused images with clear structural information and high-quality texture features for high-level vision tasks. However, when…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Qi Zhou , Yukai Shi , Xiaojun Yang , Xiaoyu Xian , Lunjia Liao , Ruimao Zhang , Liang Lin

Following the rapidly growing digital image usage, automatic image categorization has become preeminent research area. It has broaden and adopted many algorithms from time to time, whereby multi-feature (generally, hand-engineered features)…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Thangarajah Akilan , Q. M. Jonathan Wu , Wei Jiang

Current multi-modal image fusion methods typically rely on task-specific models, leading to high training costs and limited scalability. While generative methods provide a unified modeling perspective, they often suffer from slow inference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Huayi Zhu , Xiu Shu , Youqiang Xiong , Qiao Liu , Rui Chen , Di Yuan , Xiaojun Chang , Zhenyu He

The use of multi-modal data for deep machine learning has shown promise when compared to uni-modal approaches with fusion of multi-modal features resulting in improved performance in several applications. However, most state-of-the-art…

Machine Learning · Computer Science 2020-10-26 Darshana Priyasad , Tharindu Fernando , Simon Denman , Sridha Sridharan , Clinton Fookes

A novel multi-focus image fusion algorithm performed in spatial domain based on similarity characteristics is proposed incorporating with region segmentation. In this paper, a new similarity measure is developed based on the structural…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Ya-Qiong Zhang , Xiao-Jun Wu , Hui Li

Hyperspectral image fusion (HIF) is critical to a wide range of applications in remote sensing and many computer vision applications. Most traditional HIF methods assume that the observation model is predefined or known. However, in real…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Wu Wang , Yue Huang , Xinhao Ding

In a scenario where multi-modal cameras are operating together, the problem of working with non-aligned images cannot be avoided. Yet, existing image fusion algorithms rely heavily on strictly registered input image pairs to produce more…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zeyang Zhang , Hui Li , Tianyang Xu , Xiaojun Wu , Josef Kittler