English
Related papers

Related papers: Image Fusion Transformer

200 papers

Image fusion aims to integrate complementary information from multiple input images acquired through various sources to synthesize a new fused image. Existing methods usually employ distinct constraint designs tailored to specific scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Bing Cao , Xingxin Xu , Pengfei Zhu , Qilong Wang , Qinghua Hu

Image fusion is famous as an alternative solution to generate one high-quality image from multiple images in addition to image restoration from a single degraded image. The essence of image fusion is to integrate complementary information…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pengwei Liang , Junjun Jiang , Qing Ma , Xianming Liu , Jiayi Ma

The end-to-end image fusion framework has achieved promising performance, with dedicated convolutional networks aggregating the multi-modal local appearance. However, long-range dependencies are directly neglected in existing CNN fusion…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu

Infrared and visible image fusion, as a hot topic in image processing and image enhancement, aims to produce fused images retaining the detail texture information in visible images and the thermal radiation information in infrared images. A…

Image and Video Processing · Electrical Eng. & Systems 2021-04-15 Zixiang Zhao , Jiangshe Zhang , Shuang Xu , Kai Sun , Chunxia Zhang , Junmin Liu

Multimodal visual information fusion aims to integrate the multi-sensor data into a single image which contains more complementary information and less redundant features. However the complementary information is hard to extract, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Hui Li , Xiao-Jun Wu

The identification of artwork is crucial in areas like cultural heritage protection, art market analysis, and historical research. With the advancement of deep learning, Convolutional Neural Networks (CNNs) and Transformer models have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Zhenyu Wang , Heng Song

Deep neural networks have been applied to improve the image quality of fluorescence microscopy imaging. Previous methods are based on convolutional neural networks (CNNs) which generally require more time-consuming training of separate…

We study the intrinsic transformation of feature maps across convolutional network layers with explicit top-down control. To this end, we develop top-down feature transformer (TFT), under controllable parameters, that are able to account…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Zhiwei Jia , Haoshen Hong , Siyang Wang , Kwonjoon Lee , Zhuowen Tu

Convolutional neural networks (CNNs) have been the consensus for medical image segmentation tasks. However, they suffer from the limitation in modeling long-range dependencies and spatial correlations due to the nature of convolution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Moein Heidari , Amirhossein Kazerouni , Milad Soltany , Reza Azad , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

A new multifocus image fusion approach is presented in this paper. First the contourlet transform is used to decompose the source images into different components. Then, some salient features are extracted from components. In order to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-28 Fatemeh Vakili Moghadam , Hamid Reza Shahdoosti

The aim of multispectral image fusion is to combine object or scene features of images with different spectral characteristics to increase the perceptual quality. In this paper, we present a novel learning-based solution to image fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Ferhat Can Ataman , Gözde Bozdaği Akar

A problem with Convolutional Neural Networks (CNNs) is that they require large datasets to obtain adequate robustness; on small datasets, they are prone to overfitting. Many methods have been proposed to overcome this shortcoming with CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Loris Nanni , Michelangelo Paci , Sheryl Brahnam , Alessandra Lumini

Multi-modal approaches employ data from multiple input streams such as textual and visual domains. Deep neural networks have been successfully employed for these approaches. In this paper, we present a novel multi-modal approach that fuses…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Ignazio Gallo , Alessandro Calefati , Shah Nawaz , Muhammad Kamran Janjua

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

Image fusion aims to blend complementary information from multiple sensing modalities, yet existing approaches remain limited in robustness, adaptability, and controllability. Most current fusion networks are tailored to specific tasks and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiayang Li , Chengjie Jiang , Junjun Jiang , Pengwei Liang , Jiayi Ma , Liqiang Nie

Medical image segmentation - the prerequisite of numerous clinical needs - has been significantly prospered by recent advances in convolutional neural networks (CNNs). However, it exhibits general limitations on modeling explicit long-range…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yundong Zhang , Huiye Liu , Qiang Hu

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yongsheng Zang , Dongming Zhou , Changcheng Wang , Rencan Nie , Yanbu Guo

In recent years, deep learning has become a very active research tool which is used in many image processing fields. In this paper, we propose an effective image fusion method using a deep learning framework to generate a single image which…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Hui Li , Xiao-Jun Wu , Josef Kittler

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

Following the rapidly growing digital image usage, automatic image categorization has become preeminent research area. It has broaden and adopted many algorithms from time to time, whereby multi-feature (generally, hand-engineered features)…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Thangarajah Akilan , Q. M. Jonathan Wu , Wei Jiang