中文
相关论文

相关论文: Multimodal Image Fusion based on Hybrid CNN-Transf…

200 篇论文

The aim of multispectral image fusion is to combine object or scene features of images with different spectral characteristics to increase the perceptual quality. In this paper, we present a novel learning-based solution to image fusion…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Ferhat Can Ataman , Gözde Bozdaği Akar

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

图像与视频处理 · 电气工程与系统科学 2024-04-01 Abdul Rehman Khan , Asifullah Khan

In this paper, we present a hybrid X-shaped vision Transformer, named Xformer, which performs notably on image denoising tasks. We explore strengthening the global representation of tokens from different scopes. In detail, we adopt two…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Jiale Zhang , Yulun Zhang , Jinjin Gu , Jiahua Dong , Linghe Kong , Xiaokang Yang

Multispectral image pairs can provide the combined information, making object detection applications more reliable and robust in the open world. To fully exploit the different modalities, we present a simple yet effective cross-modality…

图像与视频处理 · 电气工程与系统科学 2022-10-05 Fang Qingyun , Han Dapeng , Wang Zhaokui

In this paper, we present a novel deep learning architecture for infrared and visible images fusion problem. In contrast to conventional convolutional networks, our encoding network is combined by convolutional layers, fusion layer and…

计算机视觉与模式识别 · 计算机科学 2019-01-23 Hui Li , Xiao-Jun Wu

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

图像与视频处理 · 电气工程与系统科学 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Yongsheng Zang , Dongming Zhou , Changcheng Wang , Rencan Nie , Yanbu Guo

In this paper we propose a novel method for infrared and visible image fusion where we develop nest connection-based network and spatial/channel attention models. The nest connection-based network can preserve significant amounts of…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Hui Li , Xiao-Jun Wu , Tariq Durrani

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. Considering the correlation between different MR modalities, in this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2021-11-10 Tongxue Zhou , Su Ruan , Pierre Vera , Stéphane Canu

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Meng Zhou , Xiaolan Xu , Yuxuan Zhang

Image fusion is a technique to integrate information from multiple source images with complementary information to improve the richness of a single image. Due to insufficient task-specific training data and corresponding ground truth, most…

计算机视觉与模式识别 · 计算机科学 2022-01-20 Linhao Qu , Shaolei Liu , Manning Wang , Shiman Li , Siqi Yin , Qin Qiao , Zhijian Song

Current crowd-counting models often rely on single-modal inputs, such as visual images or wireless signal data, which can result in significant information loss and suboptimal recognition performance. To address these shortcomings, we…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Zhe Cui , Yuli Li , Le-Nam Tran

Both local details and global context are crucial in medical image segmentation, and effectively integrating them is essential for achieving high accuracy. However, existing mainstream methods based on CNN-Transformer hybrid architectures…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Dayu Tan , Zhenpeng Xu , Yansen Su , Xin Peng , Chunhou Zheng , Weimin Zhong

Aiming at the problems that the convolutional neural networks neglect to capture the inherent attributes of natural images and extract features only in a single scale in the field of image super-resolution reconstruction, a network…

图像与视频处理 · 电气工程与系统科学 2020-04-09 Jiawen Lyn , Sen Yan

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

In this paper, we propose a method using a three dimensional convolutional neural network (3-D-CNN) to fuse together multispectral (MS) and hyperspectral (HS) images to obtain a high resolution hyperspectral image. Dimensionality reduction…

计算机视觉与模式识别 · 计算机科学 2017-06-21 Frosti Palsson , Johannes R. Sveinsson , Magnus O. Ulfarsson

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

图像与视频处理 · 电气工程与系统科学 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil

Multi-modal medical image fusion is essential for the precise clinical diagnosis and surgical navigation since it can merge the complementary information in multi-modalities into a single image. The quality of the fused image depends on the…

计算机视觉与模式识别 · 计算机科学 2023-10-25 Xianming Gu , Lihui Wang , Zeyu Deng , Ying Cao , Xingyu Huang , Yue-min Zhu

Deep image hashing aims to map input images into simple binary hash codes via deep neural networks and thus enable effective large-scale image retrieval. Recently, hybrid networks that combine convolution and Transformer have achieved…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Chao He , Hongxi Wei