English
Related papers

Related papers: TransFuse: A Unified Transformer-based Image Fusio…

200 papers

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Nowadays advanced image editing tools and technical skills produce tampered images more realistically, which can easily evade image forensic systems and make authenticity verification of images more difficult. To tackle this challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jing Hao , Zhixin Zhang , Shicai Yang , Di Xie , Shiliang Pu

The characteristics of feature selection, nonlinear combination and multi-task auxiliary learning mechanism of the human visual perception system play an important role in real-world scenarios, but the research of image fusion theory based…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Aiqing Fang , Xinbo Zhao , Jiaqi Yang , Yanning Zhang

Due to adverse atmospheric and imaging conditions, natural images suffer from various degradation phenomena. Consequently, image restoration has emerged as a key solution and garnered substantial attention. Although recent Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-05-12 Xingyu Jiang , Ning Gao , Xiuhui Zhang , Hongkun Dou , Shaowen Fu , Xiaoqing Zhong , Hongjue Li , Yue Deng

Image fusion aims to integrate complementary information from multiple input images acquired through various sources to synthesize a new fused image. Existing methods usually employ distinct constraint designs tailored to specific scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Bing Cao , Xingxin Xu , Pengfei Zhu , Qilong Wang , Qinghua Hu

Infrared and visible image fusion, a hot topic in the field of image processing, aims at obtaining fused images keeping the advantages of source images. This paper proposes a novel auto-encoder (AE) based fusion network. The core idea is…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Zixiang Zhao , Shuang Xu , Chunxia Zhang , Junmin Liu , Pengfei Li , Jiangshe Zhang

Infrared-visible image fusion methods aim at generating fused images with good visual quality and also facilitate the performance of high-level tasks. Indeed, existing semantic-driven methods have considered semantic information injection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Liying Wang , Xiaoli Zhang , Chuanmin Jia , Siwei Ma

With an unprecedented increase in the number of agents and systems that aim to navigate the real world using visual cues and the rising impetus for 3D Vision Models, the importance of depth estimation is hard to understate. While supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Snehal Singh Tomar , Maitreya Suin , A. N. Rajagopalan

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum

This paper presents a new regularization method to train a fully convolutional network for semantic tissue segmentation in histopathological images. This method relies on the benefit of unsupervised learning, in the form of image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 C. T. Sari , C. Sokmensuer , C. Gunduz-Demir

We propose a compact and effective framework to fuse multimodal features at multiple layers in a single network. The framework consists of two innovative fusion schemes. Firstly, unlike existing multimodal methods that necessitate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Yikai Wang , Fuchun Sun , Ming Lu , Anbang Yao

Multimodal learning aims to build models that can process and relate information from multiple modalities. Despite years of development in this field, it still remains challenging to design a unified network for processing various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yiyuan Zhang , Kaixiong Gong , Kaipeng Zhang , Hongsheng Li , Yu Qiao , Wanli Ouyang , Xiangyu Yue

Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Riccardo Barbano , Zeljko Kereta , Andreas Hauptmann , Simon R. Arridge , Bangti Jin

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Yikai Wang , Xinghao Chen , Lele Cao , Wenbing Huang , Fuchun Sun , Yunhe Wang

Data augmentation improves the generalization power of deep learning models by synthesizing more training samples. Sample-mixing is a popular data augmentation approach that creates additional data by combining existing samples. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Tsz-Him Cheung , Dit-Yan Yeung

The general aim of multi-focus image fusion is to gather focused regions of different images to generate a unique all-in-focus fused image. Deep learning based methods become the mainstream of image fusion by virtue of its powerful feature…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Boyuan Ma , Xiang Yin , Di Wu , Xiaojuan Ban

The fusion of input and guidance images that have a tradeoff in their information (e.g., hyperspectral and RGB image fusion or pansharpening) can be interpreted as one general problem. However, previous studies applied a task-specific…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Tatsumi Uezato , Danfeng Hong , Naoto Yokoya , Wei He

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

Current multimodal medical image fusion typically assumes that source images are of high quality and perfectly aligned at the pixel level. Its effectiveness heavily relies on these conditions and often deteriorates when handling misaligned…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dayong Su , Yafei Zhang , Huafeng Li , Jinxing Li , Yu Liu

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng