English
Related papers

Related papers: A Diff-Attention Aware State Space Fusion Model fo…

200 papers

Multimodal 3D object detection based on deep neural networks has indeed made significant progress. However, it still faces challenges due to the misalignment of scale and spatial information between features extracted from 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Bonan Ding , Jin Xie , Jing Nie , Jiale Cao

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Vision Transformer and its variants have demonstrated great potential in various computer vision tasks. But conventional vision transformers often focus on global dependency at a coarse level, which suffer from a learning challenge on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yunhao Wang , Huixin Sun , Xiaodi Wang , Bin Zhang , Chao Li , Ying Xin , Baochang Zhang , Errui Ding , Shumin Han

Object detection in Remote Sensing Images (RSI) is a critical task for numerous applications in Earth Observation (EO). Differing from object detection in natural images, object detection in remote sensing images faces challenges of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bissmella Bahaduri , Zuheng Ming , Fangchen Feng , Anissa Mokraou

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Infrared and visible image fusion aims to combine complementary information from both modalities to provide a more comprehensive scene understanding. However, due to the significant differences between the two modalities, preserving key…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jian Xu , Xin He

Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Lang Su , Chuqing Hu , Guofa Li , Dongpu Cao

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

ResNet has been widely used in image classification tasks due to its ability to model the residual dependence of constant mappings for linear computation. However, the ResNet method adopts a unidirectional transfer of features and lacks an…

Image and Video Processing · Electrical Eng. & Systems 2025-06-09 Minglang Chen , Jie He , Caixu Xu , Bocheng Liang , Shengli Li , Guannan He , Xiongjie Tao

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yongsheng Zang , Dongming Zhou , Changcheng Wang , Rencan Nie , Yanbu Guo

The research on recognizing the most discriminative regions provides referential information for weakly supervised object localization with only image-level annotations. However, the most discriminative regions usually conceal the other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Yukun Zhou , Zailiang Chen , Hailan Shen , Qing Liu , Rongchang Zhao , Yixiong Liang

Both functional and structural magnetic resonance imaging (fMRI and sMRI) are widely used for the diagnosis of mental disorder. However, combining complementary information from these two modalities is challenging due to their…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyu Zhou , Anton Orlichenko , Gang Qu , Zening Fu , Vince D Calhoun , Zhengming Ding , Yu-Ping Wang

In remote sensing, image fusion technique is a useful tool used to fuse high spatial resolution panchromatic images (PAN) with lower spatial resolution multispectral images (MS) to create a high spatial resolution multispectral of image…

Computer Vision and Pattern Recognition · Computer Science 2012-09-18 Firouz Abdullah Al-Wassai , N. V. Kalyankar , Ali A. Al-Zuky

As one of the tasks in Image Fusion, Infrared and Visible Image Fusion aims to integrate complementary information captured by sensors of different modalities into a single image. The Selective State Space Model (SSSM), known for its…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Haolong Ma , Hui Li , Chunyang Cheng , Gaoang Wang , Xiaoning Song , Xiaojun Wu

Semantic segmentation is a challenge in scene parsing. It requires both context information and rich spatial information. In this paper, we differentiate features for scene segmentation based on dedicated attention mechanisms (DF-DAM), and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Zhiqiang Xiong , Zhicheng Wang , Zhaohui Yu , Xi Gu

Unmanned aerial vehicle (UAV) object detection plays a vital role in applications such as environmental monitoring and urban security. To improve robustness, recent studies have explored multimodal detection by fusing visible (RGB) and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Liu Zongzhen , Luo Hui , Wang Zhixing , Wei Yuxing , Zuo Haorui , Zhang Jianlin

3D object detection based on LiDAR-camera fusion is becoming an emerging research theme for autonomous driving. However, it has been surprisingly difficult to effectively fuse both modalities without information loss and interference. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Guojun Wang , Bin Tian , Yachen Zhang , Long Chen , Dongpu Cao , Jian Wu

The GAN-based infrared and visible image fusion methods have gained ever-increasing attention due to its effectiveness and superiority. However, the existing methods adopt the global pixel distribution of source images as the basis for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Xiaowen Liu , Renhua Wang , Hongtao Huo , Xin Yang , Jing Li

In recent years, various applications in computer vision have achieved substantial progress based on deep learning, which has been widely used for image fusion and shown to achieve adequate performance. However, suffering from limited…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Zhengwen Shen , Jun Wang , Zaiyu Pan , Yulian Li , Jiangyu Wang