English
Related papers

Related papers: A Multimodal Feature Distillation with Mamba-Trans…

200 papers

Sonar imaging is the primary modality for underwater target detection, yet small targets remain difficult to detect due to insufficient pixel coverage, low acoustic contrast, and scale ambiguity across imaging ranges. CNN-based detectors…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Hui Lin , Jiayi Li , Jing Wang , Shenghui Rong

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, it is not uncommon that some FL participants…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Qian Dai , Dong Wei , Hong Liu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

Multi-Modal Image Fusion (MMIF) aims to combine images from different modalities to produce fused images, retaining texture details and preserving significant information. Recently, some MMIF methods incorporate frequency domain information…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yixin Zhu , Long Lv , Pingping Zhang , Xuehu Liu , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

Predicting clinical outcomes from brain networks in large-scale neuroimaging cohorts such as the Adolescent Brain Cognitive Development (ABCD) study requires effectively integrating functional connectivity (FC) and structural connectivity…

Computational Engineering, Finance, and Science · Computer Science 2026-02-11 Zhenyu Lei , Aiying Zhang , Song Wang , Han Fan , Jundong Li

Efficient modal feature fusion strategy is the key to achieve accurate segmentation of brain glioma. However, due to the specificity of different MRI modes, it is difficult to carry out cross-modal fusion with large differences in modal…

Image and Video Processing · Electrical Eng. & Systems 2025-03-21 Dong Chen , Boyue Zhao , Yi Zhang , Meng Zhao

Deep learning has demonstrated remarkable success in medical image segmentation and computer-aided diagnosis. In particular, numerous advanced methods have achieved state-of-the-art performance in brain tumor segmentation from MRI scans.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiaoyu Shi , Rahul Kumar Jain , Yinhao Li , Ruibo Hou , Jingliang Cheng , Jie Bai , Guohua Zhao , Lanfen Lin , Rui Xu , Yen-wei Chen

Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Lang Su , Chuqing Hu , Guofa Li , Dongpu Cao

Improving the performance of semantic segmentation models using multispectral information is crucial, especially for environments with low-light and adverse conditions. Multi-modal fusion techniques pursue either the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Aniruddh Sikdar , Jayant Teotia , Suresh Sundaram

Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zifu Wan , Pingping Zhang , Yuhao Wang , Silong Yong , Simon Stepputtis , Katia Sycara , Yaqi Xie

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

As information sources are usually imperfect, it is necessary to take into account their reliability in multi-source information fusion tasks. In this paper, we propose a new deep framework allowing us to merge multi-MR image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Ling Huang , Thierry Denoeux , Pierre Vera , Su Ruan

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Mingya Zhang , Zhihao Chen , Yiyuan Ge , Xianping Tao

Online knowledge distillation conducts knowledge transfer among all student models to alleviate the reliance on pre-trained models. However, existing online methods rely heavily on the prediction distributions and neglect the further…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Panpan Zou , Yinglei Teng , Tao Niu

Accurate ultrasound image segmentation is a prerequisite for precise biometrics and accurate assessment. Relying on manual delineation introduces significant errors and is time-consuming. However, existing segmentation models are designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Jie He , Minglang Chen , Minying Lu , Bocheng Liang , Junming Wei , Guiyan Peng , Jiaxi Chen , Ying Tan

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Due to the success of CNN-based and Transformer-based models in various computer vision tasks, recent works study the applicability of CNN-Transformer hybrid architecture models in 3D multi-modality medical segmentation tasks. Introducing…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Yonghao Huang , Leiting Chen , Chuan Zhou

Depth map super-resolution technology aims to improve the spatial resolution of low-resolution depth maps and effectively restore high-frequency detail information. Traditional convolutional neural network has limitations in dealing with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Chenggang Guo , Hao Xu , XianMing Wan

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Human Activity Recognition is an important task in many human-computer collaborative scenarios, whilst having various practical applications. Although uni-modal approaches have been extensively studied, they suffer from data quality and…

Human-Computer Interaction · Computer Science 2023-05-09 Jingcheng Li , Lina Yao , Binghao Li , Claude Sammut

The missing modality issue is critical but non-trivial to be solved by multi-modal models. Current methods aiming to handle the missing modality problem in multi-modal tasks, either deal with missing modalities only during evaluation or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Hu Wang , Yuanhong Chen , Congbo Ma , Jodie Avery , Louise Hull , Gustavo Carneiro