English
Related papers

Related papers: Random Token Fusion for Multi-View Medical Diagnos…

200 papers

Skin cancer is one of the most prevalent and potentially life-threatening diseases worldwide, necessitating early and accurate diagnosis to improve patient outcomes. Conventional diagnostic methods, reliant on clinical expertise and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Mirza Ahsan Ullah , Tehseen Zia

Foundation models have significantly advanced medical image analysis through the pre-train fine-tune paradigm. Among various fine-tuning algorithms, Parameter-Efficient Fine-Tuning (PEFT) is increasingly utilized for knowledge transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raman Dutt , Linus Ericsson , Pedro Sanchez , Sotirios A. Tsaftaris , Timothy Hospedales

The generalization of the Transformer architecture via MetaFormer has reshaped our understanding of its success in computer vision. By replacing self-attention with simpler token mixers, MetaFormer provides strong baselines for vision…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Ron Keuth , Paul Kaftan , Mattias P. Heinrich

Trusted multi-view classification aims to deliver reliable fusion for accurate predictions and has recently attracted substantial attention in both academia and industry. However, existing TMVC methods typically assume strict alignment…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Siyuan Duan , Yuan Sun , Dezhong Peng , Yingke Chen , Xi Peng , Peng Hu

Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Siran Peng , Xiangyu Zhu , Haoyu Deng , Liang-Jian Deng , Zhen Lei

Deployment of machine learning algorithms into real-world practice is still a difficult task. One of the challenges lies in the unpredictable variability of input data, which may differ significantly among individual users, institutions,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Roman Stoklasa

Both functional and structural magnetic resonance imaging (fMRI and sMRI) are widely used for the diagnosis of mental disorder. However, combining complementary information from these two modalities is challenging due to their…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyu Zhou , Anton Orlichenko , Gang Qu , Zening Fu , Vince D Calhoun , Zhengming Ding , Yu-Ping Wang

Vision Transformers (ViTs) have successfully been applied to image classification problems where large annotated datasets are available. On the other hand, when fewer annotations are available, such as in biomedical applications, image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Felipe A. Quezada , Carlos F. Navarro , Cristian Muñoz , Manuel Zamorano , Jorge Jara-Wilde , Violeta Chang , Cristóbal A. Navarro , Mauricio Cerda

While attention-based approaches have shown considerable progress in enhancing image fusion and addressing the challenges posed by long-range feature dependencies, their efficacy in capturing local features is compromised by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Jingjing Liu , Li Zhang , Xiaoyang Zeng , Wanquan Liu , Jianhua Zhang

Magnetic resonance imaging (MRI) offers superb-quality images, but its accessibility is limited by high costs, posing challenges for patients requiring longitudinal care. Low-field MRI provides affordable imaging with low-cost devices but…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Tal Oved , Beatrice Lena , Chloé F. Najac , Sheng Shen , Matthew S. Rosen , Andrew Webb , Efrat Shimron

Multimodal medical image fusion facilitates comprehensive diagnosis by aggregating complementary structural and functional information, but its effectiveness is limited by resolution degradation and modality discrepancies. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Fayaz Ali Dharejo , Sharif S. M. A. , Aiman Khalil , Nachiket Chaudhary , Rizwan Ali Naqvi , Radu Timofte

The recent integration of artificial intelligence into medical imaging has driven remarkable advances in automated organ segmentation. However, most existing 3D segmentation frameworks rely exclusively on visual learning from large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hasan Faraz Khan , Noor Fatima , Muzammil Behzad

Multi-modal fusion methods often suffer from two types of representation collapse: feature collapse where individual dimensions lose their discriminative power (as measured by eigenspectra), and modality collapse where one dominant modality…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Seulgi Kim , Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

Identifying robust and accurate correspondences across images is a fundamental problem in computer vision that enables various downstream tasks. Recent semi-dense matching methods emphasize the effectiveness of fusing relevant cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hongkai Chen , Zixin Luo , Yurun Tian , Xuyang Bai , Ziyu Wang , Lei Zhou , Mingmin Zhen , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Deep learning models have emerged as a powerful tool for various medical applications. However, their success depends on large, high-quality datasets that are challenging to obtain due to privacy concerns and costly annotation. Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Milad Yazdani , Yasamin Medghalchi , Pooria Ashrafian , Ilker Hacihaliloglu , Dena Shahriari

Visible and infrared image fusion (VIF) is an important multimedia task in computer vision. Most VIF methods focus primarily on optimizing fused image quality. Recent studies have begun incorporating downstream tasks, such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 He Li , Xinyu Liu , Weihang Kong , Xingchen Zhang

There is a key problem in the medical visual question answering task that how to effectively realize the feature fusion of language and medical images with limited datasets. In order to better utilize multi-scale information of medical…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Shanshan Song , Jiangyun Li , Jing Wang , Yuanxiu Cai , Wenkai Dong

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

In this paper we propose a very efficient method to fuse the unregistered multi-focus microscopical images based on the speed-up robust features (SURF). Our method follows the pipeline of first registration and then fusion. However, instead…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Yixiong Liang , Yuan Mao , Zhihong Tang , Meng Yan , Yuqian Zhao , Jianfeng Liu

Multi-parametric magnetic resonance (MR) imaging is an indispensable tool in the clinic. Consequently, automatic volume-of-interest segmentation based on multi-parametric MR imaging is crucial for computer-aided disease diagnosis, treatment…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Cheng Li , Yousuf Babiker M. Osman , Weijian Huang , Zhenzhen Xue , Hua Han , Hairong Zheng , Shanshan Wang