English
Related papers

Related papers: AliFuse: Aligning and Fusing Multi-modal Medical D…

200 papers

Early diagnosis of Alzheimer's Disease (AD) is crucial for delaying its progression. While AI-based speech detection is non-invasive and cost-effective, it faces a critical data efficiency dilemma due to medical data scarcity and privacy…

Computation and Language · Computer Science 2026-02-17 Xiao Wei , Bin Wen , Yuqin Lin , Kai Li , Mingyang gu , Xiaobao Wang , Longbiao Wang , Jianwu Dang

Removing the bias and variance of multicentre data has always been a challenge in large scale digital healthcare studies, which requires the ability to integrate clinical features extracted from data acquired by different scanners and…

This research work introduces a novel approach to the classification of Alzheimer's disease by using the advanced deep learning techniques combined with secure data processing methods. This research work primary uses transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Rishit Kapoor , Jesher Joshua , Muralidharan Vijayarangan , Natarajan B

Alzheimer's disease (AD) is a common neurodegenerative disease among the elderly. Early prediction and timely intervention of its prodromal stage, mild cognitive impairment (MCI), can decrease the risk of advancing to AD. Combining…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Xiangyang Hu , Xiangyu Shen , Yifei Sun , Xuhao Shan , Wenwen Min , Liyilei Su , Xiaomao Fan , Ahmed Elazab , Ruiquan Ge , Changmiao Wang , Xiaopeng Fan

Biomedical data is inherently multimodal, consisting of electronic health records, medical imaging, digital pathology, genome sequencing, wearable sensors, and more. The application of artificial intelligence tools to these multifaceted…

Machine Learning · Computer Science 2024-08-26 Shentong Mo , Paul Pu Liang

Multimodal data fusion is a key approach for enhancing diagnosis in medical applications. We propose an asymmetric fusion strategy starting from a primary modality and integrating secondary modalities by disentangling shared and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Jérémie Stym-Popper , Nathan Painchaud , Clément Rambour , Pierre-Yves Courand , Nicolas Thome , Olivier Bernard

Artificial intelligence (AI)-enabled diagnostics in maxillofacial pathology require structured, high-quality multimodal datasets. However, existing resources provide limited ameloblastoma coverage and lack the format consistency needed for…

Artificial Intelligence · Computer Science 2026-02-06 Ajo Babu George , Anna Mariam John , Athul Anoop , Balu Bhasuran

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Ensemble learning use multiple algorithms to obtain better predictive performance than any single one of its constituent algorithms could. With growing popularity of deep learning, researchers have started to ensemble them for various…

Machine Learning · Computer Science 2019-05-31 Ning An , Huitong Ding , Jiaoyun Yang , Rhoda Au , Ting Fang Alvin Ang

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

Artificial Intelligence · Computer Science 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal regions and infrared images is a unprecedented challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Tao Ye , Xiaoqi Cheng , Wuyang Liu , Haishu Tan

With the proliferation of multi-modal data in large-scale visual recognition systems, enabling models to continuously acquire knowledge from evolving data streams while preserving prior information has become increasingly critical.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Juncen Guo , Siao Liu , Xiaoguang Zhu , Lianlong Sun , Liangyu Teng , Jingyi Wu , Di Li , Linxiao Gong , Weiwei Jiang , Wei Zhou , Liang Song

Multi-modal medical image fusion is traditionally optimized for human visual perception, aiming to maximize generic contrast and structural fidelity. However, when these visually pleasing fused images are deployed in automated clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

A fundamental challenge in federated learning lies in mixing heterogeneous datasets and classification tasks while minimizing the high communication cost caused by clients as well as the exchange of weight updates with the server over a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Atefe Hassani , Islem Rekik

The core role of medical images in disease diagnosis makes their quality directly affect the accuracy of clinical judgment. However, due to factors such as low-dose scanning, equipment limitations and imaging artifacts, medical images are…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Tao Tang , Chengxu Yang

In clinical practice, tri-modal medical image fusion, compared to the existing dual-modal technique, can provide a more comprehensive view of the lesions, aiding physicians in evaluating the disease's shape, location, and biological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yushen Xu , Xiaosong Li , Yuchan Jie , Haishu Tan

A lot of deep learning (DL) research these days is mainly focused on improving quantitative metrics regardless of other factors. In human-centered applications, like skin lesion classification in dermatology, DL-driven clinical decision…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Theodor Cheslerean-Boghiu , Melia-Evelina Fleischmann , Theresa Willem , Tobias Lasser

Multimodal medical imaging provides complementary information that is crucial for accurate delineation of pathology, but the development of deep learning models is limited by the scarcity of large datasets in which different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arunkumar V , Firos V M , Senthilkumar S , Gangadharan G R