English
Related papers

Related papers: Multimodal Attention-Aware Fusion for Diagnosing D…

200 papers

This research presents a novel multimodal data fusion methodology for pain behavior recognition, integrating statistical correlation analysis with human-centered insights. Our approach introduces two key innovations: 1) integrating…

Artificial Intelligence · Computer Science 2025-01-22 Xingrui Gu , Zhixuan Wang , Irisa Jin , Zekun Wu

The joint interpretation of multi-modal and multi-view fundus images is critical for retinopathy prevention, as different views can show the complete 3D eyeball field and different modalities can provide complementary lesion areas. Compared…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yonghao Huang , Leiting Chen , Chuan Zhou

To improve the prediction of cancer survival using whole-slide images and transcriptomics data, it is crucial to capture both modality-shared and modality-specific information. However, multimodal frameworks often entangle these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Sanne Abeln , Wilson Silva

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Meng Zhou , Xiaolan Xu , Yuxuan Zhang

Multi-modal learning has shown exceptional performance in various tasks, especially in medical applications, where it integrates diverse medical information for comprehensive diagnostic evidence. However, there still are several challenges…

Machine Learning · Computer Science 2024-11-19 Lin Fan , Yafei Ou , Cenyang Zheng , Pengyu Dai , Tamotsu Kamishima , Masayuki Ikebe , Kenji Suzuki , Xun Gong

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

Knee osteoarthritis frequently exhibits discordance between structural damage observed in imaging and patient-reported symptoms such as pain. This mismatch complicates clinical interpretation and patient stratification and remains…

Machine Learning · Computer Science 2026-04-21 Pegah Ahadian , Mingrui Yang , Sixu Chen , Xiaojuan Li , Qiang Guan

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

A precise assessment of the risk of breast lesions can greatly lower it and assist physicians in choosing the best course of action. To categorise breast lesions, the majority of current computer-aided systems only use characteristics from…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Muhaisin Tiyumba Nantogmah , Abdul-Barik Alhassan , Salamudeen Alhassan

Accurate and early diagnosis of Alzheimer's disease (AD) is critical for effective intervention and requires integrating complementary information from multimodal neuroimaging data. However, conventional fusion approaches often rely on…

Machine Learning · Computer Science 2026-04-14 Farica Zhuang , Shu Yang , Dinara Aliyeva , Zixuan Wen , Duy Duong-Tran , Christos Davatzikos , Tianlong Chen , Song Wang , Li Shen

Respiratory diseases remain major global health challenges, and traditional auscultation is often limited by subjectivity, environmental noise, and inter-clinician variability. This study presents an explainable multimodal deep learning…

Sound · Computer Science 2025-12-02 S M Asiful Islam Saky , Md Rashidul Islam , Md Saiful Arefin , Shahaba Alam

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Accurate diagnosis of Alzheimer's disease (AD) is essential for enabling timely intervention and slowing disease progression. Multimodal diagnostic approaches offer considerable promise by integrating complementary information across…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Yujie Nie , Jianzhang Ni , Yonglong Ye , Yuan-Ting Zhang , Yun Kwok Wing , Xiangqing Xu , Xin Ma , Lizhou Fan

Alzheimer's Disease (AD) is the most common neurodegenerative disorder with one of the most complex pathogeneses, making effective and clinically actionable decision support difficult. The objective of this study was to develop a novel…

Machine Learning · Computer Science 2022-09-27 Michal Golovanevsky , Carsten Eickhoff , Ritambhara Singh

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

Grouping has been commonly used in deep metric learning for computing diverse features. However, current methods are prone to overfitting and lack interpretability. In this work, we propose an improved and interpretable grouping method to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Xinyi Xu , Zhengyang Wang , Cheng Deng , Hao Yuan , Shuiwang Ji

This study proposes a 3D semantic segmentation method for the spine based on the improved SwinUNETR to improve segmentation accuracy and robustness. Aiming at the complex anatomical structure of spinal images, this paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yanlin Xiang , Qingyuan He , Ting Xu , Ran Hao , Jiacheng Hu , Hanchao Zhang
‹ Prev 1 2 3 10 Next ›