English
Related papers

Related papers: A Discordance-Aware Multimodal Framework with Mult…

200 papers

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

The application of machine learning in medicine and healthcare has led to the creation of numerous diagnostic and prognostic models. However, despite their success, current approaches generally issue predictions using data from a single…

Machine Learning · Computer Science 2025-05-13 Fergus Imrie , Stefan Denner , Lucas S. Brunschwig , Klaus Maier-Hein , Mihaela van der Schaar

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li

Alzheimer's disease (AD) progression follows a complex continuum from normal cognition (NC) through mild cognitive impairment (MCI) to dementia, yet most deep learning approaches oversimplify this into discrete classification tasks. This…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Yufeng Jiang , Hexiao Ding , Hongzhao Chen , Jing Lan , Xinzhi Teng , Gerald W. Y. Cheng , Zongxi Li , Haoran Xie , Jung Sun Yoo , Jing Cai

Automatic segmentation of diverse heterogeneous brain lesions using multi-modal MRI is a challenging problem in clinical neuroimaging, mainly because of the lack of generalizability and high prediction variance of pathology-specific deep…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Md. Mehedi Hassan , Shafqat Alam , Shahriar Ahmed Seam , Maruf Ahmed

Magnetic Resonance Imaging (MRI) provides detailed structural information, while functional MRI (fMRI) captures temporal brain activity. In this work, we present a multimodal deep learning framework that integrates MRI and fMRI for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Anima Kujur , Zahra Monfared

Knee osteoarthritis (OA) is a widespread chronic condition that impairs mobility and diminishes quality of life. Despite the proven benefits of exercise therapy and patient education in managing the OA symptoms pain and functional…

Machine Learning · Computer Science 2024-10-17 M. Rafiei , S. Das , M. Bakhtiari , E. M. Roos , S. T. Skou , D. T. Grønne , J. Baumbach , L. Baumbach

Machine Learning (ML) has recently been demonstrated to rival expert-level human accuracy in prediction and detection tasks in a variety of domains, including medicine. Despite these impressive findings, however, a key barrier to the full…

Artificial Intelligence · Computer Science 2021-07-01 D. Fompeyrine , E. S. Vorm , N. Ricka , F. Rose , G. Pellegrin

Computer-aided diagnosis (CAD) is becoming a prominent approach to assist clinicians spanning across multiple fields. These automated systems take advantage of various computer vision (CV) procedures, as well as artificial intelligence (AI)…

Image and Video Processing · Electrical Eng. & Systems 2021-10-26 Danilo Avola , Luigi Cinque , Alessio Fagioli , Sebastiano Filetti , Giorgio Grani , Emanuele Rodolà

Noisy data and the similarity in the ocular appearances caused by different ophthalmic pathologies pose significant challenges for an automated expert system to accurately detect retinal diseases. In addition, the lack of knowledge…

Image and Video Processing · Electrical Eng. & Systems 2021-10-20 Sharif Amit Kamran , Alireza Tavakkoli , Stewart Lee Zuckerbrod

Medical records often consist of different modalities, such as images, text, and tabular information. Integrating all modalities offers a holistic view of a patient's condition, while analyzing them longitudinally provides a better…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Boqi Chen , Junier Oliva , Marc Niethammer

The automatic segmentation of human knee cartilage from 3D MR images is a useful yet challenging task due to the thin sheet structure of the cartilage with diffuse boundaries and inhomogeneous intensities. In this paper, we present an…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Quan Wang , Dijia Wu , Le Lu , Meizhu Liu , Kim L. Boyer , Shaohua Kevin Zhou

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

The ability to predict the future trajectory of a patient is a key step toward the development of therapeutics for complex diseases such as Alzheimer's disease (AD). However, most machine learning approaches developed for prediction of…

This paper introduces a lightweight uncertainty estimator capable of predicting multimodal (disjoint) uncertainty bounds by integrating conformal prediction with a deep-learning regressor. We specifically discuss its application for visual…

Machine Learning · Computer Science 2023-09-21 Domenico Parente , Nastaran Darabi , Alex C. Stutts , Theja Tulabandhula , Amit Ranjan Trivedi

Magnetic resonance imaging (MRI), especially functional MRI (fMRI) and diffusion MRI (dMRI), is essential for studying neurodegenerative diseases. However, missing modalities pose a major barrier to their clinical use. Although GAN- and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Xiongri Shen , Jiaqi Wang , Yi Zhong , Zhenxi Song , Leilei Zhao , Yichen Wei , Lingyan Liang , Shuqiang Wang , Baiying Lei , Demao Deng , Zhiguo Zhang

The automation of the medical evidence acquisition and diagnosis process has recently attracted increasing attention in order to reduce the workload of doctors and democratize access to medical care. However, most works proposed in the…

Computation and Language · Computer Science 2022-10-14 Arsene Fansi Tchango , Rishab Goel , Julien Martel , Zhi Wen , Gaetan Marceau Caron , Joumana Ghosn

Biomarker discovery in neurodegenerative diseases requires robust, interpretable frameworks capable of integrating high-dimensional multi-omics data under low-sample conditions. We propose a novel ensemble approach combining Graph Attention…

Image and Video Processing · Electrical Eng. & Systems 2025-09-16 Byeonghee Lee , Joonsung Kang

Deep learning based automated pathological diagnosis has markedly improved diagnostic efficiency and reduced variability between observers, yet its clinical adoption remains limited by opaque model decisions and a lack of traceable…

Recent progress in multimodal reasoning has enabled agents that interpret imagery, connect it with language, and execute structured analytical tasks. Extending these capabilities to remote sensing remains challenging, as models must reason…