English
Related papers

Related papers: ProtoMedX: Towards Explainable Multi-Modal Prototy…

200 papers

Computer-aided diagnosis (CAD) is today considered a vital tool in the field of biological image categorization, segmentation, and other related tasks. The current breakthrough in computer vision algorithms and deep learning approaches has…

Image and Video Processing · Electrical Eng. & Systems 2024-10-22 Sayeda Sanzida Ferdous Ruhi , Fokrun Nahar , Adnan Ferdous Ashrafi

Retinal diseases spanning a broad spectrum can be effectively identified and diagnosed using complementary signals from multimodal data. However, multimodal diagnosis in ophthalmic practice is typically challenged in terms of data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Lu Zhang , Huizhen Yu , Zuowei Wang , Fu Gui , Yatu Guo , Wei Zhang , Mengyu Jia

In the U.S, 5-10\% of new pediatric cases of cancer are primary bone tumors. The most common type of primary malignant bone tumor is osteosarcoma. The intention of the present work is to improve the detection and diagnosis of osteosarcoma…

Image and Video Processing · Electrical Eng. & Systems 2022-12-06 D M Anisuzzaman , Hosein Barzekar , Ling Tong , Jake Luo , Zeyun Yu

Multimodal learning has witnessed remarkable advancements in recent years, particularly with the integration of attention-based models, leading to significant performance gains across a variety of tasks. Parallel to this progress, the…

Machine Learning · Computer Science 2026-04-28 Md Raisul Kibria , Sébastien Lafond , Janan Arslan

XAI gained considerable importance in recent years. Methods based on prototypical case-based reasoning have shown a promising improvement in explainability. However, these methods typically rely on additional post-hoc saliency techniques to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Steffen Meinert , Philipp Schlinge , Nils Strodthoff , Martin Atzmueller

Medical reasoning models remain constrained by parametric knowledge and are thus susceptible to forgetting and hallucinations. DeepResearch (DR) models ground outputs in verifiable evidence from tools and perform strongly in general…

Artificial Intelligence · Computer Science 2026-02-05 Zihan Wang , Hao Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yiqun Zhang , Jinghao Lin , Haihua Yang , Xiaozhong Ji

Thyroid nodule classification using ultrasound imaging is essential for early diagnosis and clinical decision-making; however, despite promising performance on in-distribution data, existing deep learning methods often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yangmei Chen , Zhongyuan Zhang , Xikun Zhang , Xinyu Hao , Mingliang Hou , Renqiang Luo , Ziqi Xu

Predictive modelling is important for health data analysis and data-driven clinical decision-making. However, predictive studies are challenging to design optimally by hand when tens or even hundreds of features require selection,…

Deep learning models in medical imaging typically operate as parametric memory, diagnosing patients by recalling fixed knowledge learned during training. This contrasts sharply with clinical practice, where physicians employ analogical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lujia Zhong , Yihao Xia , Shuo Huang , Jianwei Zhang , Yonggang Shi

Diagnosing and treating skin diseases require advanced visual skills across domains and the ability to synthesize information from multiple imaging modalities. While current deep learning models excel at specific tasks like skin cancer…

Significant investment and development have gone into integrating Artificial Intelligence (AI) in medical and healthcare applications, leading to advanced control systems in medical technology. However, the opacity of AI systems raises…

Artificial Intelligence · Computer Science 2024-10-21 Francesco Sovrano , Michael Lognoul , Giulia Vilone

Pre-biopsy magnetic resonance imaging (MRI) is increasingly used to target suspicious prostate lesions. This has led to artificial intelligence (AI) applications improving MRI-based detection of clinically significant prostate cancer…

Image and Video Processing · Electrical Eng. & Systems 2025-02-04 Hassan Jahanandish , Shengtian Sang , Cynthia Xinran Li , Sulaiman Vesal , Indrani Bhattacharya , Jeong Hoon Lee , Richard Fan , Geoffrey A. Sonna , Mirabela Rusu

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

Advancements in high-throughput technologies have led to a shift from traditional hypothesis-driven methodologies to data-driven approaches. Multi-omics refers to the integrative analysis of data derived from multiple 'omes', such as…

Genomics · Quantitative Biology 2024-10-17 Ahmad Hussein , Mukesh Prasad , Ali Braytee

While imaging-genetics holds great promise for unraveling the complex interplay between brain structure and genetic variation in neurological disorders, traditional methods are limited to simplistic linear models or to black-box techniques…

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kexin Yu , Zihan Xu , Jialei Xie , Carter Adams

A key issue in critical contexts such as medical diagnosis is the interpretability of the deep learning models adopted in decision-making systems. Research in eXplainable Artificial Intelligence (XAI) is trying to solve this issue. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Carlo Metta , Andrea Beretta , Riccardo Guidotti , Yuan Yin , Patrick Gallinari , Salvatore Rinzivillo , Fosca Giannotti

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Alzheimer's disease (AD) diagnosis requires integrating neuroimaging with heterogeneous clinical evidence and reasoning under established criteria, yet most multimodal models remain opaque and weakly guideline-aligned. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Qiuhui Chen , Yushan Deng , Xuancheng Yao , Yi Hong