English
Related papers

Related papers: ProtoMedX: Towards Explainable Multi-Modal Prototy…

200 papers

Substantial advances in multi-modal Artificial Intelligence (AI) facilitate the combination of diverse medical modalities to achieve holistic health assessments. We present COMPRER , a novel multi-modal, multi-objective pretraining…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Guy Lutsker , Hagai Rossman , Nastya Godiva , Eran Segal

The adoption of Deep Learning algorithms in the medical imaging field is a prominent area of research, with high potential for advancing AI-based Computer-aided diagnosis (AI-CAD) solutions. However, current solutions face challenges due to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Iury B. de A. Santos , André C. P. L. F. de Carvalho

Stroke is a major public health problem, affecting millions worldwide. Deep learning has recently demonstrated promise for enhancing the diagnosis and risk prediction of stroke. However, existing methods rely on costly medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2025-12-17 Saeed Shurrab , Aadim Nepal , Terrence J. Lee-St. John , Nicola G. Ghazi , Bartlomiej Piechowski-Jozwiak , Farah E. Shamout

The rapid emergence of highly adaptable and reusable artificial intelligence (AI) models is set to revolutionize the medical field, particularly in the diagnosis and management of Parkinson's disease (PD). Currently, there are no effective…

Machine Learning · Computer Science 2025-02-18 Aite Zhao , Yongcan Liu , Xinglin Yu , Xinyue Xing

Knee Osteoarthritis (KOA) is a highly prevalent chronic musculoskeletal condition with no currently available treatment. The manifestation of KOA is heterogeneous and prediction of its progression is challenging. Current literature suggests…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Egor Panfilov , Simo Saarakkala , Miika T. Nieminen , Aleksei Tiulpin

In this chapter we explore and evaluate methods for trabecular bone characterization and osteoporosis diagnosis with increased interest in sparse approximations. We first describe texture representation and classification techniques,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Sokratis Makrogiannis , Keni Zheng

Content-based medical image retrieval is an important diagnostic tool that improves the explainability of computer-aided diagnosis systems and provides decision making support to healthcare professionals. Medical imaging data, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yunyan Xing , Benjamin J. Meyer , Mehrtash Harandi , Tom Drummond , Zongyuan Ge

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise, they require specialized equipment, limiting their use in broader clinical settings. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Volodymyr Sydorskyi , Igor Krashenyi , Oleksii Yakubenko

Large vision-language models (VLMs) have evolved from general-purpose applications to specialized use cases such as in the clinical domain, demonstrating potential for decision support in radiology. One promising application is assisting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Zhifan Jiang , Dong Yang , Vishwesh Nath , Abhijeet Parida , Nishad P. Kulkarni , Ziyue Xu , Daguang Xu , Syed Muhammad Anwar , Holger R. Roth , Marius George Linguraru

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

Retinal disease diagnosis is critical in preventing vision loss and reducing socioeconomic burdens. Globally, over 2.2 billion people are affected by some form of vision impairment, resulting in annual productivity losses estimated at $411…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Youssef Sabiri , Walid Houmaidi , Amine Abouaomar

Tracking body fat percentage is essential for effective weight management, yet gold-standard methods such as DEXA scans remain expensive and inaccessible for most people. This study evaluates the feasibility of artificial intelligence (AI)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Rayan Aldajani

Recent advancements in general-purpose or domain-specific multimodal large language models (LLMs) have witnessed remarkable progress for medical decision-making. However, they are designated for specific classification or generative tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Songtao Jiang , Tuo Zheng , Yan Zhang , Yeying Jin , Li Yuan , Zuozhu Liu

Colorectal cancer (CRC) ranks as the second leading cause of cancer-related deaths and the third most prevalent malignant tumour worldwide. Early detection of CRC remains problematic due to its non-specific and often embarrassing symptoms,…

Machine Learning · Computer Science 2025-04-25 Natalia Sikora , Robert L. Manschke , Alethea M. Tang , Peter Dunstan , Dean A. Harris , Su Yang

Computer-aided diagnosis for medical imaging is a well-studied field that aims to provide real-time decision support systems for physicians. These systems attempt to detect and diagnose a plethora of medical conditions across a variety of…

Artificial Intelligence · Computer Science 2022-05-25 Glen Smith , Qiao Zhang , Christopher MacLellan

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

Machine Learning · Computer Science 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging. Although dual-energy X-ray absorptiometry (DXA) and computed tomography (CT) can be used to evaluate musculoskeletal conditions,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Yi Gu , Yoshito Otake , Keisuke Uemura , Masaki Takao , Mazen Soufi , Yuta Hiasa , Hugues Talbot , Seiji Okata , Nobuhiko Sugano , Yoshinobu Sato