English
Related papers

Related papers: ProtoMedX: Towards Explainable Multi-Modal Prototy…

200 papers

Cancer cachexia is a multifactorial syndrome characterized by progressive muscle wasting, metabolic dysfunction, and systemic inflammation, leading to reduced quality of life and increased mortality. Despite extensive research, no single…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Sabeen Ahmed , Nathan Parker , Margaret Park , Evan W. Davis , Jennifer B. Permuth , Matthew B. Schabath , Yasin Yilmaz , Ghulam Rasool

Postoperative delirium (POD), a severe neuropsychiatric complication affecting nearly 50% of high-risk surgical patients, is defined as an acute disorder of attention and cognition, It remains significantly underdiagnosed in the intensive…

Machine Learning · Computer Science 2025-05-14 Bingxu Wang , Min Ge , Kunzhi Cai , Yuqi Zhang , Zeyi Zhou , Wenjiao Li , Yachong Guo , Wei Wang , Qing Zhou

Cell counting in biomedical imaging is pivotal for various clinical applications, yet the interpretability of deep learning models in this domain remains a significant challenge. We propose a novel prototype-based method for interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Abdurahman Ali Mohammed , Wallapak Tavanapong , Catherine Fonder , Donald S. Sakaguchi

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Ultrasound imaging is widely used in clinical practice due to its cost-effectiveness, mobility, and safety. However, current AI research often treats disease prediction and tissue segmentation as two separate tasks and their model requires…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Zhi Chen , Le Zhang

Utilizing potent representations of the large vision-language models (VLMs) to accomplish various downstream tasks has attracted increasing attention. Within this research field, soft prompt learning has become a representative approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yequan Bie , Luyang Luo , Zhixuan Chen , Hao Chen

Decision-making processes in healthcare can be highly complex and challenging. Machine Learning tools offer significant potential to assist in these processes. However, many current methodologies rely on complex models that are not easily…

Artificial Intelligence · Computer Science 2025-03-24 Alessio Cascione , Mattia Setzu , Federico A. Galatolo , Mario G. C. A. Cimino , Riccardo Guidotti

Remarkable success of modern image-based AI methods and the resulting interest in their applications in critical decision-making processes has led to a surge in efforts to make such intelligent systems transparent and explainable. The need…

Artificial Intelligence · Computer Science 2020-11-30 Adriano Lucieri , Muhammad Naseer Bajwa , Andreas Dengel , Sheraz Ahmed

Deep learning has driven significant advances in medical image analysis, yet its adoption in clinical practice remains constrained by the large size and lack of transparency in modern models. Advances in interpretability techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Nikita Malik , Pratinav Seth , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

We introduce MATEX (Multi-scale Attention and Text-guided Explainability), a novel framework that advances interpretability in medical vision-language models by incorporating anatomically informed spatial reasoning. MATEX synergistically…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Chi Lee , Yugyung Lee

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions. Conventional explanation methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Zihao Jin , Xiaodan Xing , Simon Walsh , Guang Yang

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne

Limited expert time is a key bottleneck in medical imaging. Due to advances in image classification, AI can now serve as decision-support for medical experts, with the potential for great gains in radiologist productivity and, by extension,…

Machine Learning · Computer Science 2021-06-10 Tomas Folke , Scott Cheng-Hsin Yang , Sean Anderson , Patrick Shafto

Osteoporosis is a skeletal disease typically diagnosed using dual-energy X-ray absorptiometry (DXA), which quantifies areal bone mineral density but overlooks bone microarchitecture and surrounding soft tissues. High-resolution peripheral…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Mohseu Rashid Subah , Mohammed Abdul Gani Zilani , Thomas L. Nickolas , Matthew R. Allen , Stuart J. Warden , Rachel K. Surowiec

Prompt-based medical image segmentation has rapidly emerged, yet existing methods rely on explicit prompts like bounding boxes and struggle to reason about the spatial relationships essential for clinical diagnosis. While general-domain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Quoc-Huy Trinh , Minh-Van Nguyen , Jun Zeng , Debesh Jha , Ulas Bagci

Understanding protein solubility is essential for their functional applications. Computational methods for predicting protein solubility are crucial for reducing experimental costs and enhancing the efficiency and success rates of protein…

Quantitative Methods · Quantitative Biology 2024-07-01 Yang Tan , Jia Zheng , Liang Hong , Bingxin Zhou

Mapping computed tomography (CT) number to material property dominates the proton range uncertainty. This work aims to develop a physics-constrained deep learning-based multimodal imaging (PDMI) framework to integrate physics, deep…

Deep models are the defacto standard in visual decision problems due to their impressive performance on a wide array of visual tasks. On the other hand, their opaqueness has led to a surge of interest in explainable systems. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of…

Machine Learning · Computer Science 2024-01-23 Elisa Warner , Joonsang Lee , William Hsu , Tanveer Syeda-Mahmood , Charles Kahn , Olivier Gevaert , Arvind Rao