English
Related papers

Related papers: Aligning Human Knowledge with Visual Concepts Towa…

200 papers

In recent years, Artificial Intelligence (AI) has proven its relevance for medical decision support. However, the "black-box" nature of successful AI algorithms still holds back their wide-spread deployment. In this paper, we describe an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Gwenolé Quellec , Hassan Al Hajj , Mathieu Lamard , Pierre-Henri Conze , Pascale Massin , Béatrice Cochener

Deep neural networks have shown potential in analyzing digitized hand-drawn signals for early diagnosis of Parkinson's disease. However, the lack of clear interpretability in existing diagnostic methods presents a challenge to clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Xuechao Wang , Sven Nomm , Junqing Huang , Kadri Medijainen , Aaro Toomela , Michael Ruzhansky

Deep models are the defacto standard in visual decision models due to their impressive performance on a wide array of visual tasks. However, they are frequently seen as opaque and are unable to explain their decisions. In contrast, humans…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

Multimodal pre-trained models, such as CLIP, are popular for zero-shot classification due to their open-vocabulary flexibility and high performance. However, vision-language models, which compute similarity scores between images and class…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mia Chiquier , Utkarsh Mall , Carl Vondrick

The recent boom of large language models (LLMs) has re-ignited the hope that artificial intelligence (AI) systems could aid medical diagnosis. Yet despite dazzling benchmark scores, LLM assistants have yet to deliver measurable improvements…

Artificial Intelligence · Computer Science 2025-07-03 Matthew JY Kang , Wenli Yang , Monica R Roberts , Byeong Ho Kang , Charles B Malpas

Deep learning for medical imaging is hampered by task-specific models that lack generalizability and prognostic capabilities, while existing 'universal' approaches suffer from simplistic conditioning and poor medical semantic understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Numan Saeed , Tausifa Jan Saleem , Fadillah Maani , Muhammad Ridzuan , Hu Wang , Mohammad Yaqub

Deep learning-based medical image analysis faces a significant barrier due to the lack of interpretability. Conventional explainable AI (XAI) techniques, such as Grad-CAM and SHAP, often highlight regions outside clinical interests. To…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuhao Zhang , Mingcheng Zhu , Zhiyao Luo

Effectively representing medical concepts and patients is important for healthcare analytical applications. Representing medical concepts for healthcare analytical tasks requires incorporating medical domain knowledge and prior information…

Machine Learning · Computer Science 2023-05-02 Shaodong Wang , Qing Li , Wenli Zhang

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

Interpretability is highly desired for deep neural network-based classifiers, especially when addressing high-stake decisions in medical imaging. Commonly used post-hoc interpretability methods have the limitation that they can produce…

Image and Video Processing · Electrical Eng. & Systems 2024-01-04 Sourya Sengupta , Mark A. Anastasio

Medical image classifiers detect gastrointestinal diseases well, but they do not explain their decisions. Large language models can generate clinical text, yet they struggle with visual reasoning and often produce unstable or incorrect…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Md. Najib Hasan , Imran Ahmad , Sourav Basak Shuvo , Md. Mahadi Hasan Ankon , Sunanda Das , Nazmul Siddique , Hui Wang

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Deep learning models have shown promise in lung pathology detection from chest X-rays, but widespread clinical adoption remains limited due to opaque model decision-making. In prior work, we introduced ClinicXAI, a human-centric,…

Artificial Intelligence · Computer Science 2026-04-17 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

To increase the transparency of modern computer-aided diagnosis (CAD) systems for assessing the malignancy of lung nodules, an interpretable model based on applying the generalized additive models and the concept-based learning is proposed.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Rinat I. Dumaev , Sergei A. Molodyakov , Lev V. Utkin

Interpretability of deep learning (DL) systems is gaining attention in medical imaging to increase experts' trust in the obtained predictions and facilitate their integration in clinical settings. We propose a deep visualization method to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Cristina González-Gonzalo , Bart Liefers , Bram van Ginneken , Clara I. Sánchez

Explainability is a highly demanded requirement for applications in high-risk areas such as medicine. Vision Transformers have mainly been limited to attention extraction to provide insight into the model's reasoning. Our approach combines…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Luisa Gallée , Catharina Silvia Lisson , Meinrad Beer , Michael Götz

An integrated approach is proposed across visual and textual data to both determine and justify a medical diagnosis by a neural network. As deep learning techniques improve, interest grows to apply them in medical applications. To enable a…

Machine Learning · Computer Science 2019-07-15 Graham Spinks , Marie-Francine Moens

This paper claims that machine learning models deployed in high stakes domains such as medicine must be interpretable, shareable, reproducible and accountable. We argue that these principles should form the foundational design criteria for…

Machine Learning · Computer Science 2025-08-25 Ayyüce Begüm Bektaş , Mithat Gönen

The clinical adoption of biomedical vision-language models is hindered by prompt optimization techniques that produce either uninterpretable latent vectors or single textual prompts. This lack of transparency and failure to capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Kaushitha Silva , Mansitha Eashwara , Sanduni Ubayasiri , Ruwan Tennakoon , Damayanthi Herath

AI in dermatology is evolving at a rapid pace but the major limitation to training trustworthy classifiers is the scarcity of data with ground-truth concept level labels, which are meta-labels semantically meaningful to humans. Foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Soham Gadgil , Mahtab Bigverdi