English
Related papers

Related papers: Explaining Chest X-ray Pathology Models using Text…

200 papers

Explaining Deep Learning models is becoming increasingly important in the face of daily emerging multimodal models, particularly in safety-critical domains like medical imaging. However, the lack of detailed investigations into the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Anees Ur Rehman Hashmi , Dwarikanath Mahapatra , Mohammad Yaqub

Deep learning models for chest X-ray diagnosis are constrained by limited coverage of clinically meaningful concept combinations in publicly available training datasets. While synthetic image generation has been explored to increase data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

Cardiac Magnetic Resonance (CMR) is the most effective tool for the assessment and diagnosis of a heart condition, which malfunction is the world's leading cause of death. Software tools leveraging Artificial Intelligence already enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Adrianna Janik , Jonathan Dodd , Georgiana Ifrim , Kris Sankaran , Kathleen Curran

The global demand for radiologists is increasing rapidly due to a growing reliance on medical imaging services, while the supply of radiologists is not keeping pace. Advances in computer vision and image processing technologies present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Shehroz S. Khan , Petar Przulj , Ahmed Ashraf , Ali Abedi

Vision-and-language(V&L) models take image and text as input and learn to capture the associations between them. Prior studies show that pre-trained V&L models can significantly improve the model performance for downstream tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Masoud Monajatipoor , Mozhdeh Rouhsedaghat , Liunian Harold Li , Aichi Chien , C. -C. Jay Kuo , Fabien Scalzo , Kai-Wei Chang

Timely and rapid diagnoses are core to informing on optimum interventions that curb the spread of COVID-19. The use of medical images such as chest X-rays and CTs has been advocated to supplement the Reverse-Transcription Polymerase Chain…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Ogechukwu Ukwandu , Hanan Hindy , Elochukwu Ukwandu

Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Keegan Quigley , Miriam Cha , Ruizhi Liao , Geeticka Chauhan , Steven Horng , Seth Berkowitz , Polina Golland

Accurate analysis of pathological images is essential for automated tumor diagnosis but remains challenging due to high structural similarity and subtle morphological variations in tissue images. Current vision-language (VL) models often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yating Huang , Ziyan Huang , Lintao Xiang , Qijun Yang , Hujun Yin

Classifying chest radiographs is a time-consuming and challenging task, even for experienced radiologists. This provides an area for improvement due to the difficulty in precisely distinguishing between conditions such as pleural effusion,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Maria Efimovich , Jayden Lim , Vedant Mehta , Ethan Poon

To increase the transparency of modern computer-aided diagnosis (CAD) systems for assessing the malignancy of lung nodules, an interpretable model based on applying the generalized additive models and the concept-based learning is proposed.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Rinat I. Dumaev , Sergei A. Molodyakov , Lev V. Utkin

Explainability methods for NLP systems encounter a version of the fundamental problem of causal inference: for a given ground-truth input text, we never truly observe the counterfactual texts necessary for isolating the causal effects of…

Computation and Language · Computer Science 2022-09-29 Zhengxuan Wu , Karel D'Oosterlinck , Atticus Geiger , Amir Zur , Christopher Potts

Vision-language foundation models (VLMs) have shown impressive performance in guiding image generation through text, with emerging applications in medical imaging. In this work, we are the first to investigate the question: 'Can fine-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Amar Kumar , Anita Kriz , Barak Pertzov , Tal Arbel

This work aligns deep learning (DL) with human reasoning capabilities and needs to enable more efficient, interpretable, and robust image classification. We approach this from three perspectives: explainability, causality, and biological…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Gianluca Carloni

The global challenge in chest radiograph X-ray (CXR) abnormalities often being misdiagnosed is primarily associated with perceptual errors, where healthcare providers struggle to accurately identify the location of abnormalities, rather…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Sanskriti Singh

Medical vision language pre-training (VLP) has emerged as a frontier of research, enabling zero-shot pathological recognition by comparing the query image with the textual descriptions for each disease. Due to the complex semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Vu Minh Hieu Phan , Yutong Xie , Yuankai Qi , Lingqiao Liu , Liyang Liu , Bowen Zhang , Zhibin Liao , Qi Wu , Minh-Son To , Johan W. Verjans

Recent progress in Large Vision-Language Models (LVLMs) has enabled promising applications in medical tasks, such as report generation and visual question answering. However, existing benchmarks focus mainly on the final diagnostic answer,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hyungyung Lee , Geon Choi , Jung-Oh Lee , Hangyul Yoon , Hyuk Gi Hong , Edward Choi

Background and Objective: Artificial intelligence (AI) methods coupled with biomedical analysis has a critical role during pandemics as it helps to release the overwhelming pressure from healthcare systems and physicians. As the ongoing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Aman Swaraj , Karan Verma

Deep neural networks and other intricate Artificial Intelligence (AI) models have reached high levels of accuracy on many biomedical natural language processing tasks. However, their applicability in real-world use cases may be limited due…

Artificial Intelligence · Computer Science 2020-10-22 Milad Moradi , Matthias Samwald

Self-supervised learning (SSL) is potentially useful in reducing the need for manual annotation and making deep learning models accessible for medical image analysis tasks. By leveraging the representations learned from unlabeled data,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Azad Singh , Vandan Gorade , Deepak Mishra

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves