English
Related papers

Related papers: Explaining Chest X-ray Pathology Models using Text…

200 papers

Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However,…

Artificial Intelligence · Computer Science 2024-04-01 Seil Kang , Donghyun Kim , Junhyeok Kim , Hyo Kyung Lee , Seong Jae Hwang

Amid the coronavirus disease(COVID-19) pandemic, humanity experiences a rapid increase in infection numbers across the world. Challenge hospitals are faced with, in the fight against the virus, is the effective screening of incoming…

Image and Video Processing · Electrical Eng. & Systems 2020-06-09 Md. Rezaul Karim , Till Döhmen , Dietrich Rebholz-Schuhmann , Stefan Decker , Michael Cochez , Oya Beyan

Vision-language models (VLMs) are increasingly proposed for clinical decision support, yet their reliability in real-world scenarios that require integrating both visual and textual context from medical records remains poorly characterized.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 David Restrepo , Ira Ktena , Maria Vakalopoulou , Stergios Christodoulidis , Enzo Ferrante

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

Natural language explanations provide an inherently human-understandable way to explain black-box models, closely reflecting how radiologists convey their diagnoses in textual reports. Most works explicitly supervise the explanation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Isabel Rio-Torto , Jaime S. Cardoso , Luís F. Teixeira

Since the emergence of COVID-19, deep learning models have been developed to identify COVID-19 from chest X-rays. With little to no direct access to hospital data, the AI community relies heavily on public data comprising numerous data…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Rachael Harkness , Geoff Hall , Alejandro F Frangi , Nishant Ravikumar , Kieran Zucker

Over the last few years, convolutional neural networks (CNNs) have dominated the field of computer vision thanks to their ability to extract features and their outstanding performance in classification problems, for example in the automatic…

Image and Video Processing · Electrical Eng. & Systems 2022-08-01 Helena Liz , Javier Huertas-Tato , Manuel Sánchez-Montañés , Javier Del Ser , David Camacho

Recently, vision-language pre-trained models have emerged in computational pathology. Previous works generally focused on the alignment of image-text pairs via the contrastive pre-training paradigm. Such pre-trained models have been applied…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Anh Tien Nguyen , Trinh Thi Le Vuong , Jin Tae Kwak

Radiologists highly desire fully automated versatile AI for medical imaging interpretation. However, the lack of extensively annotated large-scale multi-disease datasets has hindered the achievement of this goal. In this paper, we explore…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Weiwei Cao , Jianpeng Zhang , Yingda Xia , Tony C. W. Mok , Zi Li , Xianghua Ye , Le Lu , Jian Zheng , Yuxing Tang , Ling Zhang

The COVID-19 pandemic has been having a severe and catastrophic effect on humankind and is being considered the most crucial health calamity of the century. One of the best methods of detecting COVID-19 is from radiological images, namely…

Image and Video Processing · Electrical Eng. & Systems 2020-10-15 Arjun Sarkar , Joerg Vandenhirtz , Jozsef Nagy , David Bacsa , Mitchell Riley

Medical imaging analysis plays a critical role in the diagnosis and treatment of various medical conditions. This paper focuses on chest X-ray images and their corresponding radiological reports. It presents a new model that learns a joint…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Gefen Dawidowicz , Elad Hirsch , Ayellet Tal

Purpose: Interpreting chest radiographs (CXR) remains challenging due to the ambiguity of overlapping structures such as the lungs, heart, and bones. To address this issue, we propose a novel method for extracting fine-grained anatomical…

Image and Video Processing · Electrical Eng. & Systems 2023-06-08 Constantin Seibold , Alexander Jaus , Matthias A. Fink , Moon Kim , Simon Reiß , Ken Herrmann , Jens Kleesiek , Rainer Stiefelhagen

The chest X-ray (CXR) is commonly employed to diagnose thoracic illnesses, but the challenge of achieving accurate automatic diagnosis through this method persists due to the complex relationship between pathology. In recent years, various…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Weizhi Nie , Chen Zhang , Dan song , Yunpeng Bai , Keliang Xie , Anan Liu

Decision support tools that rely on supervised learning require large amounts of expert annotations. Using past radiological reports obtained from hospital archiving systems has many advantages as training data above manual single-class…

Machine Learning · Computer Science 2021-05-21 Aydan Gasimova

While echocardiography and MRI are clinical standards for evaluating cardiac structure, their use is limited by cost and accessibility.We introduce a direct classification framework that predicts severe left ventricular hypertrophy from…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Basudha Pal , Rama Chellappa , Muhammad Umair

Vision-language pretraining has advanced image-text alignment, yet progress in radiology remains constrained by the heterogeneity of clinical reports, including abbreviations, impression-only notes, and stylistic variability. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hanbin Ko , Gihun Cho , Inhyeok Baek , Donguk Kim , Joonbeom Koo , Changi Kim , Dongheon Lee , Chang Min Park

Medical image analysis using computer-based algorithms has attracted considerable attention from the research community and achieved tremendous progress in the last decade. With recent advances in computing resources and availability of…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Huyen Tran , Duc Thanh Nguyen , John Yearwood

A major obstacle to the integration of deep learning models for chest x-ray interpretation into clinical settings is the lack of understanding of their failure modes. In this work, we first investigate whether there are patient subgroups…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Emma Chen , Andy Kim , Rayan Krishnan , Jin Long , Andrew Y. Ng , Pranav Rajpurkar

Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Shengchao Chen , Sufen Ren , Guanjun Wang , Mengxing Huang , Chenyang Xue

Modern diagnostic workflows are increasingly multimodal, integrating diverse data sources such as medical images, structured records, and physiological time series. Among these, electrocardiograms (ECGs) and chest X-rays (CXRs) are two of…

Machine Learning · Computer Science 2025-06-25 Vineet Punyamoorty , Aditya Malusare , Vaneet Aggarwal