English
Related papers

Related papers: Explaining Chest X-ray Pathology Models using Text…

200 papers

Lung diseases remain a critical global health concern, and it's crucial to have accurate and quick ways to diagnose them. This work focuses on classifying different lung diseases into five groups: viral pneumonia, bacterial pneumonia,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Tanzina Taher Ifty , Saleh Ahmed Shafin , Shoeb Mohammad Shahriar , Tashfia Towhid

Recent research demonstrates that deep learning models are capable of precisely extracting bio-information (e.g. race, gender and age) from patients' Chest X-Rays (CXRs). In this paper, we further show that deep learning models are also…

Image and Video Processing · Electrical Eng. & Systems 2023-05-02 Hao Liang , Kevin Ni , Guha Balakrishnan

IMACT-CXR is an interactive multi-agent conversational tutor that helps trainees interpret chest X-rays by unifying spatial annotation, gaze analysis, knowledge retrieval, and image-grounded reasoning in a single AutoGen-based workflow. The…

Artificial Intelligence · Computer Science 2026-04-17 Tuan-Anh Le , Anh Mai Vu , David Yang , Akash Awasthi , Hien Van Nguyen

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Voice disorders affect a significant portion of the population, and the ability to diagnose them using automated, non-invasive techniques would represent a substantial advancement in healthcare, improving the quality of life of patients.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Davide Ghia , Gabriele Ciravegna , Alkis Koudounas , Marco Fantini , Erika Crosetti , Giovanni Succo , Tania Cerquitelli

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Geeticka Chauhan , Ruizhi Liao , William Wells , Jacob Andreas , Xin Wang , Seth Berkowitz , Steven Horng , Peter Szolovits , Polina Golland

The chest X-ray is one of the most commonly accessible radiological examinations for screening and diagnosis of many lung diseases. A tremendous number of X-ray imaging studies accompanied by radiological reports are accumulated and stored…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Xiaosong Wang , Yifan Peng , Le Lu , Zhiyong Lu , Mohammadhadi Bagheri , Ronald M. Summers

Drug toxicity remains a major challenge in pharmaceutical development. Recent machine learning models have improved in silico toxicity prediction, but their reliance on annotated data and lack of interpretability limit their applicability.…

Machine Learning · Computer Science 2025-11-06 Jueon Park , Yein Park , Minju Song , Soyon Park , Donghyeon Lee , Seungheun Baek , Jaewoo Kang

Public datasets of Chest X-Rays (CXRs) have long been a popular benchmark for developing machine learning (ML) computer vision models in healthcare. However, the reported strong average-case performance of these models do not necessarily…

Machine Learning · Computer Science 2026-02-10 Andrew Wang , Jiashuo Zhang , Michael Oberst

The accelerated adoption of digital pathology and advances in deep learning have enabled the development of powerful models for various pathology tasks across a diverse array of diseases and patient cohorts. However, model training is often…

In this paper, we introduce CheXOFA, a new pre-trained vision-language model (VLM) for the chest X-ray domain. Our model is initially pre-trained on various multimodal datasets within the general domain before being transferred to the chest…

Computation and Language · Computer Science 2023-07-17 Gangwoo Kim , Hajung Kim , Lei Ji , Seongsu Bae , Chanhwi Kim , Mujeen Sung , Hyunjae Kim , Kun Yan , Eric Chang , Jaewoo Kang

Building a highly accurate predictive model for classification and localization of abnormalities in chest X-rays usually requires a large number of manually annotated labels and pixel regions (bounding boxes) of abnormalities. However, it…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yan Han , Chongyan Chen , Ahmed Tewfik , Benjamin Glicksberg , Ying Ding , Yifan Peng , Zhangyang Wang

Chest X-rays (CXRs) are among the most frequently performed imaging examinations worldwide, yet rising imaging volumes increase radiologist workload and the risk of diagnostic errors. Although artificial intelligence (AI) systems have shown…

Medical image classifiers detect gastrointestinal diseases well, but they do not explain their decisions. Large language models can generate clinical text, yet they struggle with visual reasoning and often produce unstable or incorrect…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Md. Najib Hasan , Imran Ahmad , Sourav Basak Shuvo , Md. Mahadi Hasan Ankon , Sunanda Das , Nazmul Siddique , Hui Wang

Fast diagnosis and treatment of pneumothorax, a collapsed or dropped lung, is crucial to avoid fatalities. Pneumothorax is typically detected on a chest X-ray image through visual inspection by experienced radiologists. However, the…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 Antonio Sze-To , Abtin Riasatian , Hamid R. Tizhoosh

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Chronic obstructive pulmonary disease (COPD) is one of the most common chronic illnesses in the world and the third leading cause of mortality worldwide. It is often underdiagnosed or not diagnosed until later in the disease course.…

Lung cancer remains one of the leading causes of cancer-related mortality worldwide. A crucial challenge for early diagnosis is differentiating uncertain cases with similar visual characteristics and closely annotation scores. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sadaf Khademi , Mehran Shabanpour , Reza Taleei , Anastasia Oikonomou , Arash Mohammadi

In the evolving landscape of ECG signal analysis, the challenge of limited transparency in machine learning models remains a significant barrier to their effective integration into clinical practice. This study addresses this issue by…

Signal Processing · Electrical Eng. & Systems 2024-12-09 Toygar Tanyel , Sezgin Atmaca , Kaan Gökçe , M. Yiğit Balık , Arda Güler , Emre Aslanger , İlkay Öksüz

Multimodal deep learning foundation models can learn the relationship between images and text. In the context of medical imaging, mapping images to language concepts reflects the clinical task of diagnostic image interpretation, however…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Matthew Christensen , Milos Vukadinovic , Neal Yuan , David Ouyang