English
Related papers

Related papers: Towards Interpretable Radiology Report Generation …

200 papers

Automated ICD-10 coding from clinical discharge summaries requires models that are both accurate on long-tailed multi-label classification tasks and interpretable to clinicians. Concept Bottleneck Models (CBMs) offer a principled framework…

Machine Learning · Computer Science 2026-05-12 Mohammed Sameer Syed , Xuan Lu

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known…

Deep learning models have achieved remarkable accuracy in chest X-ray diagnosis, yet their widespread clinical adoption remains limited by the black-box nature of their predictions. Clinicians require transparent, verifiable explanations to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yiming Tang , Wenjia Zhong , Rushi Shah , Dianbo Liu

Interpretation is critical for disease diagnosis, but existing models struggle to balance predictive accuracy with human-understandable rationales. While large language models (LLMs) offer strong reasoning abilities, their clinical use is…

Computation and Language · Computer Science 2025-07-15 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Yida Xu , Yunya Song , Xian Yang

Chest X-ray (CXR) radiology report generation (RRG) models have shown rapid progress on automated metrics, yet their clinical utility remains uncertain due to limited qualitative evaluation by radiologists. We present CXRMate-2, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Aaron Nicolson , Elizabeth J. Cooper , Hwan-Jin Yoon , Claire McCafferty , Ramya Krishnan , Michelle Craigie , Nivene Saad , Jason Dowling , Ian A. Scott , Bevan Koopman

Radiology report generation (RRG) aims to automatically generate free-text descriptions from clinical radiographs, e.g., chest X-Ray images. RRG plays an essential role in promoting clinical automation and presents significant help to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Chang Liu , Yuanhe Tian , Yan Song

We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Dwarikanath Mahapatra

Automated 3D radiology report generation often suffers from clinical hallucinations and a lack of the iterative verification found in human practice. While recent Vision-Language Models (VLMs) have advanced the field, they typically operate…

Artificial Intelligence · Computer Science 2026-04-20 Yi Lin , Yihao Ding , Yonghui Wu , Yifan Peng

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

Reading and interpreting chest X-ray images is one of the most radiologist's routines. However, it still can be challenging, even for the most experienced ones. Therefore, we proposed a multi-model deep learning-based automated chest X-ray…

Image and Video Processing · Electrical Eng. & Systems 2024-01-31 Arief Purnama Muharram , Hollyana Puteri Haryono , Abassi Haji Juma , Ira Puspasari , Nugraha Priya Utama

Vision-language models (VLM) have markedly advanced AI-driven interpretation and reporting of complex medical imaging, such as computed tomography (CT). Yet, existing methods largely relegate clinicians to passive observers of final…

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable…

Computation and Language · Computer Science 2021-08-30 Hoang T. N. Nguyen , Dong Nie , Taivanbat Badamdorj , Yujie Liu , Yingying Zhu , Jason Truong , Li Cheng

Large Language Models (LLMs) exhibit hallucinations in knowledge-intensive tasks. Graph-based retrieval augmented generation (RAG) has emerged as a promising solution, yet existing approaches suffer from fundamental recall and precision…

Information Retrieval · Computer Science 2026-03-24 Duyi Pan , Tianao Lou , Xin Li , Haoze Song , Yiwen Wu , Mengyi Deng , Mingyu Yang , Wei Wang

Radiology reports are an important means of communication between radiologists and other physicians. These reports express a radiologist's interpretation of a medical imaging examination and are critical in establishing a diagnosis and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Hojjat Salehinejad , Shahrokh Valaee , Aren Mnatzakanian , Tim Dowdell , Joseph Barfett , Errol Colak

Concept Bottleneck Models (CBMs) aim to enhance interpretability by predicting human-understandable concepts as intermediates for decision-making. However, these models often face challenges in ensuring reliable concept representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yuxuan Cai , Xiyu Wang , Satoshi Tsutsui , Winnie Pang , Bihan Wen

Automatic generation of radiology reports seeks to reduce clinician workload while improving documentation consistency. Existing methods that adopt encoder-decoder or retrieval-augmented pipelines achieve progress in fluency but remain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rong Fu , Yiqing Lyu , Chunlei Meng , Muge Qi , Yabin Jin , Qi Zhao , Li Bao , Juntao Gao , Fuqian Shi , Nilanjan Dey , Wei Luo , Simon Fong

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh