English
Related papers

Related papers: Improving Chest X-Ray Report Generation by Leverag…

200 papers

Chest X-ray (CXR) is the most frequently ordered imaging test, supporting diverse clinical tasks from thoracic disease detection to postoperative monitoring. However, task-specific classification models are limited in scope, require costly…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Zefan Yang , Xuanang Xu , Jiajin Zhang , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

Automatic extraction of medical conditions from free-text radiology reports is critical for supervising computer vision models to interpret medical images. In this work, we show that radiologists labeling reports significantly disagree with…

Image and Video Processing · Electrical Eng. & Systems 2021-03-16 Saahil Jain , Akshay Smit , Steven QH Truong , Chanh DT Nguyen , Minh-Thanh Huynh , Mudit Jain , Victoria A. Young , Andrew Y. Ng , Matthew P. Lungren , Pranav Rajpurkar

As the COVID-19 pandemic continues to devastate globally, the use of chest X-ray (CXR) imaging as a complimentary screening strategy to RT-PCR testing continues to grow given its routine clinical use for respiratory complaint. As part of…

Image and Video Processing · Electrical Eng. & Systems 2021-05-17 Maya Pavlova , Naomi Terhljan , Audrey G. Chung , Andy Zhao , Siddharth Surana , Hossein Aboutalebi , Hayden Gunraj , Ali Sabri , Amer Alaref , Alexander Wong

Chest X-rays (CXRs) are among the most commonly used medical image modalities. They are mostly used for screening, and an indication of disease typically results in subsequent tests. As this is mostly a screening test used to rule out chest…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Ken C. L. Wong , Mehdi Moradi , Joy Wu , Tanveer Syeda-Mahmood

We propose Retrieval Augmented Generation (RAG) as an approach for automated radiology report writing that leverages multimodally aligned embeddings from a contrastively pretrained vision language model for retrieval of relevant candidate…

Computation and Language · Computer Science 2023-05-08 Mercy Ranjit , Gopinath Ganapathy , Ranjit Manuel , Tanuja Ganu

Recent advances in text-conditioned image generation diffusion models have begun paving the way for new opportunities in modern medical domain, in particular, generating Chest X-rays (CXRs) from diagnostic reports. Nonetheless, to further…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Woojung Han , Chanyoung Kim , Dayun Ju , Yumin Shim , Seong Jae Hwang

Chest X-ray (CXR) imaging remains one of the most widely used diagnostic tools for detecting pulmonary diseases such as tuberculosis (TB) and pneumonia. Recent advances in deep learning, particularly Vision Transformers (ViTs), have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Faisal Ahmed

Convolutional Neural Networks (CNNs) intrinsically requires large-scale data whereas Chest X-Ray (CXR) images tend to be data/annotation-scarce, leading to over-fitting. Therefore, based on our development experience and related work, this…

Image and Video Processing · Electrical Eng. & Systems 2021-06-03 Changhee Han , Takayuki Okamoto , Koichi Takeuchi , Dimitris Katsios , Andrey Grushnikov , Masaaki Kobayashi , Antoine Choppin , Yutaka Kurashina , Yuki Shimahara

The chest X-ray (CXR) is one of the most common and easy-to-get medical tests used to diagnose common diseases of the chest. Recently, many deep learning-based methods have been proposed that are capable of effectively classifying CXRs.…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Weizhi Nie , Chen Zhang , Dan Song , Lina Zhao , Yunpeng Bai , Keliang Xie , Anan Liu

AI-assisted report generation offers the opportunity to reduce radiologists' workload stemming from expanded screening guidelines, complex cases and workforce shortages, while maintaining diagnostic accuracy. In addition to describing…

Radiology report generation from chest X-rays is an important task in artificial intelligence with the potential to greatly reduce radiologists' workload and shorten patient wait times. Despite recent advances, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Puzhen Wu , Hexin Dong , Yi Lin , Yihao Ding , Yifan Peng

Radiologists play a crucial role in translating medical images into actionable reports. However, the field faces staffing shortages and increasing workloads. While automated approaches using vision-language models (VLMs) show promise as…

Before the recent success of deep learning methods for automated medical image analysis, practitioners used handcrafted radiomic features to quantitatively describe local patches of medical images. However, extracting discriminative…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Yan Han , Gregory Holste , Ying Ding , Ahmed Tewfik , Yifan Peng , Zhangyang Wang

Although deep learning models for chest X-ray interpretation are commonly trained on labels generated by automatic radiology report labelers, the impact of improvements in report labeling on the performance of chest X-ray classification…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Saahil Jain , Akshay Smit , Andrew Y. Ng , Pranav Rajpurkar

Recently large vision-language models have shown potential when interpreting complex images and generating natural language descriptions using advanced reasoning. Medicine's inherently multimodal nature incorporating scans and text-based…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Naman Sharma

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

The Shared Task on Large-Scale Radiology Report Generation (RRG24) aims to expedite the development of assistive systems for interpreting and reporting on chest X-ray (CXR) images. This task challenges participants to develop models that…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Aaron Nicolson , Jinghui Liu , Jason Dowling , Anthony Nguyen , Bevan Koopman

Recent advances in vision-language models (VLMs) have improved Chest X-ray (CXR) interpretation in multiple aspects. However, many medical VLMs rely solely on supervised fine-tuning (SFT), which optimizes next-token prediction without…

Radiology report generation aims to automatically generate a clinically accurate and coherent paragraph from the X-ray image, which could relieve radiologists from the heavy burden of report writing. Although various image caption methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Zhongzhen Huang , Xiaofan Zhang , Shaoting Zhang

Medical imaging has been used for diagnosis of various conditions, making it one of the most powerful resources for effective patient care. Due to widespread availability, low cost, and low radiation, chest X-ray is one of the most sought…

Image and Video Processing · Electrical Eng. & Systems 2024-04-22 Sonit Singh