English
Related papers

Related papers: CheXalign: Preference fine-tuning in chest X-ray i…

200 papers

Free-text radiology reports present a rich data source for various medical tasks, but effectively labeling these texts remains challenging. Traditional rule-based labeling methods fall short of capturing the nuances of diverse free-text…

Computation and Language · Computer Science 2024-11-07 Jawook Gu , Kihyun You , Han-Cheol Cho , Jiho Kim , Eun Kyoung Hong , Byungseok Roh

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

Chest X-Ray imaging is one of the most common radiological tools for detection of various pathologies related to the chest area and lung function. In a clinical setting, automated assessment of chest radiographs has the potential of…

Machine Learning · Computer Science 2022-10-31 David Biesner , Helen Schneider , Benjamin Wulff , Ulrike Attenberger , Rafet Sifa

X-ray image-based medical report generation (MRG) is a pivotal area in artificial intelligence which can significantly reduce diagnostic burdens and patient wait times. Despite significant progress, we believe that the task has reached a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Xiao Wang , Fuling Wang , Yuehang Li , Qingchuan Ma , Shiao Wang , Bo Jiang , Chuanfu Li , Jin Tang

In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing radiology reports is a heavy burden for radiologists. To this end, we present an automatic, multi-modal approach for report generation from a…

Image and Video Processing · Electrical Eng. & Systems 2022-06-02 Shuxin Yang , Xian Wu , Shen Ge , S. Kevin Zhou , Li Xiao

Traditional preference tuning methods for LLMs/Visual Generative Models often rely solely on reward model labeling, which can be opaque, offer limited insights into the rationale behind preferences, and are prone to issues such as reward…

Machine Learning · Computer Science 2026-01-13 Hanyang Zhao , Haoxian Chen , Yucheng Guo , Genta Indra Winata , Tingting Ou , Ziyu Huang , David D. Yao , Wenpin Tang

Although deep learning models for chest X-ray interpretation are commonly trained on labels generated by automatic radiology report labelers, the impact of improvements in report labeling on the performance of chest X-ray classification…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Saahil Jain , Akshay Smit , Andrew Y. Ng , Pranav Rajpurkar

The 'Impression' section of a radiology report is a critical basis for communication between radiologists and other physicians, and it is typically written by radiologists based on the 'Findings' section. However, writing numerous…

Radiologists are in short supply globally, and deep learning models offer a promising solution to address this shortage as part of clinical decision-support systems. However, training such models often requires expensive and time-consuming…

Computation and Language · Computer Science 2023-07-10 Alessandro Wollek , Philip Haitzer , Thomas Sedlmeyr , Sardi Hyska , Johannes Rueckel , Bastian Sabel , Michael Ingrisch , Tobias Lasser

The current gold standard for evaluating generated chest x-ray (CXR) reports is through radiologist annotations. However, this process can be extremely time-consuming and costly, especially when evaluating large numbers of reports. In this…

Computation and Language · Computer Science 2024-08-13 Alyssa Huang , Oishi Banerjee , Kay Wu , Eduardo Pontes Reis , Pranav Rajpurkar

Medical image interpretation is central to most clinical applications such as disease diagnosis, treatment planning, and prognostication. In clinical practice, radiologists examine medical images and manually compile their findings into…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nurbanu Aksoy , Nishant Ravikumar , Alejandro F Frangi

Medical Vision-Language Models (VLMs) are prone to hallucinations, compromising clinical reliability. While reinforcement learning methods like Group Relative Policy Optimization (GRPO) offer a low-cost alignment solution, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Xiao Liang , Yuxuan An , Di Wang , Jiawei Hu , Zhicheng Jiao , Bin Jing , Quan Wang

Medical imaging is crucial for diagnosing, monitoring, and treating medical conditions. The medical reports of radiology images are the primary medium through which medical professionals attest their findings, but their writing is time…

Computation and Language · Computer Science 2025-01-07 Iustin Sîrbu , Iulia-Renata Sîrbu , Jasmina Bogojeska , Traian Rebedea

AI-assisted report generation offers the opportunity to reduce radiologists' workload stemming from expanded screening guidelines, complex cases and workforce shortages, while maintaining diagnostic accuracy. In addition to describing…

Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable…

Computation and Language · Computer Science 2021-08-30 Hoang T. N. Nguyen , Dong Nie , Taivanbat Badamdorj , Yujie Liu , Yingying Zhu , Jason Truong , Li Cheng

Radiology report generation (RRG) for diagnostic images, such as chest X-rays, plays a pivotal role in both clinical practice and AI. Traditional free-text reports suffer from redundancy and inconsistent language, complicating the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yingshu Li , Yunyi Liu , Zhanyu Wang , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Aaron Nicolson , Jason Dowling , Bevan Koopman

Despite the significant progress made by existing retrieval augmented language models (RALMs) in providing trustworthy responses and grounding in reliable sources, they often overlook effective alignment with human preferences. In the…

Computation and Language · Computer Science 2024-12-19 Zhuoran Jin , Hongbang Yuan , Tianyi Men , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Radiology reports are an instrumental part of modern medicine, informing key clinical decisions such as diagnosis and treatment. The worldwide shortage of radiologists, however, restricts access to expert care and imposes heavy workloads,…