English
Related papers

Related papers: RadAlign: Advancing Radiology Report Generation wi…

200 papers

Automated radiology report generation holds significant potential to reduce radiologists' workload and enhance diagnostic accuracy. However, generating precise and clinically meaningful reports from chest radiographs remains challenging due…

Image and Video Processing · Electrical Eng. & Systems 2026-05-20 Md. Zihad Bin Jahangir , Muhammad Ashad Kabir , Sumaiya Akter , Israt Jahan , Minh Chau

Automating radiology report generation poses a dual challenge: building clinically reliable systems and designing rigorous evaluation protocols. We introduce a multi-agent reinforcement learning framework that serves as both a benchmark and…

Artificial Intelligence · Computer Science 2025-09-23 Ahmed T. Elboardy , Ghada Khoriba , Essam A. Rashed

Most current medical vision language models struggle to jointly generate diagnostic text and pixel-level segmentation masks in response to complex visual questions. This represents a major limitation towards clinical application, as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Chengrun Li , Corentin Royer , Haozhe Luo , Bastian Wittmann , Xia Li , Ibrahim Hamamci , Sezgin Er , Anjany Sekuboyina , Bjoern Menze

In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing radiology reports is a heavy burden for radiologists. To this end, we present an automatic, multi-modal approach for report generation from a…

Image and Video Processing · Electrical Eng. & Systems 2022-06-02 Shuxin Yang , Xian Wu , Shen Ge , S. Kevin Zhou , Li Xiao

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

Radiology report generation (RRG) aims to automatically generate free-text descriptions from clinical radiographs, e.g., chest X-Ray images. RRG plays an essential role in promoting clinical automation and presents significant help to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Chang Liu , Yuanhe Tian , Yan Song

Large Vision-Language Models (LVLMs) have demonstrated promising performance in chest X-ray (CXR) analysis. To enhance human-computer interaction, several studies have incorporated radiologists' eye gaze, typically through heatmaps or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yunsoo Kim , Jinge Wu , Honghan Wu

This paper explores the task of radiology report generation, which aims at generating free-text descriptions for a set of radiographs. One significant challenge of this task is how to correctly maintain the consistency between the images…

Computation and Language · Computer Science 2023-06-13 Wenjun Hou , Kaishuai Xu , Yi Cheng , Wenjie Li , Jiang Liu

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

This study introduces "RadCouncil," a multi-agent Large Language Model (LLM) framework designed to enhance the generation of impressions in radiology reports from the finding section. RadCouncil comprises three specialized agents: 1) a…

Computation and Language · Computer Science 2024-12-11 Fang Zeng , Zhiliang Lyu , Quanzheng Li , Xiang Li

Radiology report generation (RRG) has shown great potential in assisting radiologists by automating the labor-intensive task of report writing. While recent advancements have improved the quality and coherence of generated reports, ensuring…

Artificial Intelligence · Computer Science 2025-03-18 Chenyu Wang , Weichao Zhou , Shantanu Ghosh , Kayhan Batmanghelich , Wenchao Li

Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However,…

Artificial Intelligence · Computer Science 2024-04-01 Seil Kang , Donghyun Kim , Junhyeok Kim , Hyo Kyung Lee , Seong Jae Hwang

Accurate risk assessment in lung cancer screening is critical for enabling early cancer detection and minimizing unnecessary invasive procedures. The Lung CT Screening Reporting and Data System (Lung-RADS) has been widely used as the…

Machine Learning · Computer Science 2025-09-09 Chuang Niu , Ge Wang

Generating radiology reports is time-consuming and requires extensive expertise in practice. Therefore, reliable automatic radiology report generation is highly desired to alleviate the workload. Although deep learning techniques have been…

Image and Video Processing · Electrical Eng. & Systems 2019-07-24 Jianbo Yuan , Haofu Liao , Rui Luo , Jiebo Luo

Medical report generation automates radiology descriptions from images, easing the burden on physicians and minimizing errors. However, current methods lack structured outputs and physician interactivity for clear, clinically relevant…

Artificial Intelligence · Computer Science 2024-04-18 Hongzhao Li , Hongyu Wang , Xia Sun , Hua He , Jun Feng

The recent advancements in text-to-image generative models have been remarkable. Yet, the field suffers from a lack of evaluation metrics that accurately reflect the performance of these models, particularly lacking fine-grained metrics…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Zhiyu Tan , Xiaomeng Yang , Luozheng Qin , Mengping Yang , Cheng Zhang , Hao Li

Most natural language tasks in the radiology domain use language models pre-trained on biomedical corpus. There are few pretrained language models trained specifically for radiology, and fewer still that have been trained in a low data…

Computation and Language · Computer Science 2023-06-06 Rikhiya Ghosh , Sanjeev Kumar Karn , Manuela Daniela Danu , Larisa Micu , Ramya Vunikili , Oladimeji Farri

Radiology report generation (RRG) models typically focus on individual exams, often overlooking the integration of historical visual or textual data, which is crucial for patient follow-ups. Traditional methods usually struggle with long…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Tengfei Liu , Jiapu Wang , Yongli Hu , Mingjie Li , Junfei Yi , Xiaojun Chang , Junbin Gao , Baocai Yin

Lung cancer remains one of the leading causes of cancer-related mortality worldwide. A crucial challenge for early diagnosis is differentiating uncertain cases with similar visual characteristics and closely annotation scores. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Sadaf Khademi , Mehran Shabanpour , Reza Taleei , Anastasia Oikonomou , Arash Mohammadi

Image-to-text radiology report generation aims to automatically produce radiology reports that describe the findings in medical images. Most existing methods focus solely on the image data, disregarding the other patient information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nurbanu Aksoy , Serge Sharoff , Selcuk Baser , Nishant Ravikumar , Alejandro F Frangi