English
Related papers

Related papers: Can Prompt Learning Benefit Radiology Report Gener…

200 papers

Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Keegan Quigley , Miriam Cha , Ruizhi Liao , Geeticka Chauhan , Steven Horng , Seth Berkowitz , Polina Golland

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

Recent developments in the field of Natural Language Processing, especially language models such as the transformer have brought state-of-the-art results in language understanding and language generation. In this work, we investigate the…

Computation and Language · Computer Science 2024-08-22 Sonit Singh

To reduce doctors' workload, deep-learning-based automatic medical report generation has recently attracted more and more research efforts, where attention mechanisms and reinforcement learning are integrated with the classic…

Computation and Language · Computer Science 2020-11-17 Wenting Xu , Chang Qi , Zhenghua Xu , Thomas Lukasiewicz

To effectively train medical students to become qualified radiologists, a large number of X-ray images collected from patients with diverse medical conditions are needed. However, due to data privacy concerns, such images are typically…

Image and Video Processing · Electrical Eng. & Systems 2020-06-19 Xingyi Yang , Nandiraju Gireesh , Eric Xing , Pengtao Xie

Harnessing the robust capabilities of Large Language Models (LLMs) for narrative generation, logical reasoning, and common-sense knowledge integration, this study delves into utilizing LLMs to enhance automated radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yingshu Li , Zhanyu Wang , Yunyi Liu , Lei Wang , Lingqiao Liu , Luping Zhou

Automatic generation of radiology reports seeks to reduce clinician workload while improving documentation consistency. Existing methods that adopt encoder-decoder or retrieval-augmented pipelines achieve progress in fluency but remain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rong Fu , Yiqing Lyu , Chunlei Meng , Muge Qi , Yabin Jin , Qi Zhao , Li Bao , Juntao Gao , Fuqian Shi , Nilanjan Dey , Wei Luo , Simon Fong

Recent advancements in artificial intelligence have significantly improved the automatic generation of radiology reports. However, existing evaluation methods fail to reveal the models' understanding of radiological images and their…

Artificial Intelligence · Computer Science 2024-08-27 Xiaoman Zhang , Julián N. Acosta , Hong-Yu Zhou , Pranav Rajpurkar

Instruction-tuned generative Large language models (LLMs) like ChatGPT and Bloomz possess excellent generalization abilities, but they face limitations in understanding radiology reports, particularly in the task of generating the…

Computation and Language · Computer Science 2023-06-07 Sanjeev Kumar Karn , Rikhiya Ghosh , Kusuma P , Oladimeji Farri

Multi-rater annotations commonly occur when medical images are independently annotated by multiple experts (raters). In this paper, we tackle two challenges arisen in multi-rater annotations for medical image segmentation (called ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jinhong Wang , Yi Cheng , Jintai Chen , Hongxia Xu , Danny Chen , Jian Wu

Modern studies in radiograph representation learning rely on either self-supervision to encode invariant semantics or associated radiology reports to incorporate medical expertise, while the complementarity between them is barely noticed.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Hong-Yu Zhou , Chenyu Lian , Liansheng Wang , Yizhou Yu

Automated medical report generation has demonstrated the potential to significantly reduce the workload associated with time-consuming medical reporting. Recent generative representation learning methods have shown promise in integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shuchang Ye , Mingyuan Meng , Mingjian Li , Dagan Feng , Usman Naseem , Jinman Kim

Every year physicians face an increasing demand of image-based diagnosis from patients, a problem that can be addressed with recent artificial intelligence methods. In this context, we survey works in the area of automatic report generation…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Pablo Messina , Pablo Pino , Denis Parra , Alvaro Soto , Cecilia Besa , Sergio Uribe , Marcelo andía , Cristian Tejos , Claudia Prieto , Daniel Capurro

Computed Tomography Report Generation (CTRG) aims to automate the clinical radiology reporting process, thereby reducing the workload of report writing and facilitating patient care. While deep learning approaches have achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qiong Peng , Yawen Huang , Xian Wu , Yefeng Zheng , Liansheng Wang

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Automated radiology report generation aims at automatically generating a detailed description of medical images, which can greatly alleviate the workload of radiologists and provide better medical services to remote areas. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yuhao Wang , Kai Wang , Xiaohong Liu , Tianrun Gao , Jingyue Zhang , Guangyu Wang

Radiology Report Generation (RRG) aims to automatically generate diagnostic reports from radiology images. To achieve this, existing methods have leveraged the powerful cross-modal generation capabilities of Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Jiechao Gao , Chang Liu , Yuangang Li

Automatic generation of radiology reports has the potential to alleviate radiologists' significant workload, yet current methods struggle to deliver clinically reliable conclusions. In particular, most prior approaches focus on producing…

Computation and Language · Computer Science 2025-12-16 Kyeongkyu Lee , Seonghwan Yoon , Hongki Lim

In autoregressive (AR) image generation, models based on the 'next-token prediction' paradigm of LLMs have shown comparable performance to diffusion models by reducing inductive biases. However, directly applying LLMs to complex image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Miaomiao Cai , Guanjie Wang , Wei Li , Zhijun Tu , Hanting Chen , Shaohui Lin , Jie Hu

Developing imaging models capable of detecting pathologies from chest X-rays can be cost and time-prohibitive for large datasets as it requires supervision to attain state-of-the-art performance. Instead, labels extracted from radiology…

Computation and Language · Computer Science 2024-08-09 Panagiotis Fytas , Anna Breger , Ian Selby , Simon Baker , Shahab Shahipasand , Anna Korhonen