English
Related papers

Related papers: Reading Radiology Imaging Like The Radiologist

200 papers

Building a large-scale training dataset is an essential problem in the development of medical image recognition systems. Visual grounding techniques, which automatically associate objects in images with corresponding descriptions, can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Akimichi Ichinose , Taro Hatsutani , Keigo Nakamura , Yoshiro Kitamura , Satoshi Iizuka , Edgar Simo-Serra , Shoji Kido , Noriyuki Tomiyama

We propose Retrieval Augmented Generation (RAG) as an approach for automated radiology report writing that leverages multimodally aligned embeddings from a contrastively pretrained vision language model for retrieval of relevant candidate…

Computation and Language · Computer Science 2023-05-08 Mercy Ranjit , Gopinath Ganapathy , Ranjit Manuel , Tanuja Ganu

We present an architecture that generates medical texts while learning an informative, continuous representation with discriminative features. During training the input to the system is a dataset of captions for medical X-Rays. The acquired…

Computation and Language · Computer Science 2018-05-16 Graham Spinks , Marie-Francine Moens

Chest Xray imaging is a widely used diagnostic tool in modern medicine, and its high utilization creates substantial workloads for radiologists. To alleviate this burden, vision language models are increasingly applied to automate Chest…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shaoyang Zhou , Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Vision-language pretraining has been shown to produce high-quality visual encoders which transfer efficiently to downstream computer vision tasks. Contrastive learning approaches have increasingly been adopted for medical vision language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Keegan Quigley , Miriam Cha , Josh Barua , Geeticka Chauhan , Seth Berkowitz , Steven Horng , Polina Golland

Reading and interpreting chest X-ray images is one of the most radiologist's routines. However, it still can be challenging, even for the most experienced ones. Therefore, we proposed a multi-model deep learning-based automated chest X-ray…

Image and Video Processing · Electrical Eng. & Systems 2024-01-31 Arief Purnama Muharram , Hollyana Puteri Haryono , Abassi Haji Juma , Ira Puspasari , Nugraha Priya Utama

Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by…

Computation and Language · Computer Science 2026-05-29 Xi Zhang , Yingshu Li , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

With the advance of deep learning, much progress has been made in building powerful artificial intelligence (AI) systems for automatic Chest X-ray (CXR) analysis. Most existing AI models are trained to be a binary classifier with the aim of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangyu Peng , Kai Wang , Jianfei Yang , Yingying Zhu , Yang You

Counterfactual generation for chest X-rays (CXR) aims to simulate plausible pathological changes while preserving patient-specific anatomy. However, diffusion-based editing methods often suffer from structural drift, where stable anatomical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zichun Zhang , Weizhi Nie , Honglin Guo , Yuting Su

Image Captioning is a task that requires models to acquire a multi-modal understanding of the world and to express this understanding in natural language text. While the state-of-the-art for this task has rapidly improved in terms of n-gram…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Annika Lindh , Robert J. Ross , Abhijit Mahalunkar , Giancarlo Salton , John D. Kelleher

Recent progress on automatic generation of image captions has shown that it is possible to describe the most salient information conveyed by images with accurate and meaningful sentences. In this paper, we propose an image caption system…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Junqi Jin , Kun Fu , Runpeng Cui , Fei Sha , Changshui Zhang

Automatic radiology report generation is booming due to its huge application potential for the healthcare industry. However, existing computer vision and natural language processing approaches to tackle this problem are limited in two…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Fudan Zheng , Mengfei Li , Ying Wang , Weijiang Yu , Ruixuan Wang , Zhiguang Chen , Nong Xiao , Yutong Lu

Diagnostic Captioning (DC) concerns the automatic generation of a diagnostic text from a set of medical images of a patient collected during an examination. DC can assist inexperienced physicians, reducing clinical errors. It can also help…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 John Pavlopoulos , Vasiliki Kougia , Ion Androutsopoulos , Dimitris Papamichail

Automated CT report generation plays a crucial role in improving diagnostic accuracy and clinical workflow efficiency. However, existing methods lack interpretability and impede patient-clinician understanding, while their static nature…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Yannian Gu , Wenhui Lei , Hanyu Chen , Xiaofan Zhang , Shaoting Zhang

The image captioning task is increasingly prevalent in artificial intelligence applications for medicine. One important application is clinical report generation from chest radiographs. The clinical writing of unstructured reports is time…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Edward Vendrow , Ethan Schonfeld

This paper introduces RTEx, a novel methodology for a) ranking radiography exams based on their probability to contain an abnormality, b) generating abnormality tags for abnormal exams, and c) providing a diagnostic explanation in natural…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Vasiliki Kougia , John Pavlopoulos , Panagiotis Papapetrou , Max Gordon

Radiology report generation (RRG) aims to automatically produce clinically accurate textual reports from medical images. Existing methods predominantly rely on autoregressive (AR) language models, whose causal dependency structure restricts…

Artificial Intelligence · Computer Science 2026-05-19 Shiying Yu , Jielei Wang , Guoming Lu

Counterfactual medical image generation have emerged as a critical tool for enhancing AI-driven systems in medical domain by answering "what-if" questions. However, existing approaches face two fundamental limitations: First, they fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hyungi Min , Taeseung You , Hangyeul Lee , Yeongjae Cho , Sungzoon Cho

Radiology reports for the same patient examination may contain clinically meaningful discrepancies arising from interpretation differences, reporting variability, or evolving assessments. Systematic analysis of such discrepancies is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhaoyi Sun , Minal Jagtiani , Wen-wai Yim , Fei Xia , Martin Gunn , Meliha Yetisgen , Asma Ben Abacha

Interpreting chest X-rays is inherently challenging due to the overlap between anatomical structures and the subtle presentation of many clinically significant pathologies, making accurate diagnosis time-consuming even for experienced…

Artificial Intelligence · Computer Science 2026-04-17 Shantam Srivastava , Mahesh Bhosale , David Doermann , Mingchen Gao