English
Related papers

Related papers: GIT-CXR: End-to-End Transformer for Chest X-Ray Re…

200 papers

Text to image latent diffusion models have recently advanced medical image synthesis, but applications to 3D CT generation remain limited. Existing approaches rely on simplified prompts, neglecting the rich semantic detail in full radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Sina Amirrajab , Zohaib Salahuddin , Sheng Kuang , Henry C. Woodruff , Philippe Lambin

The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explicitly focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tim Tanida , Philip Müller , Georgios Kaissis , Daniel Rueckert

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Purpose: To explore best-practice approaches for generating synthetic chest X-ray images and augmenting medical imaging datasets to optimize the performance of deep learning models in downstream tasks like classification and segmentation.…

X-ray medical report generation is one of the important applications of artificial intelligence in healthcare. With the support of large foundation models, the quality of medical report generation has significantly improved. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Futian Wang , Yuhan Qiao , Xiao Wang , Fuling Wang , Yuxiang Zhang , Dengdi Sun

Developing advanced medical imaging retrieval systems is challenging due to the varying definitions of `similar images' across different medical contexts. This challenge is compounded by the lack of large-scale, high-quality medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Tengfei Zhang , Ziheng Zhao , Chaoyi Wu , Xiao Zhou , Ya Zhang , Yanfeng Wang , Weidi Xie

Automated radiology report generation aims to expedite the tedious and error-prone reporting process for radiologists. While recent works have made progress, learning to align medical images and textual findings remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yaxiong Chen , Chuang Du , Chunlei Li , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

Radiology report generation aims to produce computer-aided diagnoses to alleviate the workload of radiologists and has drawn increasing attention recently. However, previous deep learning methods tend to neglect the mutual influences…

Computation and Language · Computer Science 2022-01-12 Song Wang , Liyan Tang , Mingquan Lin , George Shih , Ying Ding , Yifan Peng

Machine learning has significantly advanced healthcare by aiding in disease prevention and treatment identification. However, accessing patient data can be challenging due to privacy concerns and strict regulations. Generating synthetic,…

When pneumonia is not found on a chest X-ray, should the report describe this negative observation or omit it? We argue that this question cannot be answered from the X-ray alone and requires a pragmatic perspective, which captures the…

Computation and Language · Computer Science 2023-11-30 Dang Nguyen , Chacha Chen , He He , Chenhao Tan

Mammography report generation is a critical yet underexplored task in medical AI, characterized by challenges such as multiview image reasoning, high-resolution visual cues, and unstructured radiologic language. In this work, we introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Nak-Jun Sung , Donghyun Lee , Bo Hwa Choi , Chae Jung Park

There is growing interest in applying AI to radiology report generation, particularly for chest X-rays (CXRs). This paper investigates whether incorporating pixel-level information through segmentation masks can improve fine-grained image…

AI-driven models have demonstrated significant potential in automating radiology report generation for chest X-rays. However, there is no standardized benchmark for objectively evaluating their performance. To address this, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Xiaoman Zhang , Hong-Yu Zhou , Xiaoli Yang , Oishi Banerjee , Julián N. Acosta , Josh Miller , Ouwen Huang , Pranav Rajpurkar

The extraction of labels from radiology text reports enables large-scale training of medical imaging models. Existing approaches to report labeling typically rely either on sophisticated feature engineering based on medical domain knowledge…

Computation and Language · Computer Science 2020-10-20 Akshay Smit , Saahil Jain , Pranav Rajpurkar , Anuj Pareek , Andrew Y. Ng , Matthew P. Lungren

Chest x-rays are a vital tool in the workup of many patients. Similar to most medical imaging modalities, they are profoundly multi-modal and are capable of visualising a variety of combinations of conditions. There is an ever pressing need…

Image and Video Processing · Electrical Eng. & Systems 2021-06-08 Bradley Segal , David M. Rubin , Grace Rubin , Adam Pantanowitz

Large-scale generative models have demonstrated impressive capabilities in producing visually compelling images, with increasing applications in medical imaging. However, they continue to grapple with hallucination challenges and the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Anees Ur Rehman Hashmi , Ibrahim Almakky , Mohammad Areeb Qazi , Santosh Sanjeev , Vijay Ram Papineni , Jagalpathy Jagdish , Mohammad Yaqub

Vision Transformers (ViTs) are widely adopted in medical imaging tasks, and some existing efforts have been directed towards vision-language training for Chest X-rays (CXRs). However, we envision that there still exists a potential for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Umar Marikkar , Sara Atito , Muhammad Awais , Adam Mahdi

Radiology reporting is a complex task requiring detailed medical image understanding and precise language generation, for which generative multimodal models offer a promising solution. However, to impact clinical practice, models must…

Chest radiographs (CXRs) are among the most common tests in medicine. Automated image interpretation may reduce radiologists\' workload and expand access to diagnostic expertise. Deep learning multi-task and foundation models have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-09-11 Lauren H. Cooke , Matthias Jung , Jan M. Brendel , Nora M. Kerkovits , Borek Foldyna , Michael T. Lu , Vineet K. Raghu

Automatic extraction of medical conditions from free-text radiology reports is critical for supervising computer vision models to interpret medical images. In this work, we show that radiologists labeling reports significantly disagree with…

Image and Video Processing · Electrical Eng. & Systems 2021-03-16 Saahil Jain , Akshay Smit , Steven QH Truong , Chanh DT Nguyen , Minh-Thanh Huynh , Mudit Jain , Victoria A. Young , Andrew Y. Ng , Matthew P. Lungren , Pranav Rajpurkar