English
Related papers

Related papers: Radiology Text Analysis System (RadText): Architec…

200 papers

When reading images, radiologists generate text reports describing the findings therein. Current state-of-the-art computer-aided diagnosis tools utilize a fixed set of predefined categories automatically extracted from these medical reports…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Constantin Seibold , Simon Reiß , M. Saquib Sarfraz , Rainer Stiefelhagen , Jens Kleesiek

Accurately interpreting medical images and writing radiology reports is a critical but challenging task in healthcare. Both human-written and AI-generated reports can contain errors, ranging from clinical inaccuracies to linguistic…

Computation and Language · Computer Science 2024-09-18 Vishwanatha M. Rao , Serena Zhang , Julian N. Acosta , Subathra Adithan , Pranav Rajpurkar

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Geeticka Chauhan , Ruizhi Liao , William Wells , Jacob Andreas , Xin Wang , Seth Berkowitz , Steven Horng , Peter Szolovits , Polina Golland

Most natural language tasks in the radiology domain use language models pre-trained on biomedical corpus. There are few pretrained language models trained specifically for radiology, and fewer still that have been trained in a low data…

Computation and Language · Computer Science 2023-06-06 Rikhiya Ghosh , Sanjeev Kumar Karn , Manuela Daniela Danu , Larisa Micu , Ramya Vunikili , Oladimeji Farri

Neural image-to-text radiology report generation systems offer the potential to improve radiology reporting by reducing the repetitive process of report drafting and identifying possible medical errors. However, existing report generation…

Computation and Language · Computer Science 2021-04-14 Yasuhide Miura , Yuhao Zhang , Emily Bao Tsai , Curtis P. Langlotz , Dan Jurafsky

BACKGROUND: Radiology reports are typically written in a free-text format, making clinical information difficult to extract and use. Recently the adoption of structured reporting (SR) has been recommended by various medical societies thanks…

Endometriosis ultrasound reports are often unstructured free-text documents that require manual abstraction for downstream tasks such as analytics, machine learning model training, and clinical auditing. We present \textbf{EndoExtract}, an…

Human-Computer Interaction · Computer Science 2026-02-17 Haiyi Li , Yiyang Zhao , Yutong Li , Alison Deslandes , Jodie Avery , Mathew Leonardi , Mary Louise Hull , Hsiang-Ting Chen

Recent advancements in artificial intelligence have significantly improved the automatic generation of radiology reports. However, existing evaluation methods fail to reveal the models' understanding of radiological images and their…

Artificial Intelligence · Computer Science 2024-08-27 Xiaoman Zhang , Julián N. Acosta , Hong-Yu Zhou , Pranav Rajpurkar

Automated radiology report generation aims to generate radiology reports that contain rich, fine-grained descriptions of radiology imaging. Compared with image captioning in the natural image domain, medical images are very similar to each…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhao Wang

Vision-language pretraining has been shown to produce high-quality visual encoders which transfer efficiently to downstream computer vision tasks. Contrastive learning approaches have increasingly been adopted for medical vision language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Keegan Quigley , Miriam Cha , Josh Barua , Geeticka Chauhan , Seth Berkowitz , Steven Horng , Polina Golland

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

The automatic generation of radiology reports has emerged as a promising solution to reduce a time-consuming task and accurately capture critical disease-relevant findings in X-ray images. Previous approaches for radiology report generation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Sang-Jun Park , Keun-Soo Heo , Dong-Hee Shin , Young-Han Son , Ji-Hye Oh , Tae-Eui Kam

Radiology reporting is a crucial part of the communication between radiologists and other medical professionals, but it can be time-consuming and error-prone. One approach to alleviate this is structured reporting, which saves time and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Chantal Pellegrini , Matthias Keicher , Ege Özsoy , Nassir Navab

Radiology reports capture crucial longitudinal information on tumor burden, treatment response, and disease progression, yet their unstructured narrative format complicates automated analysis. While large language models (LLMs) have…

Computation and Language · Computer Science 2026-03-12 Luc Builtjes , Alessa Hering

Automated generation of clinically accurate radiology reports can improve patient care. Previous report generation methods that rely on image captioning models often generate incoherent and incorrect text due to their lack of relevant…

Automated deidentification of clinical text data is crucial due to the high cost of manual deidentification, which has been a barrier to sharing clinical text and the advancement of clinical natural language processing. However, creating…

Computation and Language · Computer Science 2023-11-07 Callandra Moore , Jonathan Ranisau , Walter Nelson , Jeremy Petch , Alistair Johnson

Current approaches to explaining the decisions of deep learning systems for medical tasks have focused on visualising the elements that have contributed to each decision. We argue that such approaches are not enough to "open the black box"…

Artificial Intelligence · Computer Science 2018-06-04 William Gale , Luke Oakden-Rayner , Gustavo Carneiro , Andrew P Bradley , Lyle J Palmer

This paper explores the task of radiology report generation, which aims at generating free-text descriptions for a set of radiographs. One significant challenge of this task is how to correctly maintain the consistency between the images…

Computation and Language · Computer Science 2023-06-13 Wenjun Hou , Kaishuai Xu , Yi Cheng , Wenjie Li , Jiang Liu

Existing mainstream approaches follow the encoder-decoder paradigm for generating radiology reports. They focus on improving the network structure of encoders and decoders, which leads to two shortcomings: overlooking the modality gap and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yuanjiang Luo , Hongxiang Li , Xuan Wu , Meng Cao , Xiaoshuang Huang , Zhihong Zhu , Peixi Liao , Hu Chen , Yi Zhang