English
Related papers

Related papers: FlexR: Few-shot Classification with Language Embed…

200 papers

The task of radiology reporting comprises describing and interpreting the medical findings in radiographic images, including description of their location and appearance. Automated approaches to radiology reporting require the image to be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q. O'Neil

The chest X-ray (CXR) is by far the most commonly performed radiological examination for screening and diagnosis of many cardiac and pulmonary diseases. There is an immense world-wide shortage of physicians capable of providing rapid and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Jonathan Laserson , Christine Dan Lantsman , Michal Cohen-Sfady , Itamar Tamir , Eli Goz , Chen Brestel , Shir Bar , Maya Atar , Eldad Elnekave

In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Constantin Seibold , Simon Reiß , Saquib Sarfraz , Matthias A. Fink , Victoria Mayer , Jan Sellner , Moon Sung Kim , Klaus H. Maier-Hein , Jens Kleesiek , Rainer Stiefelhagen

Automated generation of clinically accurate radiology reports can improve patient care. Previous report generation methods that rely on image captioning models often generate incoherent and incorrect text due to their lack of relevant…

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

Multimodal models trained on large natural image-text pair datasets have exhibited astounding abilities in generating high-quality images. Medical imaging data is fundamentally different to natural images, and the language used to…

Chest Xray imaging is a widely used diagnostic tool in modern medicine, and its high utilization creates substantial workloads for radiologists. To alleviate this burden, vision language models are increasingly applied to automate Chest…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shaoyang Zhou , Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Recent developments in the field of Natural Language Processing, especially language models such as the transformer have brought state-of-the-art results in language understanding and language generation. In this work, we investigate the…

Computation and Language · Computer Science 2024-08-22 Sonit Singh

As artificial intelligence (AI) becomes increasingly central to healthcare, the demand for explainable and trustworthy models is paramount. Current report generation systems for chest X-rays (CXR) often lack mechanisms for validating…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Sayeh Gholipour Picha , Dawood Al Chanti , Alice Caplier

Image-to-text radiology report generation aims to automatically produce radiology reports that describe the findings in medical images. Most existing methods focus solely on the image data, disregarding the other patient information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nurbanu Aksoy , Serge Sharoff , Selcuk Baser , Nishant Ravikumar , Alejandro F Frangi

With the emergence of large-scale vision-language models, realistic radiology reports may be generated using only medical images as input guided by simple prompts. However, their practical utility has been limited due to the factual errors…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 R. Mahmood , K. C. L. Wong , D. M. Reyes , N. D'Souza , L. Shi , J. Wu , P. Kaviani , M. Kalra , G. Wang , P. Yan , T. Syeda-Mahmood

The image captioning task is increasingly prevalent in artificial intelligence applications for medicine. One important application is clinical report generation from chest radiographs. The clinical writing of unstructured reports is time…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Edward Vendrow , Ethan Schonfeld

Automated radiology report generation aims to generate radiology reports that contain rich, fine-grained descriptions of radiology imaging. Compared with image captioning in the natural image domain, medical images are very similar to each…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Yuhao Wang

A large-scale image-text pair dataset has greatly contributed to the development of vision-language pre-training (VLP) models, which enable zero-shot or few-shot classification without costly annotation. However, in the medical domain, the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Kihyun You , Jawook Gu , Jiyeon Ham , Beomhee Park , Jiho Kim , Eun Kyoung Hong , Woonhyunk Baek , Byungseok Roh

BACKGROUND: Radiology reports are typically written in a free-text format, making clinical information difficult to extract and use. Recently the adoption of structured reporting (SR) has been recommended by various medical societies thanks…

Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Keegan Quigley , Miriam Cha , Ruizhi Liao , Geeticka Chauhan , Steven Horng , Seth Berkowitz , Polina Golland

Automated structured radiology report generation (SRRG) from chest X-ray images offers significant potential to reduce workload of radiologists by generating reports in structured formats that ensure clarity, consistency, and adherence to…

Machine Learning · Computer Science 2025-10-02 Seongjae Kang , Dong Bok Lee , Juho Jung , Dongseop Kim , Won Hwa Kim , Sunghoon Joo

In this work, we present an approach, which we call Embeddings for Language/Image-aligned X-Rays, or ELIXR, that leverages a language-aligned image encoder combined or grafted onto a fixed LLM, PaLM 2, to perform a broad range of chest…

Chest X-ray (CXR) reporting follows a region-based clinical workflow in which radiologists inspect anatomical regions and integrate localized findings into a final report. However, existing resources for CXR report generation provide these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yichen Zhao , Zelin Peng , Fenghe Tang , Piao Yang , Yu Huang , Wei Shen

Medical report generation is the task of automatically writing radiology reports for chest X-ray images. Manually composing these reports is a time-consuming process that is also prone to human errors. Generating medical reports can…

Computation and Language · Computer Science 2024-10-22 Abdullah , Ameer Hamza , Seong Tae Kim