English
Related papers

Related papers: Multimodal Image-Text Matching Improves Retrieval-…

200 papers

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

To effectively train medical students to become qualified radiologists, a large number of X-ray images collected from patients with diverse medical conditions are needed. However, due to data privacy concerns, such images are typically…

Image and Video Processing · Electrical Eng. & Systems 2020-06-19 Xingyi Yang , Nandiraju Gireesh , Eric Xing , Pengtao Xie

Recent advances in text-conditioned image generation diffusion models have begun paving the way for new opportunities in modern medical domain, in particular, generating Chest X-rays (CXRs) from diagnostic reports. Nonetheless, to further…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Woojung Han , Chanyoung Kim , Dayun Ju , Yumin Shim , Seong Jae Hwang

Decision support tools that rely on supervised learning require large amounts of expert annotations. Using past radiological reports obtained from hospital archiving systems has many advantages as training data above manual single-class…

Machine Learning · Computer Science 2021-05-21 Aydan Gasimova

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

Chest Xray imaging is a widely used diagnostic tool in modern medicine, and its high utilization creates substantial workloads for radiologists. To alleviate this burden, vision language models are increasingly applied to automate Chest…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shaoyang Zhou , Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Medical report generation from X-ray images is a challenging task, particularly in an unpaired setting where paired image-report data is unavailable for training. To address this challenge, we propose a novel model that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

In cross-modal retrieval tasks, such as image-to-report and report-to-image retrieval, accurately aligning medical images with relevant text reports is essential but challenging due to the inherent ambiguity and variability in medical data.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Shreyank N Gowda , Xiaobo Jin , Christian Wagner

Automatic radiology report generation has been an attracting research problem towards computer-aided diagnosis to alleviate the workload of doctors in recent years. Deep learning techniques for natural image captioning are successfully…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Yixiao Zhang , Xiaosong Wang , Ziyue Xu , Qihang Yu , Alan Yuille , Daguang Xu

The automatic clinical caption generation problem is referred to as proposed model combining the analysis of frontal chest X-Ray scans with structured patient information from the radiology records. We combine two language models, the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Alexander Selivanov , Oleg Y. Rogov , Daniil Chesakov , Artem Shelmanov , Irina Fedulova , Dmitry V. Dylov

Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jun Li , Tongkun Su , Baoliang Zhao , Faqin Lv , Qiong Wang , Nassir Navab , Ying Hu , Zhongliang Jiang

X-ray image based medical report generation achieves significant progress in recent years with the help of the large language model, however, these models have not fully exploited the effective information in visual image regions, resulting…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Xiao Wang , Fuling Wang , Haowen Wang , Bo Jiang , Chuanfu Li , Yaowei Wang , Yonghong Tian , Jin Tang

We present a novel approach to Chest X-ray (CXR) Visual Question Answering (VQA), addressing both single-image image-difference questions. Single-image questions focus on abnormalities within a specific CXR ("What abnormalities are seen in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Francesco Dalla Serra , Patrick Schrempf , Chaoyang Wang , Zaiqiao Meng , Fani Deligianni , Alison Q. O'Neil

Multi-modal data abounds in biomedicine, such as radiology images and reports. Interpreting this data at scale is essential for improving clinical care and accelerating clinical research. Biomedical text with its complex semantics poses…

As artificial intelligence (AI) becomes increasingly central to healthcare, the demand for explainable and trustworthy models is paramount. Current report generation systems for chest X-rays (CXR) often lack mechanisms for validating…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Sayeh Gholipour Picha , Dawood Al Chanti , Alice Caplier

Vision-language pretraining has advanced image-text alignment, yet progress in radiology remains constrained by the heterogeneity of clinical reports, including abbreviations, impression-only notes, and stylistic variability. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hanbin Ko , Gihun Cho , Inhyeok Baek , Donguk Kim , Joonbeom Koo , Changi Kim , Dongheon Lee , Chang Min Park

Chest radiographs (CXRs) are among the most common tests in medicine. Automated image interpretation may reduce radiologists\' workload and expand access to diagnostic expertise. Deep learning multi-task and foundation models have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-09-11 Lauren H. Cooke , Matthias Jung , Jan M. Brendel , Nora M. Kerkovits , Borek Foldyna , Michael T. Lu , Vineet K. Raghu

The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Shuai Zhang , Xiaoyan Xin , Yang Wang , Yachong Guo , Qiuqiao Hao , Xianfeng Yang , Jun Wang , Jian Zhang , Bing Zhang , Wei Wang

Multimodal foundation models hold significant potential for automating radiology report generation, thereby assisting clinicians in diagnosing cardiac diseases. However, generated reports often suffer from serious factual inaccuracy. In…

Computation and Language · Computer Science 2025-02-07 Liwen Sun , James Zhao , Megan Han , Chenyan Xiong