English
Related papers

Related papers: Fine-Grained Image-Text Alignment in Medical Imagi…

200 papers

Mix-up is a key technique for consistency regularization-based semi-supervised learning methods, blending two or more images to generate strong-perturbed samples for strong-weak pseudo supervision. Existing mix-up operations are performed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zhiqiang Shen , Peng Cao , Junming Su , Jinzhu Yang , Osmar R. Zaiane

Developing an interpretable system for generating reports in chest X-ray (CXR) analysis is becoming increasingly crucial in Computer-aided Diagnosis (CAD) systems, enabling radiologists to comprehend the decisions made by these systems.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Trong Thang Pham , Ngoc-Vuong Ho , Nhat-Tan Bui , Thinh Phan , Patel Brijesh , Donald Adjeroh , Gianfranco Doretto , Anh Nguyen , Carol C. Wu , Hien Nguyen , Ngan Le

Medical report generation from X-ray images is a challenging task, particularly in an unpaired setting where paired image-report data is unavailable for training. To address this challenge, we propose a novel model that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Text-To-Image (TTI) generation is significant for controlled and diverse image generation with broad potential applications. Although current medical TTI methods have made some progress in report-to-Chest-Xray (CXR) generation, their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Peng Huang , Bowen Guo , Shuyu Liang , Junhu Fu , Yuanyuan Wang , Yi Guo

Automated radiology report generation from 3D CT volumes often suffers from incomplete pathology coverage. We provide empirical evidence that this limitation stems from a representational bottleneck: contrastive 3D CT embeddings encode…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Renjie Liang , Yiling Ma , Yang Xing , Zhengkang Fan , Jinqian Pan , Chengkun Sun , Li Li , Kuang Gong , Jie Xu

Automated Radiology report generation (RRG) aims at producing detailed descriptions of medical images, reducing radiologists' workload and improving access to high-quality diagnostic services. Existing encoder-decoder models only rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Quang Vinh Nguyen , Minh Duc Nguyen , Thanh Hoang Son Vo , Hyung-Jeong Yang , Soo-Hyung Kim

Automatic generation of medical reports from X-ray images can assist radiologists to perform the time-consuming and yet important reporting task. Yet, achieving clinically accurate generated reports remains challenging. Modeling the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Sixing Yan , William K. Cheung , Keith Chiu , Terence M. Tong , Charles K. Cheung , Simon See

Data scarcity and privacy concerns limit the availability of high-quality medical images for public use, which can be mitigated through medical image synthesis. However, current medical image synthesis methods often struggle to accurately…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Wenting Chen , Pengyu Wang , Hui Ren , Lichao Sun , Quanzheng Li , Yixuan Yuan , Xiang Li

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

Integrating multi-modal clinical data, such as electronic health records (EHR) and chest X-ray images (CXR), is particularly beneficial for clinical prediction tasks. However, in a temporal setting, multi-modal data are often inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Wenfang Yao , Chen Liu , Kejing Yin , William K. Cheung , Jing Qin

Advances in multi-spectral detectors are causing a paradigm shift in X-ray Computed Tomography (CT). Spectral information acquired from these detectors can be used to extract volumetric material composition maps of the object of interest.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Mathé T. Zeegers , Ajinkya Kadu , Tristan van Leeuwen , Kees Joost Batenburg

This study investigates the integration of diverse patient data sources into multimodal language models for automated chest X-ray (CXR) report generation. Traditionally, CXR report generation relies solely on CXR images and limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Aaron Nicolson , Shengyao Zhuang , Jason Dowling , Bevan Koopman

Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive ability to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Hang Hua , Jing Shi , Kushal Kafle , Simon Jenni , Daoan Zhang , John Collomosse , Scott Cohen , Jiebo Luo

Our paper focuses on automating the generation of medical reports from chest X-ray image inputs, a critical yet time-consuming task for radiologists. Unlike existing medical re-port generation efforts that tend to produce human-readable…

Computation and Language · Computer Science 2021-08-30 Hoang T. N. Nguyen , Dong Nie , Taivanbat Badamdorj , Yujie Liu , Yingying Zhu , Jason Truong , Li Cheng

The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Shuai Zhang , Xiaoyan Xin , Yang Wang , Yachong Guo , Qiuqiao Hao , Xianfeng Yang , Jun Wang , Jian Zhang , Bing Zhang , Wei Wang

In medical reporting, the accuracy of radiological reports, whether generated by humans or machine learning algorithms, is critical. We tackle a new task in this paper: image-conditioned autocorrection of inaccuracies within these reports.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Arnold Caleb Asiimwe , Dídac Surís , Pranav Rajpurkar , Carl Vondrick

Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images. However, the subtle visual nuances and domain-specific terminology…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Kai Shu , Yuzhuo Jia , Ziyang Zhang , Jiechao Gao

Chest X-ray radiographs (CXRs) play a pivotal role in diagnosing and monitoring cardiopulmonary diseases. However, lung opacities in CXRs frequently obscure anatomical structures, impeding clear identification of lung borders and…

Image and Video Processing · Electrical Eng. & Systems 2025-03-30 Junzhi Ning , Dominic Marshall , Yijian Gao , Xiaodan Xing Yang Nan , Yingying Fang , Sheng Zhang , Matthieu Komorowski , Guang Yang

Radiology reports are detailed text descriptions of the content of medical scans. Each report describes the presence/absence and location of relevant clinical findings, commonly including comparison with prior exams of the same patient to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Francesco Dalla Serra , Chaoyang Wang , Fani Deligianni , Jeffrey Dalton , Alison Q O'Neil

The automation of chest X-ray reporting has garnered significant interest due to the time-consuming nature of the task. However, the clinical accuracy of free-text reports has proven challenging to quantify using natural language processing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Matthias Keicher , Kamilia Zaripova , Tobias Czempiel , Kristina Mach , Ashkan Khakzar , Nassir Navab