English
Related papers

Related papers: Variational Topic Inference for Chest X-Ray Report…

200 papers

A chest X-ray radiology report describes abnormal findings not only from X-ray obtained at current examination, but also findings on disease progression or change in device placement with reference to the X-ray from previous examination.…

Multimedia · Computer Science 2024-05-07 Zhichuan Wang , Kinhei Lee , Qiao Deng , Tiffany Y. So , Wan Hang Chiu , Yeung Yu Hui , Bingjing Zhou , Edward S. Hui

Automatic radiology report generation has been an attracting research problem towards computer-aided diagnosis to alleviate the workload of doctors in recent years. Deep learning techniques for natural image captioning are successfully…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Yixiao Zhang , Xiaosong Wang , Ziyue Xu , Qihang Yu , Alan Yuille , Daguang Xu

Document editing has become a pervasive component of the production of information, with version control systems enabling edits to be efficiently stored and applied. In light of this, the task of learning distributed representations of…

Computation and Language · Computer Science 2021-01-05 Edison Marrese-Taylor , Machel Reid , Yutaka Matsuo

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Automated radiology report generation is essential in clinical practice. However, diagnosing radiological images typically requires physicians 5-10 minutes, resulting in a waste of valuable healthcare resources. Existing studies have not…

Multimedia · Computer Science 2025-09-16 Jing Xiao , Hongfei Liu , Ruiqi Dong , Jimin Liu , Haoyong Yu

Radiology report generation aims to automatically provide clinically meaningful descriptions of radiology images such as MRI and X-ray. Although great success has been achieved in natural scene image captioning tasks, radiology report…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Automated chest radiographs interpretation requires both accurate disease classification and detailed radiology report generation, presenting a significant challenge in the clinical workflow. Current approaches either focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Difei Gu , Yunhe Gao , Yang Zhou , Mu Zhou , Dimitris Metaxas

Reading and interpreting chest X-ray images is one of the most radiologist's routines. However, it still can be challenging, even for the most experienced ones. Therefore, we proposed a multi-model deep learning-based automated chest X-ray…

Image and Video Processing · Electrical Eng. & Systems 2024-01-31 Arief Purnama Muharram , Hollyana Puteri Haryono , Abassi Haji Juma , Ira Puspasari , Nugraha Priya Utama

With the emergence of vision language models in the medical imaging domain, numerous studies have focused on two dominant research activities: (1) report generation from Chest X-rays (CXR), and (2) synthetic scan generation from text or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Santosh Sanjeev , Fadillah Adamsyah Maani , Arsen Abzhanov , Vijay Ram Papineni , Ibrahim Almakky , Bartłomiej W. Papież , Mohammad Yaqub

Report generation models offer fine-grained textual interpretations of medical images like chest X-rays, yet they often lack interactivity (i.e. the ability to steer the generation process through user queries) and localized…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Philip Müller , Georgios Kaissis , Daniel Rueckert

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

Objective Renal cancer is a common malignancy and a major cause of cancer-related deaths. Computed tomography (CT) is central to early detection, staging, and treatment planning. However, the growing CT workload increases radiologists'…

Image and Video Processing · Electrical Eng. & Systems 2025-10-17 Renjie Liang , Zhengkang Fan , Jinqian Pan , Chenkun Sun , Bruce Daniel Steinberg , Russell Terry , Jie Xu

Radiology report generation aims to automatically generate a clinically accurate and coherent paragraph from the X-ray image, which could relieve radiologists from the heavy burden of report writing. Although various image caption methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Zhongzhen Huang , Xiaofan Zhang , Shaoting Zhang

In medical reporting, the accuracy of radiological reports, whether generated by humans or machine learning algorithms, is critical. We tackle a new task in this paper: image-conditioned autocorrection of inaccuracies within these reports.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Arnold Caleb Asiimwe , Dídac Surís , Pranav Rajpurkar , Carl Vondrick

Observing a set of images and their corresponding paragraph-captions, a challenging task is to learn how to produce a semantically coherent paragraph to describe the visual content of an image. Inspired by recent successes in integrating…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Dandan Guo , Ruiying Lu , Bo Chen , Zequn Zeng , Mingyuan Zhou

Automatic report generation has arisen as a significant research area in computer-aided diagnosis, aiming to alleviate the burden on clinicians by generating reports automatically based on medical images. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jun Li , Tongkun Su , Baoliang Zhao , Faqin Lv , Qiong Wang , Nassir Navab , Ying Hu , Zhongliang Jiang

Automatic radiology report generation is challenging as medical images or reports are usually similar to each other due to the common content of anatomy. This makes a model hard to capture the uniqueness of individual images and is prone to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Bhanu Prakash Voutharoja , Lei Wang , Luping Zhou

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

Computation and Language · Computer Science 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

Medical report generation is a challenging task since it is time-consuming and requires expertise from experienced radiologists. The goal of medical report generation is to accurately capture and describe the image findings. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Yu-Jen Chen , Wei-Hsiang Shen , Hao-Wei Chung , Ching-Hao Chiu , Da-Cheng Juan , Tsung-Ying Ho , Chi-Tung Cheng , Meng-Lin Li , Tsung-Yi Ho

X-ray image based medical report generation achieves significant progress in recent years with the help of the large language model, however, these models have not fully exploited the effective information in visual image regions, resulting…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Xiao Wang , Fuling Wang , Haowen Wang , Bo Jiang , Chuanfu Li , Yaowei Wang , Yonghong Tian , Jin Tang