English
Related papers

Related papers: Prompt-Guided Generation of Structured Chest X-Ray…

200 papers

As medical imaging is central to diagnostic processes, automating the generation of radiology reports has become increasingly relevant to assist radiologists with their heavy workloads. Most current methods rely solely on global image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Hamza Kalisch , Fabian Hörst , Jens Kleesiek , Ken Herrmann , Constantin Seibold

AI-assisted report generation offers the opportunity to reduce radiologists' workload stemming from expanded screening guidelines, complex cases and workforce shortages, while maintaining diagnostic accuracy. In addition to describing…

Gathering manually annotated images for the purpose of training a predictive model is far more challenging in the medical domain than for natural images as it requires the expertise of qualified radiologists. We therefore propose to take…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Aydan Gasimova , Giovanni Montana , Daniel Rueckert

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Hao Yang , Xinlong Liang , Zhang Li , Yue Sun , Zheyu Hu , Xinghe Xie , Behdad Dashtbozorg , Jincheng Huang , Shiwei Zhu , Luyi Han , Jiong Zhang , Shanshan Wang , Ritse Mann , Qifeng Yu , Tao Tan

Background: Large language models (LLMs) are gaining use in clinical settings, but their performance can suffer with incomplete radiology reports. We tested whether multimodal LLMs (using text and images) could improve accuracy and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Choonghan Kim , Seonhee Cho , Joo Heung Yoon

Radiology reports play a critical role in communicating medical findings to physicians. In each report, the impression section summarizes essential radiology findings. In clinical practice, writing impression is highly demanded yet…

Computation and Language · Computer Science 2021-12-21 Jinpeng Hu , Jianling Li , Zhihong Chen , Yaling Shen , Yan Song , Xiang Wan , Tsung-Hui Chang

Generative AI models provide a wide range of tools capable of performing complex tasks in a fraction of the time it would take a human. Among these, Large Language Models (LLMs) stand out for their ability to generate diverse texts, from…

Computation and Language · Computer Science 2024-10-07 Baldomero R. Árbol , Dan Casas

The chest X-Ray (CXR) is the one of the most common clinical exam used to diagnose thoracic diseases and abnormalities. The volume of CXR scans generated daily in hospitals is huge. Therefore, an automated diagnosis system able to save the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Shuai Zhang , Xiaoyan Xin , Yang Wang , Yachong Guo , Qiuqiao Hao , Xianfeng Yang , Jun Wang , Jian Zhang , Bing Zhang , Wei Wang

Anomaly detection in chest X-rays is a critical task. Most methods mainly model the distribution of normal images, and then regard significant deviation from normal distribution as anomaly. Recently, CLIP-based methods, pre-trained on a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zhichao Sun , Yuliang Gu , Yepeng Liu , Zerui Zhang , Zhou Zhao , Yongchao Xu

Artificial intelligence (AI)-based chest X-ray (CXR) interpretation assistants have demonstrated significant progress and are increasingly being applied in clinical settings. However, contemporary medical AI models often adhere to a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jinquan Guan , Qi Chen , Lizhou Liang , Yuhang Liu , Vu Minh Hieu Phan , Minh-Son To , Jian Chen , Yutong Xie

There is growing interest in applying AI to radiology report generation, particularly for chest X-rays (CXRs). This paper investigates whether incorporating pixel-level information through segmentation masks can improve fine-grained image…

Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior…

Machine Learning · Computer Science 2024-05-24 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Despite the reduction in turn-around times in radiology reports with the use of speech recognition software, persistent communication errors can significantly impact the interpretation of the radiology report. Pre-filling a radiology report…

Computation and Language · Computer Science 2023-10-11 Qingqing Zhu , Tejas Sudharshan Mathai , Pritam Mukherjee , Yifan Peng , Ronald M. Summers , Zhiyong Lu

This study explores the capability of Large Language Models (LLMs) to evaluate causality in causal graphs generated by conventional statistical causal discovery methods-a task traditionally reliant on manual assessment by human subject…

Computation and Language · Computer Science 2025-04-16 Yuni Susanti , Nina Holsmoelle

Recent medical multimodal foundation models are built as multimodal LLMs (MLLMs) by connecting a CLIP-pretrained vision encoder to an LLM using LLaVA-style finetuning. This two-stage, decoupled approach introduces a projection layer that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Ashwin Kumar , Robbie Holland , Corey Barrett , Jangwon Kim , Maya Varma , Zhihong Chen , Yunhe Gao , Greg Zaharchuk , Tara Taghavi , Krishnaram Kenthapadi , Akshay Chaudhari

Mammography report generation is a critical yet underexplored task in medical AI, characterized by challenges such as multiview image reasoning, high-resolution visual cues, and unstructured radiologic language. In this work, we introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Nak-Jun Sung , Donghyun Lee , Bo Hwa Choi , Chae Jung Park

Radiology report generation from chest X-rays is an important task in artificial intelligence with the potential to greatly reduce radiologists' workload and shorten patient wait times. Despite recent advances, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Puzhen Wu , Hexin Dong , Yi Lin , Yihao Ding , Yifan Peng

Medical imaging plays a crucial role in diagnosis, with radiology reports serving as vital documentation. Automating report generation has emerged as a critical need to alleviate the workload of radiologists. While machine learning has…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Ibrahim Ethem Hamamci , Sezgin Er , Bjoern Menze