English
Related papers

Related papers: ChEX: Interactive Localization and Region Descript…

200 papers

Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder-decoder…

Computation and Language · Computer Science 2021-09-28 An Yan , Zexue He , Xing Lu , Jiang Du , Eric Chang , Amilcare Gentili , Julian McAuley , Chun-Nan Hsu

In this work, we study uncertainty estimation for anatomical landmark-based segmentation on chest X-rays. Inspired by hybrid neural network architectures that combine standard image convolutional encoders with graph-based generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Matias Cosarinsky , Nicolas Gaggion , Rodrigo Echeveste , Enzo Ferrante

Radiology report generation (RRG) aims to create free-text radiology reports from clinical imaging. Grounded radiology report generation (GRRG) extends RRG by including the localisation of individual findings on the image. Currently, there…

Medical imaging contains the essential information for rendering diagnostic and treatment decisions. Inspecting (visual perception) and interpreting image to generate a report are tedious clinical routines for a radiologist where automation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Xin Li , Rui Cao , Dongxiao Zhu

Latent Diffusion Models have shown remarkable results in text-guided image synthesis in recent years. In the domain of natural (RGB) images, recent works have shown that such models can be adapted to various vision-language downstream tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Konstantinos Vilouras , Ilias Stogiannidis , Junyu Yan , Alison Q. O'Neil , Sotirios A. Tsaftaris

Interpreting chest radiograph, a.ka. chest x-ray, images is a necessary and crucial diagnostic tool used by medical professionals to detect and identify many diseases that may plague a patient. Although the images themselves contain a…

Image and Video Processing · Electrical Eng. & Systems 2020-07-03 Nikita Albert

Multimodal Large Language Models (MLLMs) have shown success in various general image processing tasks, yet their application in medical imaging is nascent, lacking tailored models. This study investigates the potential of MLLMs in improving…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Ling Yang , Zhanyu Wang , Zhenghao Chen , Xinyu Liang , Luping Zhou

We present a novel framework for explainable labeling and interpretation of medical images. Medical images require specialized professionals for interpretation, and are explained (typically) via elaborate textual reports. Different from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Dwarikanath Mahapatra

We consider the problem of abnormality localization for clinical applications. While deep learning has driven much recent progress in medical imaging, many clinical challenges are not fully addressed, limiting its broader usage. While…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Xi Ouyang , Srikrishna Karanam , Ziyan Wu , Terrence Chen , Jiayu Huo , Xiang Sean Zhou , Qian Wang , Jie-Zhi Cheng

Deep learning models show significant potential for advancing AI-assisted medical diagnostics, particularly in detecting lung cancer through medical image modalities such as chest X-rays. However, the black-box nature of these models poses…

Machine Learning · Computer Science 2025-03-31 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

Deep learning methods, in particular convolutional neural networks, have emerged as a powerful tool in medical image computing tasks. While these complex models provide excellent performance, their black-box nature may hinder real-world…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yuzhe Lu , Adam Perer

Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However,…

Artificial Intelligence · Computer Science 2024-04-01 Seil Kang , Donghyun Kim , Junhyeok Kim , Hyo Kyung Lee , Seong Jae Hwang

This study aimed to develop an algorithm to automatically extract annotations for chest X-ray classification models from German thoracic radiology reports. An automatic label extraction model was designed based on the CheXpert architecture,…

Computation and Language · Computer Science 2023-06-06 Alessandro Wollek , Sardi Hyska , Thomas Sedlmeyr , Philip Haitzer , Johannes Rueckel , Bastian O. Sabel , Michael Ingrisch , Tobias Lasser

The COVID-19 pandemic has strained global public health, necessitating accurate diagnosis and intervention to control disease spread and reduce mortality rates. This paper introduces an interpretable deep survival prediction model designed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhusi Zhong , Jie Li , Zhuoqi Ma , Scott Collins , Harrison Bai , Paul Zhang , Terrance Healey , Xinbo Gao , Michael K. Atalay , Zhicheng Jiao

A radiology report comprises presentation-style vocabulary, which ensures clarity and organization, and factual vocabulary, which provides accurate and objective descriptions based on observable findings. While manually writing these…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Kang Liu , Zhuoqi Ma , Mengmeng Liu , Zhicheng Jiao , Xiaolu Kang , Qiguang Miao , Kun Xie

In this paper, our focus is on constructing models to assist a clinician in the diagnosis of COVID-19 patients in situations where it is easier and cheaper to obtain X-ray data than to obtain high-quality images like those from CT scans.…

Image and Video Processing · Electrical Eng. & Systems 2021-02-15 Rishab Khincha , Soundarya Krishnan , Tirtharaj Dash , Lovekesh Vig , Ashwin Srinivasan

Most deep learning algorithms lack explanations for their predictions, which limits their deployment in clinical practice. Approaches to improve explainability, especially in medical imaging, have often been shown to convey limited…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Maxime Kayser , Cornelius Emde , Oana-Maria Camburu , Guy Parsons , Bartlomiej Papiez , Thomas Lukasiewicz

Before the recent success of deep learning methods for automated medical image analysis, practitioners used handcrafted radiomic features to quantitatively describe local patches of medical images. However, extracting discriminative…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Yan Han , Gregory Holste , Ying Ding , Ahmed Tewfik , Yifan Peng , Zhangyang Wang

The automatic detection of critical findings in chest X-rays (CXR), such as pneumothorax, is important for assisting radiologists in their clinical workflow like triaging time-sensitive cases and screening for incidental findings. While…

Machine Learning · Computer Science 2020-01-27 Evan Schwab , André Gooßen , Hrishikesh Deshpande , Axel Saalbach

Generating medical reports from chest X-ray images is a critical and time-consuming task for radiologists, especially in emergencies. To alleviate the stress on radiologists and reduce the risk of misdiagnosis, numerous research efforts…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Qiang Sun , Zongcheng Ji , Yinlong Xiao , Peng Chang , Jun Yu