English
Related papers

Related papers: RadDiff: Describing Differences in Radiology Image…

200 papers

Vision-language pre-training for chest X-rays has made significant strides, primarily by utilizing paired radiographs and radiology reports. However, existing approaches often face challenges in encoding medical knowledge effectively. While…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Haozhe Luo , Ziyu Zhou , Corentin Royer , Anjany Sekuboyina , Bjoern Menze

Biomedical imaging datasets are often small and biased, meaning that real-world performance of predictive models can be substantially lower than expected from internal testing. This work proposes using generative image editing to simulate…

Developing a generalist radiology diagnosis system can greatly enhance clinical diagnostics. In this paper, we introduce RadDiag, a foundational model supporting 2D and 3D inputs across various modalities and anatomies, using a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Qiaoyu Zheng , Weike Zhao , Chaoyi Wu , Xiaoman Zhang , Lisong Dai , Hengyu Guan , Yuehua Li , Ya Zhang , Yanfeng Wang , Weidi Xie

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Annually and globally, over three billion radiography examinations and computer tomography scans result in mostly unstructured radiology reports containing free text. Despite the potential benefits of structured reporting, its adoption is…

Computation and Language · Computer Science 2024-06-25 Daniel Reichenpfader , Jonas Knupp , André Sander , Kerstin Denecke

Vision-language models (VLMs) exhibit strong zero-shot generalization on natural images and show early promise in interpretable medical image analysis. However, existing benchmarks do not systematically evaluate whether these models truly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Tianhong Zhou , Yin Xu , Yingtao Zhu , Chuxi Xiao , Haiyang Bian , Lei Wei , Xuegong Zhang

Medical image segmentation is a challenging task with inherent ambiguity and high uncertainty, attributed to factors such as unclear tumor boundaries and multiple plausible annotations. The accuracy and diversity of segmentation masks are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Tao Chen , Chenhui Wang , Hongming Shan

Agentic systems offer a potential path to solve complex clinical tasks through collaboration among specialized agents, augmented by tool use and external knowledge bases. Nevertheless, for chest X-ray (CXR) interpretation, prevailing…

Multiagent Systems · Computer Science 2026-04-16 Kai Zhang , Corey D Barrett , Jangwon Kim , Lichao Sun , Tara Taghavi , Krishnaram Kenthapadi

Recent advances in deep learning have enabled researchers to explore tasks at the intersection of computer vision and natural language processing, such as image captioning, visual question answering, visual dialogue, and visual language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sonit Singh

In recent years, machine learning-based clinical decision support systems (CDSS) have played a key role in the analysis of several medical conditions. Despite their promising capabilities, the lack of transparency in AI models poses…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Francesco Prinzi , Carmelo Militello , Calogero Zarcaro , Tommaso Vincenzo Bartolotta , Salvatore Gaglio , Salvatore Vitabile

Medical image segmentation has been significantly advanced with the rapid development of deep learning (DL) techniques. Existing DL-based segmentation models are typically discriminative; i.e., they aim to learn a mapping from the input…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Tao Chen , Chenhui Wang , Zhihao Chen , Yiming Lei , Hongming Shan

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

Deep learning based automated pathological diagnosis has markedly improved diagnostic efficiency and reduced variability between observers, yet its clinical adoption remains limited by opaque model decisions and a lack of traceable…

Image Difference Captioning (IDC) generates natural language descriptions that precisely identify differences between two images, serving as a key benchmark for fine-grained change perception, cross-modal reasoning, and image editing data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yuancheng Wei , Haojie Zhang , Linli Yao , Lei Li , Jiali Chen , Tao Huang , Yiting Lu , Duojun Huang , Xin Li , Zhao Zhong

We investigate the problem of identifying objects that have been added, removed, or moved between a pair of captures (images or videos) of the same scene at different times. Accurately identifying verifiable changes is extremely challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yuqun Wu , Chih-hao Lin , Henry Che , Aditi Tiwari , Chuhang Zou , Shenlong Wang , Derek Hoiem

The demand for high-quality medical imaging in clinical practice and assisted diagnosis has made 3D image reconstruction in radiological imaging a key research focus. Artificial intelligence (AI) has emerged as a promising approach for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Yuezhe Yang , Lei Bi , Boyu Yang , Yaqian Wang , Yang He , Yige Peng , Zhe Jin , Xingbo Dong , Jinman Kim

Evaluating the clinical correctness and reasoning fidelity of automatically generated medical imaging reports remains a critical yet unresolved challenge. Existing evaluation methods often fail to capture the structured diagnostic logic…

Artificial Intelligence · Computer Science 2026-01-26 Suzhong Fu , Jingqi Dong , Xuan Ding , Rui Sun , Yiming Yang , Shuguang Cui , Zhen Li

Cancer screening is a reasoning task. A radiologist observes findings, compares them to prior scans, integrates clinical context, and reaches a diagnostic conclusion confirmed by pathology. We present RadThinking, a Visual Question…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Wenxuan Li , Pedro R. A. S. Bassi , Xinze Zhou , Jakob Wasserthal , Alan L. Yuille , Zongwei Zhou

Vision-language models (VLM) have markedly advanced AI-driven interpretation and reporting of complex medical imaging, such as computed tomography (CT). Yet, existing methods largely relegate clinicians to passive observers of final…

Radiology reports remain the primary mechanism by which imaging findings are communicated to clinical teams. However, much of the structured information behind these reports, including measurements, image evidence, prior comparisons, lesion…

Computation and Language · Computer Science 2026-05-26 Houman Kazemzadeh , Kamyar Naderi