English

From Text to Image: Exploring GPT-4Vision's Potential in Advanced Radiological Analysis across Subspecialties

Image and Video Processing 2026-01-23 v2 Computer Vision and Pattern Recognition
Authors: Felix Busch , Tianyu Han , Marcus Makowski , Daniel Truhn , Keno Bressem , Lisa Adams
View on arXiv ↗ PDF ↗ DOI ↗

Abstract

The study evaluates and compares GPT-4 and GPT-4Vision for radiological tasks, suggesting GPT-4Vision may recognize radiological features from images, thereby enhancing its diagnostic potential over text-based descriptions.

Keywords

GPT-4Vision radiological analysis medical imaging diagnostic potential text-to-image

Cite

@article{arxiv.2311.14777,
  title  = {From Text to Image: Exploring GPT-4Vision's Potential in Advanced Radiological Analysis across Subspecialties},
  author = {Felix Busch and Tianyu Han and Marcus Makowski and Daniel Truhn and Keno Bressem and Lisa Adams},
  journal= {arXiv preprint arXiv:2311.14777},
  year   = {2026}
}

Related papers

View all related →
Image and Video Processing · Electrical Eng. & Systems
Evaluating GPT-4 with Vision on Detection of Radiological Findings on Chest Radiographs
Yiliang Zhou, Hanley Ong, Patrick Kennedy, Carol Wu +5
2024-05-15
Image and Video Processing · Electrical Eng. & Systems
GPT-4 Vision on Medical Image Classification -- A Case Study on COVID-19 Dataset
Ruibo Chen, Tianyi Xiong, Yihan Wu, Guodong Liu +5
2023-10-31
Computer Vision and Pattern Recognition · Computer Science
A Systematic Evaluation of GPT-4V's Multimodal Capability for Medical Image Analysis
Yingshu Li, Yunyi Liu, Zhanyu Wang, Xinyu Liang +6
2024-02-01
Computer Vision and Pattern Recognition · Computer Science
OpenAI ChatGPT interprets Radiological Images: GPT-4 as a Medical Doctor for a Fast Check-Up
Omer Aydin, Enis Karaarslan
2025-02-04
Image and Video Processing · Electrical Eng. & Systems
Holistic Evaluation of GPT-4V for Biomedical Imaging
Zhengliang Liu, Hanqi Jiang, Tianyang Zhong, Zihao Wu +46
2023-12-12
Computer Vision and Pattern Recognition · Computer Science
Multimodal ChatGPT for Medical Applications: an Experimental Study of GPT-4V
Zhiling Yan, Kai Zhang, Rong Zhou, Lifang He +2
2023-10-31
Artificial Intelligence · Computer Science
Assessing the Aesthetic Evaluation Capabilities of GPT-4 with Vision: Insights from Group and Individual Assessments
Yoshia Abe, Tatsuya Daikoku, Yasuo Kuniyoshi
2024-03-07
Computer Vision and Pattern Recognition · Computer Science
GPT-4V(ision) Unsuitable for Clinical Care and Education: A Clinician-Evaluated Assessment
Senthujan Senkaiahliyan, Augustin Toma, Jun Ma, An-Wen Chan +5
2024-03-20
Computer Vision and Pattern Recognition · Computer Science
GPT-4V(ision) as a Generalist Evaluator for Vision-Language Tasks
Xinlu Zhang, Yujie Lu, Weizhi Wang, An Yan +6
2023-11-03
Image and Video Processing · Electrical Eng. & Systems
An Early Investigation into the Utility of Multimodal Large Language Models in Medical Imaging
Sulaiman Khan, Md. Rafiul Biswas, Alina Murad, Hazrat Ali +1
2024-06-05
Computation and Language · Computer Science
An Early Evaluation of GPT-4V(ision)
Yang Wu, Shilong Wang, Hao Yang, Tian Zheng +3
2023-10-26
Computer Vision and Pattern Recognition · Computer Science
GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?
Wenhao Wu, Huanjin Yao, Mengxi Zhang, Yuxin Song +2
2024-03-13
Computation and Language · Computer Science
Notes on Applicability of GPT-4 to Document Understanding
Łukasz Borchmann
2024-05-29
Computation and Language · Computer Science
Evaluation of GPT-4 for chest X-ray impression generation: A reader study on performance and perception
Sebastian Ziegelmayer, Alexander W. Marka, Nicolas Lenhart, Nadja Nehls +6
2023-12-27
Computer Vision and Pattern Recognition · Computer Science
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li +1
2023-10-03
Image and Video Processing · Electrical Eng. & Systems
Advanced Chest X-Ray Analysis via Transformer-Based Image Descriptors and Cross-Model Attention Mechanism
Lakshita Agarwal, Bindu Verma
2025-04-24
Computation and Language · Computer Science
Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Task
Zihao Wu, Lu Zhang, Chao Cao, Xiaowei Yu +11
2023-04-19
Computer Vision and Pattern Recognition · Computer Science
An Empirical Study of GPT-4o Image Generation Capabilities
Sixiang Chen, Jinbin Bai, Zhuoran Zhao, Tian Ye +15
2025-04-14
Computer Vision and Pattern Recognition · Computer Science
Can GPT-4V(ision) Serve Medical Applications? Case Studies on GPT-4V for Multimodal Medical Diagnosis
Chaoyi Wu, Jiayu Lei, Qiaoyu Zheng, Weike Zhao +7
2023-12-05
Computation and Language · Computer Science
GPT-4 Technical Report
OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal +277
2024-03-11
Computation and Language · Computer Science
Exploring the Boundaries of GPT-4 in Radiology
Qianchu Liu, Stephanie Hyland, Shruthi Bannur, Kenza Bouzid +15
2023-10-24
Computation and Language · Computer Science
Translating Radiology Reports into Plain Language using ChatGPT and GPT-4 with Prompt Learning: Promising Results, Limitations, and Potential
Qing Lyu, Josh Tan, Michael E. Zapadka, Janardhana Ponnatapura +4
2024-10-22
Artificial Intelligence · Computer Science
How Well Do Multi-modal LLMs Interpret CT Scans? An Auto-Evaluation Framework for Analyses
Qingqing Zhu, Benjamin Hou, Tejas S. Mathai, Pritam Mukherjee +6
2024-06-19
Artificial Intelligence · Computer Science
MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis
Asma Alkhaldi, Raneem Alnajim, Layan Alabdullatef, Rawan Alyahya +4
2024-07-08
Computer Vision and Pattern Recognition · Computer Science
Hidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicine
Qiao Jin, Fangyuan Chen, Yiliang Zhou, Ziyang Xu +14
2024-09-04