English
Related papers

Related papers: RadGenome-Chest CT: A Grounded Vision-Language Dat…

200 papers

Computed Tomography (CT) is one of the most popular modalities for medical imaging. By far, CT images have contributed to the largest publicly available datasets for volumetric medical segmentation tasks, covering full-body anatomical…

Image and Video Processing · Electrical Eng. & Systems 2024-11-25 Jin Ye , Ying Chen , Yanjun Li , Haoyu Wang , Zhongying Deng , Ziyan Huang , Yanzhou Su , Chenglong Ma , Yuanfeng Ji , Junjun He

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

We present ReXVQA, the largest and most comprehensive benchmark for visual question answering (VQA) in chest radiology, comprising approximately 696,000 questions paired with 160,000 chest X-rays studies across training, validation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Ankit Pal , Jung-Oh Lee , Xiaoman Zhang , Malaikannan Sankarasubbu , Seunghyeon Roh , Won Jung Kim , Meesun Lee , Pranav Rajpurkar

Artificial intelligence (AI) has significant potential in healthcare applications, but its training and deployment faces challenges due to healthcare's diverse data, complex tasks, and the need to preserve privacy. Foundation models that…

Radiology reports convey detailed clinical observations and capture diagnostic reasoning that evolves over time. However, existing evaluation methods are limited to single-report settings and rely on coarse metrics that fail to capture…

Objective Renal cancer is a common malignancy and a major cause of cancer-related deaths. Computed tomography (CT) is central to early detection, staging, and treatment planning. However, the growing CT workload increases radiologists'…

Image and Video Processing · Electrical Eng. & Systems 2025-10-17 Renjie Liang , Zhengkang Fan , Jinqian Pan , Chenkun Sun , Bruce Daniel Steinberg , Russell Terry , Jie Xu

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

Automated CT report generation plays a crucial role in improving diagnostic accuracy and clinical workflow efficiency. However, existing methods lack interpretability and impede patient-clinician understanding, while their static nature…

Image and Video Processing · Electrical Eng. & Systems 2025-03-06 Yannian Gu , Wenhui Lei , Hanyu Chen , Xiaofan Zhang , Shaoting Zhang

Medical image grounding aims to align natural language phrases with specific regions in medical images, serving as a foundational task for intelligent diagnosis, visual question answering (VQA), and automated report generation (MRG).…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ziye Deng , Ruihan He , Jiaxiang Liu , Yuan Wang , Zijie Meng , Songtao Jiang , Yong Xie , Zuozhu Liu

Automated chest radiographs interpretation requires both accurate disease classification and detailed radiology report generation, presenting a significant challenge in the clinical workflow. Current approaches either focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Difei Gu , Yunhe Gao , Yang Zhou , Mu Zhou , Dimitris Metaxas

Deep learning in medical imaging often requires large-scale, high-quality data or initiation with suitably pre-trained weights. However, medical datasets are limited by data availability, domain-specific knowledge, and privacy concerns, and…

Image and Video Processing · Electrical Eng. & Systems 2023-12-12 Zelong Liu , Alexander Zhou , Arnold Yang , Alara Yilmaz , Maxwell Yoo , Mikey Sullivan , Catherine Zhang , James Grant , Daiqing Li , Zahi A. Fayad , Sean Huver , Timothy Deyer , Xueyan Mei

Radiologists are tasked with interpreting a large number of images in a daily base, with the responsibility of generating corresponding reports. This demanding workload elevates the risk of human error, potentially leading to treatment…

Image and Video Processing · Electrical Eng. & Systems 2024-07-31 Jiayu Lei , Xiaoman Zhang , Chaoyi Wu , Lisong Dai , Ya Zhang , Yanyong Zhang , Yanfeng Wang , Weidi Xie , Yuehua Li

Chest X-rays (CXRs) are among the most frequently performed imaging examinations worldwide, yet rising imaging volumes increase radiologist workload and the risk of diagnostic errors. Although artificial intelligence (AI) systems have shown…

In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Constantin Seibold , Simon Reiß , Saquib Sarfraz , Matthias A. Fink , Victoria Mayer , Jan Sellner , Moon Sung Kim , Klaus H. Maier-Hein , Jens Kleesiek , Rainer Stiefelhagen

Medical Visual Question Answering (Med-VQA) combines computer vision and natural language processing to automatically answer clinical inquiries about medical images. However, current Med-VQA datasets exhibit two significant limitations: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bo Liu , Ke Zou , Liming Zhan , Zexin Lu , Xiaoyu Dong , Yidi Chen , Chengqiang Xie , Jiannong Cao , Xiao-Ming Wu , Huazhu Fu

As medical imaging is central to diagnostic processes, automating the generation of radiology reports has become increasingly relevant to assist radiologists with their heavy workloads. Most current methods rely solely on global image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Hamza Kalisch , Fabian Hörst , Jens Kleesiek , Ken Herrmann , Constantin Seibold

Automatic lung lesions segmentation of chest CT scans is considered a pivotal stage towards accurate diagnosis and severity measurement of COVID-19. Traditional U-shaped encoder-decoder architecture and its variants suffer from diminutions…

Image and Video Processing · Electrical Eng. & Systems 2020-12-04 Tanvir Mahmud , Md Awsafur Rahman , Shaikh Anowarul Fattah , Sun-Yuan Kung

As Vision-Language Models (VLMs) increasingly gain traction in medical applications, clinicians are progressively expecting AI systems not only to generate textual diagnoses but also to produce corresponding medical images that integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junjie Yang , Yuhao Yan , Gang Wu , Yuxuan Wang , Ruoyu Liang , Xinjie Jiang , Xiang Wan , Fenglei Fan , Yongquan Zhang , Feiwei Qin , Changmiao Wang

Large Vision-Language Models (LVLMs) have demonstrated promising performance in chest X-ray (CXR) analysis. To enhance human-computer interaction, several studies have incorporated radiologists' eye gaze, typically through heatmaps or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yunsoo Kim , Jinge Wu , Honghan Wu