English
Related papers

Related papers: RadGPT: Constructing 3D Image-Text Tumor Datasets

200 papers

The world faces a shortage of radiologists, leading to longer treatment times and increased stress, negatively impacting patient safety and workforce morale. Integrating artificial intelligence to interpret radiographic images and generate…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Marijn Borghouts

In the recent years, artificial intelligence (AI) and its leading subtypes, machine learning (ML) and deep learning (DL) and their applications are spreading very fast in various aspects such as medicine. Today the most important challenge…

With the significantly increasing incidence and prevalence of abdominal diseases, there is a need to embrace greater use of new innovations and technology for the diagnosis and treatment of patients. Although deep-learning methods have…

Tumor is a leading cause of death worldwide, with an estimated 10 million deaths attributed to tumor-related diseases every year. AI-driven tumor recognition unlocks new possibilities for more precise and intelligent tumor screening and…

Most current medical vision language models struggle to jointly generate diagnostic text and pixel-level segmentation masks in response to complex visual questions. This represents a major limitation towards clinical application, as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Chengrun Li , Corentin Royer , Haozhe Luo , Bastian Wittmann , Xia Li , Ibrahim Hamamci , Sezgin Er , Anjany Sekuboyina , Bjoern Menze

As medical imaging is central to diagnostic processes, automating the generation of radiology reports has become increasingly relevant to assist radiologists with their heavy workloads. Most current methods rely solely on global image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Hamza Kalisch , Fabian Hörst , Jens Kleesiek , Ken Herrmann , Constantin Seibold

Annually and globally, over three billion radiography examinations and computer tomography scans result in mostly unstructured radiology reports containing free text. Despite the potential benefits of structured reporting, its adoption is…

Computation and Language · Computer Science 2024-06-25 Daniel Reichenpfader , Jonas Knupp , André Sander , Kerstin Denecke

Body composition assessment using CT images can potentially be used for a number of clinical applications, including the prognostication of cardiovascular outcomes, evaluation of metabolic health, monitoring of disease progression,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-24 Yaqian Chen , Hanxue Gu , Yuwen Chen , Jichen Yang , Haoyu Dong , Joseph Y. Cao , Adrian Camarena , Christopher Mantyh , Roy Colglazier , Maciej A. Mazurowski

This work presents comprehensive results to detect in the early stage the pancreatic neuroendocrine tumors (PNETs), a group of endocrine tumors arising in the pancreas, which are the second common type of pancreatic cancer, by checking the…

Image and Video Processing · Electrical Eng. & Systems 2020-04-07 Zhuotun Zhu , Yongyi Lu , Wei Shen , Elliot K. Fishman , Alan L. Yuille

In this work, we introduce RadImageNet-VQA, a large-scale dataset designed to advance radiologic visual question answering (VQA) on CT and MRI exams. Existing medical VQA datasets are limited in scale, dominated by X-ray imaging or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Léo Butsanets , Charles Corbière , Julien Khlaut , Pierre Manceron , Corentin Dancette

The large language model called ChatGPT has drawn extensively attention because of its human-like expression and reasoning abilities. In this study, we investigate the feasibility of using ChatGPT in experiments on using ChatGPT to…

Computation and Language · Computer Science 2024-10-22 Qing Lyu , Josh Tan , Michael E. Zapadka , Janardhana Ponnatapura , Chuang Niu , Kyle J. Myers , Ge Wang , Christopher T. Whitlow

Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and diverse radiology reports with cross-source heterogeneity…

Following recent advancements in computer-aided detection and diagnosis systems for colonoscopy, the automated reporting of colonoscopy procedures is set to further revolutionize clinical practice. A crucial yet underexplored aspect in the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Carlo Biffi , Giorgio Roffo , Pietro Salvagnini , Andrea Cherubini

Objective: Radiotherapy treatment planning is a time-consuming and potentially subjective process that requires the iterative adjustment of model parameters to balance multiple conflicting objectives. Recent advancements in frontier…

The annotation of digital pathological slide data for renal cell carcinoma is of paramount importance for correct diagnosis of artificial intelligence models due to the heterogeneous nature of the tumor. This process not only facilitates a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Qingrong Sun , Weixiang Zhong , Jie Zhou , Chong Lai , Xiaodong Teng , Maode Lai

Annotating medical images, particularly for organ segmentation, is laborious and time-consuming. For example, annotating an abdominal organ requires an estimated rate of 30-60 minutes per CT volume based on the expertise of an annotator and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-09 Chongyu Qu , Tiezheng Zhang , Hualin Qiao , Jie Liu , Yucheng Tang , Alan Yuille , Zongwei Zhou

Chest computed tomography (CT) is central to the detection and management of thoracic disease, yet the growing scale and complexity of volumetric imaging increasingly exceed what can be addressed by scan-level prediction alone. Clinically…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xuguang Bai , Mingxuan Liu , Tongxi Song , Yifei Chen , Hongjia Yang , Kasidit Anmahapong , Zihan Li , Ying Zhou , Qiyuan Tian

Reliable reference data in medical imaging is largely unavailable. Developing tools that allow for the comparison of individual patient data to reference data has a high potential to improve diagnostic imaging. Population atlases are a…

Image and Video Processing · Electrical Eng. & Systems 2024-12-02 Sophie Starck , Vasiliki Sideri-Lampretsa , Jessica J. M. Ritter , Veronika A. Zimmer , Rickmer Braren , Tamara T. Mueller , Daniel Rueckert

Electronic health records contain detailed information about the medical condition of patients, but they are difficult for patients to understand even if they have access to them. We explore whether ChatGPT (GPT 4) can help explain…

Human-Computer Interaction · Computer Science 2024-06-25 Mengxuan Sun , Ehud Reiter , Anne E Kiltie , George Ramsay , Lisa Duncan , Peter Murchie , Rosalind Adam

Accurate segmentation for medical images is important for clinical diagnosis. Existing automatic segmentation methods are mainly based on fully supervised learning and have an extremely high demand for precise annotations, which are very…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Yuanpeng Liu , Qinglei Hui , Zhiyi Peng , Shaolin Gong , Dexing Kong