English
Related papers

Related papers: Vision-Language Models for Automated 3D PET/CT Rep…

200 papers

Whole-body PET/CT is a cornerstone of oncological imaging, yet accurate lesion segmentation remains challenging due to tracer heterogeneity, physiological uptake, and multi-center variability. While fully automated methods have advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Maximilian Rokuss , Yannick Kirchhoff , Fabian Isensee , Klaus H. Maier-Hein

Vision-and-language models (VLMs) have been increasingly explored in the medical domain, particularly following the success of CLIP in general domain. However, unlike the relatively straightforward pairing of 2D images and text, curating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ziyang Zhang , Yang Yu , Xulei Yang , Si Yong Yeo

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesions with different shapes, sizes, and uptake intensity may be distributed in different anatomical…

Image and Video Processing · Electrical Eng. & Systems 2022-09-20 Zhantao Liu , Shaonan Zhong , Junyang Mo

Pulmonary embolism (PE) registries accelerate practice-improving research but depend on resource-intensive manual abstraction of radiology reports. We evaluated whether openly available large-language models (LLMs) can automate concept…

Vision-language models can connect the text description of an object to its specific location in an image through visual grounding. This has potential applications in enhanced radiology reporting. However, these models require large…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Zachary Huemann , Samuel Church , Joshua D. Warner , Daniel Tran , Xin Tie , Alan B McMillan , Junjie Hu , Steve Y. Cho , Meghan Lubner , Tyler J. Bradshaw

Multi-modal large language models (MLLMs) have been given free rein to explore exciting medical applications with a primary focus on radiology report generation. Nevertheless, the preliminary success in 2D radiology captioning is…

Accurate histological differentiation between adenocarcinoma (ADC) and squamous cell carcinoma (SCC) is critical for personalized treatment in non-small cell lung cancer (NSCLC). While [$^{18}$F]FDG PET/CT is a standard tool for the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Fatih Aksu , Laura Ciuffetti , Francesco Di Feola , Filippo Ruffini , Giulia Romoli , Fabrizia Gelardi , Arturo Chiti , Valerio Guarrasi , Paolo Soda

PET imaging is an invaluable tool in clinical settings as it captures the functional activity of both healthy anatomy and cancerous lesions. Developing automatic lesion segmentation methods for PET images is crucial since manual lesion…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Tanya Gatsak , Kumar Abhishek , Hanene Ben Yedder , Saeid Asgari Taghanaki , Ghassan Hamarneh

Dynamic positron emission tomography (PET) images can reveal the distribution of tracers in the organism and the dynamic processes involved in biochemical reactions, and it is widely used in clinical practice. Despite the high effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Jie Sun , Junyan Zhang , Qian Xia , Chuanfu Sun , Yumei Chen , Yunjie Yang , Huafeng Liu , Wentao Zhu , Qiegen Liu

Positron emission tomography (PET) is widely utilized for cancer detection due to its ability to visualize functional and biological processes in vivo. PET images are usually reconstructed from histogrammed raw data (sinograms) using…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yiran Sun , Osama Mawlawi

Historically, patient datasets have been used to develop and validate various reconstruction algorithms for PET/MRI and PET/CT. To enable such algorithm development, without the need for acquiring hundreds of patient exams, in this paper we…

Score-based generative models have demonstrated highly promising results for medical image reconstruction tasks in magnetic resonance imaging or computed tomography. However, their application to Positron Emission Tomography (PET) is still…

Image and Video Processing · Electrical Eng. & Systems 2024-01-24 Imraj RD Singh , Alexander Denker , Riccardo Barbano , Željko Kereta , Bangti Jin , Kris Thielemans , Peter Maass , Simon Arridge

Purpose: The main purpose of this study was to assess the reliability of shape and heterogeneity features in both Positron Emission Tomography (PET) and low-dose Computed Tomography (CT) components of PET/CT. A secondary objective was to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-06 Marie-Charlotte Desseroit , Florent Tixier , Wolfgang Weber , Barry A Siegel , Catherine Cheze Le Rest , Dimitris Visvikis , Mathieu Hatt

Sequential whole-body 18F-Fluorodeoxyglucose (FDG) positron emission tomography (PET) scans are regarded as the imaging modality of choice for the assessment of treatment response in the lymphomas because they detect treatment response when…

Image and Video Processing · Electrical Eng. & Systems 2021-06-10 Kai-Chieh Liang , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

The goal of automatic report generation is to generate a clinically accurate and coherent phrase from a single given X-ray image, which could alleviate the workload of traditional radiology reporting. However, in a real-world scenario,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tiancheng Gu , Dongnan Liu , Zhiyuan Li , Weidong Cai

There is enormous enthusiasm and concerns in using large language models (LLMs) in healthcare, yet current assumptions are all based on general-purpose LLMs such as ChatGPT. This study develops a clinical generative LLM, GatorTronGPT, using…

Medical report generation is the task of automatically writing radiology reports for chest X-ray images. Manually composing these reports is a time-consuming process that is also prone to human errors. Generating medical reports can…

Computation and Language · Computer Science 2024-10-22 Abdullah , Ameer Hamza , Seong Tae Kim

Interpreting quantitative CT biomarkers, such as organ volume and tissue attenuation, requires large-scale healthy reference distributions. However, creating these is challenging because clinical datasets are often heavily enriched with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Christian Wachinger , Bernhard Renger , Christopher Späth , Jan Kirschke , Marcus Makowski

Positron Emission Tomography (PET) /Computed Tomography (CT) is crucial for diagnosing, managing, and planning treatment for various cancers. Developing reliable deep learning models for the segmentation of tumor lesions in PET/CT scans in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Tanya Chutani , Saikiran Bonthu , Pranab Samanta , Nitin Singhal