English
Related papers

Related papers: Universal CT Representations from Anatomy to Disea…

200 papers

Federated learning and its application to medical image segmentation have recently become a popular research topic. This training paradigm suffers from statistical heterogeneity between participating institutions' local datasets, incurring…

Image and Video Processing · Electrical Eng. & Systems 2023-10-19 Matthis Manthe , Stefan Duffner , Carole Lartizien

In oncology, Positron Emission Tomography-Computed Tomography (PET/CT) is widely used in cancer diagnosis, staging, and treatment monitoring, as it combines anatomical details from CT with functional metabolic activity and molecular marker…

Current fMRI foundation models primarily rely on a limited range of brain states and mismatched pretraining tasks, restricting their ability to learn generalized representations across diverse brain states. We present \textit{Brain-DiT}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junfeng Xia , Wenhao Ye , Xuanye Pan , Xinke Shen , Mo Wang , Quanying Liu

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Eric Zimmermann , Julian Viret , Michal Zelechowski , James Brian Hall , Neil Tenenholtz , Adam Casson , George Shaikovski , Eugene Vorontsov , Siqi Liu , Kristen A Severson

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

We introduce SPECTRE, a fully transformer-based foundation model for volumetric computed tomography (CT). Our Self-Supervised & Cross-Modal Pretraining for CT Representation Extraction (SPECTRE) approach utilizes scalable 3D Vision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Cris Claessens , Christiaan Viviers , Giacomo D'Amicantonio , Egor Bondarev , Fons van der Sommen

The processing and analysis of computed tomography (CT) imaging is important for both basic scientific development and clinical applications. In AutoCT, we provide a comprehensive pipeline that integrates an end-to-end automatic…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Zhe Bai , Abdelilah Essiari , Talita Perciano , Kristofer E. Bouchard

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

The generation of Synthetic Computed Tomography (sCT) images has become a pivotal methodology in modern clinical practice, particularly in the context of Radiotherapy (RT) treatment planning. The use of sCT enables the calculation of doses,…

While it is well known that population differences from genetics, sex, race, and environmental factors contribute to disease, AI studies in medicine have largely focused on locoregional patient cohorts with less diverse data sources. Such…

Computed tomography (CT) is of great importance in clinical practice due to its powerful ability to provide patients' anatomical information without any invasive inspection, but its potential radiation risk is raising people's concerns.…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Ziyuan Yang , Wenjun Xia , Zexin Lu , Yingyu Chen , Xiaoxiao Li , Yi Zhang

Whole-body PET/CT is a cornerstone of oncological imaging, yet accurate lesion segmentation remains challenging due to tracer heterogeneity, physiological uptake, and multi-center variability. While fully automated methods have advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Maximilian Rokuss , Yannick Kirchhoff , Fabian Isensee , Klaus H. Maier-Hein

Recent 3D CT vision-language models align volumes with reports via contrastive pretraining, but typically rely on limited public data and provide only coarse global supervision. We train a 3D CT vision-language model on 98k report-volume…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Simon Ging , Philipp Arnold , Sebastian Walter , Hani Alnahas , Hannah Bast , Elmar Kotter , Jiancheng Yang , Behzad Bozorgtabar , Thomas Brox

Accurate lesion segmentation in whole-body PET/CT scans is crucial for cancer diagnosis and treatment planning, but limited datasets often hinder the performance of automated segmentation models. In this paper, we explore the potential of…

Image and Video Processing · Electrical Eng. & Systems 2024-09-13 Lap Yan Lennon Chan , Chenxin Li , Yixuan Yuan

Automated segmentation of cancerous lesions in PET/CT scans is a crucial first step in quantitative image analysis. However, training deep learning models for segmentation with high accuracy is particularly challenging due to the variations…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shadab Ahamed

Precision medicine in the quantitative management of chronic diseases and oncology would be greatly improved if the Computed Tomography (CT) scan of any patient could be segmented, parsed and analyzed in a precise and detailed way. However,…

Pre-training convolutional neural networks with weakly-supervised and self-supervised strategies is becoming increasingly popular for several computer vision tasks. However, due to the lack of strong discriminative signals, these learned…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Xueting Yan , Ishan Misra , Abhinav Gupta , Deepti Ghadiyaram , Dhruv Mahajan

Supervised deep learning models for automated CTG analysis are typically constrained by narrowly curated labelled datasets and limited patient cohorts, leaving substantial volumes of physiologically informative clinical recordings untapped.…

Machine Learning · Computer Science 2026-05-06 Sheng Wong , Ravi Shankar , Beth Albert , Hao Fei , Lin Li , Imane Ben M'Barek , Manu Vatish , Gabriel Davis Jones

Precise image segmentation provides clinical study with instructive information. Despite the remarkable progress achieved in medical image segmentation, there is still an absence of a 3D foundation segmentation model that can segment a wide…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yuxin Du , Fan Bai , Tiejun Huang , Bo Zhao

Computed tomography (CT) is a beneficial imaging tool for diagnostic purposes. CT scans provide detailed information concerning the internal anatomic structures of a patient, but present higher radiation dose and costs compared to X-ray…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Benjamin Paulson , Joshua Goldshteyn , Sydney Balboni , John Cisler , Andrew Crisler , Natalia Bukowski , Julia Kalish , Theodore Colwell