English
Related papers

Related papers: Vision Foundation Models for Computed Tomography

200 papers

Cytology is essential for cancer diagnostics and screening due to its minimally invasive nature. However, the development of robust deep learning models for digital cytology is challenging due to the heterogeneity in staining and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Vedrana Ivezić , Ashwath Radhachandran , Ekaterina Redekop , Shreeram Athreya , Dongwoo Lee , Vivek Sant , Corey Arnold , William Speier

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

Existing foundation models (FMs) in the medical domain often require extensive fine-tuning or rely on training resource-intensive decoders, while many existing encoders are pretrained with objectives biased toward specific tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tim Veenboer , George Yiasemis , Eric Marcus , Vivien Van Veldhuizen , Cees G. M. Snoek , Jonas Teuwen , Kevin B. W. Groot Lipman

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Computed tomography (CT) and clinical numeric data are essential modalities for cancer evaluation, but building large-scale multimodal training datasets for developing medical foundation models remains challenging due to the structural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Daeun Jung , Jaehyeok Jang , Sooyoung Jang , Yu Rang Park

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Peirong Liu , Oula Puonti , Xiaoling Hu , Karthik Gopinath , Annabel Sorby-Adams , Daniel C. Alexander , W. Taylor Kimberly , Juan E. Iglesias

Pathology has played a crucial role in the diagnosis and evaluation of patient tissue samples obtained from surgeries and biopsies for many years. The advent of Whole Slide Scanners and the development of deep learning technologies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Mieko Ochi , Daisuke Komura , Shumpei Ishikawa

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Magnetic Resonance Imaging is a critical imaging modality in clinical diagnosis and research, yet its complexity and heterogeneity hinder scalable, generalizable machine learning. Although foundation models have revolutionized language and…

The role of artificial intelligence (AI) in pathology has evolved from aiding diagnostics to uncovering predictive morphological patterns in whole slide images (WSIs). Recently, foundation models (FMs) leveraging self-supervised…

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks. These models leverage…

Machine Learning · Computer Science 2025-07-22 Xinliang Zhou , Chenyu Liu , Zhisheng Chen , Kun Wang , Yi Ding , Ziyu Jia , Qingsong Wen

Language-aligned vision foundation models perform strongly across diverse downstream tasks. Yet, their learned representations remain opaque, making interpreting their decision-making difficult. Recent work decompose these representations…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Kai Wittenmayer , Sukrut Rao , Amin Parchami-Araghi , Bernt Schiele , Jonas Fischer

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Computed tomography (CT) is a central to three-dimensional medical imaging, yet CT-based artificial intelligence remains fragmented across task-specific models for segmentation, classification, registration, and report analysis. Here we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yuheng Li , Yuan Gao , Haoyu Dong , Yuxiang Lai , Shansong Wang , Mojtaba Safari , James E. Baciak , Xiaofeng Yang

While computer science has seen remarkable advancements in foundation models, which remain underexplored in geoscience. Addressing this gap, we introduce a workflow to develop geophysical foundation models, including data preparation, model…

Geophysics · Physics 2023-12-18 Hanlin Sheng , Xinming Wu , Xu Si , Jintao Li , Sibo Zhang , Xudong Duan

Foundation models (FMs) promise to generalize medical imaging, but their effectiveness varies. It remains unclear how pre-training domain (medical vs. general), paradigm (e.g., text-guided), and architecture influence embedding quality,…

Volumetric rendering of Computed Tomography (CT) scans is crucial for visualizing complex 3D anatomical structures in medical imaging. Current high-fidelity approaches, especially neural rendering techniques, require time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhongpai Gao , Meng Zheng , Benjamin Planche , Anwesa Choudhuri , Terrence Chen , Ziyan Wu

Vision Foundation Models (VFMs) have become a de facto choice for many downstream vision tasks, like image classification, image segmentation, and object localization. However, they can also provide significant utility for downstream 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Johannes Spoecklberger , Wei Lin , Pedro Hermosilla , Sivan Doveh , Horst Possegger , M. Jehanzeb Mirza