English
Related papers

Related papers: Building Universal Foundation Models for Medical I…

200 papers

Inadequate generality across different organs and tasks constrains the application of ultrasound (US) image analysis methods in smart healthcare. Building a universal US foundation model holds the potential to address these issues.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Jing Jiao , Jin Zhou , Xiaokang Li , Menghua Xia , Yi Huang , Lihong Huang , Na Wang , Xiaofan Zhang , Shichong Zhou , Yuanyuan Wang , Yi Guo

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Unsupervised domain adaptation (UDA) methods have shown their promising performance in the cross-modality medical image segmentation tasks. These typical methods usually utilize a translation network to transform images from the source…

Image and Video Processing · Electrical Eng. & Systems 2021-01-19 Xiaoting Han , Lei Qi , Qian Yu , Ziqi Zhou , Yefeng Zheng , Yinghuan Shi , Yang Gao

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

The rapid advancement of autonomous systems, including self-driving vehicles and drones, has intensified the need to forge true Spatial Intelligence from multi-modal onboard sensor data. While foundation models excel in single-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Song Wang , Lingdong Kong , Xiaolu Liu , Hao Shi , Wentong Li , Jianke Zhu , Steven C. H. Hoi

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Robust segmentation is critical for deriving quantitative measures from large-scale, multi-center, and longitudinal medical scans. Manually annotating medical scans, however, is expensive and labor-intensive and may not always be available…

Synthetic PET images are valuable for quantitative imaging workflow development, scalable virtual imaging trials, and deep learning model training, but conventional physics-based simulation approaches are computationally intensive, limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Suya Li , Kaushik Dutta , Debojyoti Pal , Jingqin Luo , Kooresh I. Shoghi

Human anatomy is the foundation of medical imaging and boasts one striking characteristic: its hierarchy in nature, exhibiting two intrinsic properties: (1) locality: each anatomical structure is morphologically distinct from the others;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Mohammad Reza Hosseinzadeh Taher , Michael B. Gotway , Jianming Liang

The deep learning field is converging towards the use of general foundation models that can be easily adapted for diverse tasks. While this paradigm shift has become common practice within the field of natural language processing, progress…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Joana Palés Huix , Adithya Raju Ganeshan , Johan Fredin Haslum , Magnus Söderberg , Christos Matsoukas , Kevin Smith

In clinical practice, regions of interest in medical imaging often need to be identified through a process of precise image segmentation. The quality of this image segmentation step critically affects the subsequent clinical assessment of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-23 João B. S. Carvalho , João A. Santinha , Đorđe Miladinović , Joachim M. Buhmann

Foundation models like the Segment Anything Model (SAM) show strong generalization, yet adapting them to medical images remains difficult due to domain shift, scarce labels, and the inability of Parameter-Efficient Fine-Tuning (PEFT) to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Vi Vu , Thanh-Huy Nguyen , Tien-Thinh Nguyen , Ba-Thinh Lam , Hoang-Thien Nguyen , Tianyang Wang , Xingjian Li , Min Xu

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

The growing demand for accurate and equitable AI models in digital dermatology faces a significant challenge: the lack of diverse, high-quality labeled data. In this work, we investigate the potential of domain-specific foundation models…

Developing artificial intelligence (AI) and machine learning (ML) models for medical imaging typically involves extensive training and testing on large datasets, consuming significant computational time, energy, and resources. There is a…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Raj Hansini Khoiwal , Alan B. McMillan