English
Related papers

Related papers: Foundation Models for Medical Imaging: Status, Cha…

200 papers

Foundation models (FMs), such as GPT-4 and AlphaFold, are reshaping the landscape of scientific research. Beyond accelerating tasks such as hypothesis generation, experimental design, and result interpretation, they prompt a more…

Machine Learning · Computer Science 2025-10-20 Fan Liu , Jindong Han , Tengfei Lyu , Weijia Zhang , Zhe-Rui Yang , Lu Dai , Cancheng Liu , Hao Liu

Wearable foundation models (WFMs), trained on large volumes of data collected by affordable, always-on devices, have demonstrated strong performance on short-term, well-defined health monitoring tasks, including activity recognition,…

Machine Learning · Computer Science 2026-03-23 Yu Yvonne Wu , Yuwei Zhang , Hyungjun Yoon , Ting Dang , Dimitris Spathis , Tong Xia , Qiang Yang , Jing Han , Dong Ma , Sung-Ju Lee , Cecilia Mascolo

Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of…

Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Yichi Zhang , Zhenrong Shen , Rushi Jiao

Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets…

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

Developing Foundation Models for medical image analysis is essential to overcome the unique challenges of radiological tasks. The first challenges of this kind for 3D brain MRI, SSL3D and FOMO25, were held at MICCAI 2025. Our solution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Pedro M. Gordaliza , Jaume Banus , Benoît Gérin , Maxence Wynen , Nataliia Molchanova , Jonas Richiardi , Meritxell Bach Cuadra

This paper explores the advancements and applications of large-scale models in the medical field, with a particular focus on Medical Large Models (MedLMs). These models, encompassing Large Language Models (LLMs), Vision Models, 3D Large…

Artificial Intelligence · Computer Science 2025-10-08 YunHe Su , Zhengyang Lu , Junhui Liu , Ke Pang , Haoran Dai , Sa Liu , Yuxin Jia , Lujia Ge , Jing-min Yang

The diagnostic imaging departments are under great pressure due to a growing workload. The number of required scans is growing and there is a shortage of qualified labor. AI solutions for medical imaging applications have shown great…

Software Engineering · Computer Science 2024-11-18 Amanda Vallentin

The rapid emergence of foundation models, particularly Large Language Models (LLMs) and Vision-Language Models (VLMs), has introduced a transformative paradigm in robotics. These models offer powerful capabilities in semantic understanding,…

Robotics · Computer Science 2025-07-15 Muhammad Tayyab Khan , Ammar Waheed

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

As the rapid development of computer vision and the emergence of powerful network backbones and architectures, the application of deep learning in medical imaging has become increasingly significant. Unlike natural images, medical images…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Guoqing Zhang , Jingyun Yang , Yang Li

The Segment Anything Model (SAM) has drawn significant attention from researchers who work on medical image segmentation because of its generalizability. However, researchers have found that SAM may have limited performance on medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yihao Liu , Jiaming Zhang , Andres Diaz-Pinto , Haowei Li , Alejandro Martin-Gomez , Amir Kheradmand , Mehran Armand

Graph Foundation Models (GFMs) are emerging as a significant research topic in the graph domain, aiming to develop graph models trained on extensive and diverse data to enhance their applicability across various tasks and domains.…

Machine Learning · Computer Science 2024-06-03 Haitao Mao , Zhikai Chen , Wenzhuo Tang , Jianan Zhao , Yao Ma , Tong Zhao , Neil Shah , Mikhail Galkin , Jiliang Tang

Social problems stemming from the shortage of radiologists are intensifying, and artificial intelligence is being highlighted as a potential solution. Recently emerging large-scale generative AI has expanded from large language models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Inwoo Seo , Eunkyoung Bae , Joo-Young Jeon , Young-Sang Yoon , Jiho Cha

Medical image segmentation plays an important role in many image-guided clinical approaches. However, existing segmentation algorithms mostly rely on the availability of fully annotated images with pixel-wise annotations for training, which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuyan Shi , Jialu Ma , Jin Yang , Shasha Wang , Yichi Zhang

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

With the development of artificial intelligence and breakthroughs in deep learning, large-scale Foundation Models (FMs), such as GPT, Sora, etc., have achieved remarkable results in many fields including natural language processing and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jianhua Wu , Bingzhao Gao , Jincheng Gao , Jianhao Yu , Hongqing Chu , Qiankun Yu , Xun Gong , Yi Chang , H. Eric Tseng , Hong Chen , Jie Chen

Image segmentation is a long-standing challenge in computer vision, studied continuously over several decades, as evidenced by seminal algorithms such as N-Cut, FCN, and MaskFormer. With the advent of foundation models (FMs), contemporary…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Tianfei Zhou , Wang Xia , Fei Zhang , Boyu Chang , Wenguan Wang , Ye Yuan , Ender Konukoglu , Daniel Cremers