English
Related papers

Related papers: Foundation Models in Biomedical Imaging: Turning H…

200 papers

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models, are…

Large foundation models (FMs) are transforming Earth science by integrating heterogeneous multimodal data, such as multi-platform imagery, gridded reanalysis data, diverse geophysical and geochemical observations, and domain-specific text,…

Instrumentation and Methods for Astrophysics · Physics 2026-05-14 Xiangyu Zhao , Bo Liu , Yuehan Zhang , Zelin Song , Wanghan Xu , Feng Liu , Fengxiang Wang , Ben Fei , Fenghua Ling , Wangxu Wei , Wenlong Zhang , Xiao-Ming Wu

Foundation models (FMs), such as GPT-4 and AlphaFold, are reshaping the landscape of scientific research. Beyond accelerating tasks such as hypothesis generation, experimental design, and result interpretation, they prompt a more…

Machine Learning · Computer Science 2025-10-20 Fan Liu , Jindong Han , Tengfei Lyu , Weijia Zhang , Zhe-Rui Yang , Lu Dai , Cancheng Liu , Hao Liu

Foundation Models (FMs) are models trained on large corpora of data that, at very large scale, can generalize to new tasks without any task-specific finetuning. As these models continue to grow in size, innovations continue to push the…

Machine Learning · Computer Science 2022-12-27 Avanika Narayan , Ines Chami , Laurel Orr , Simran Arora , Christopher Ré

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

The rapid advancement of foundation models (FMs) across language, image, audio, and video domains has shown remarkable capabilities in diverse tasks. However, the proliferation of FMs brings forth a critical challenge: the potential to…

Machine Learning · Computer Science 2024-10-04 Pranab Sahoo , Prabhash Meharia , Akash Ghosh , Sriparna Saha , Vinija Jain , Aman Chadha

Neural networks achieve state-of-the-art performance in many supervised learning tasks when the training data distribution matches the test data distribution. However, their performance drops significantly under domain (covariate) shift, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kerem Cekmeceli , Meva Himmetoglu , Guney I. Tombak , Anna Susmelj , Ertunc Erdil , Ender Konukoglu

Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Jing Hu , Kaiwei Yu , Hongjiang Xian , Shu Hu , Xin Wang

Understanding the inner mechanisms of black-box foundation models (FMs) is essential yet challenging in artificial intelligence and its applications. Over the last decade, the long-running focus has been on their explainability, leading to…

Machine Learning · Computer Science 2024-11-26 Shi Fu , Yuzhu Chen , Yingjie Wang , Dacheng Tao

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAIM), to improve model…

Machine Learning · Computer Science 2024-03-11 Mingxuan Liu , Yilin Ning , Yuhe Ke , Yuqing Shang , Bibhas Chakraborty , Marcus Eng Hock Ong , Roger Vaughan , Nan Liu

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

With the development of artificial intelligence and breakthroughs in deep learning, large-scale Foundation Models (FMs), such as GPT, Sora, etc., have achieved remarkable results in many fields including natural language processing and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Jianhua Wu , Bingzhao Gao , Jincheng Gao , Jianhao Yu , Hongqing Chu , Qiankun Yu , Xun Gong , Yi Chang , H. Eric Tseng , Hong Chen , Jie Chen

Brain Foundation Models (BFMs) are transforming neuroscience by enabling scalable and transferable learning from neural signals, advancing both clinical diagnostics and cutting-edge neuroscience exploration. Their emergence is powered by…

Machine Learning · Computer Science 2026-02-13 Fanqi Shen , Enhong Yang , Jiahe Li , Junru Hong , Xiaoran Pan , Zhizhang Yuan , Meng Li , Yang Yang

Modern Foundation Models (FMs) are typically trained on corpora spanning a wide range of different data modalities, topics and downstream tasks. Utilizing these models can be very computationally expensive and is out of reach for most…

Machine Learning · Computer Science 2025-06-09 Andrey Zhmoginov , Jihwan Lee , Mark Sandler

Wearable foundation models (WFMs), trained on large volumes of data collected by affordable, always-on devices, have demonstrated strong performance on short-term, well-defined health monitoring tasks, including activity recognition,…

Machine Learning · Computer Science 2026-03-23 Yu Yvonne Wu , Yuwei Zhang , Hyungjun Yoon , Ting Dang , Dimitris Spathis , Tong Xia , Qiang Yang , Jing Han , Dong Ma , Sung-Ju Lee , Cecilia Mascolo

Background: The rapid integration of foundation models into clinical practice and public health necessitates a rigorous evaluation of their true clinical reasoning capabilities beyond narrow examination success. Current benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dingyu Wang , Zimu Yuan , Jiajun Liu , Shanggui Liu , Nan Zhou , Tianxing Xu , Di Huang , Dong Jiang

Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high…

Neurons and Cognition · Quantitative Biology 2025-08-26 Yanwen Wang , Xinglin Zhao , Yijin Song , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Foundation models (FMs), i.e., models trained on a vast amount of typically unlabeled data, have become popular and available recently for the domain of histopathology. The key idea is to extract semantically rich vectors from any input…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jonathan Ganz , Jonas Ammeling , Emely Rosbach , Ludwig Lausser , Christof A. Bertram , Katharina Breininger , Marc Aubreville