English
Related papers

Related papers: Progress and Opportunities of Foundation Models in…

200 papers

The role of artificial intelligence (AI) in pathology has evolved from aiding diagnostics to uncovering predictive morphological patterns in whole slide images (WSIs). Recently, foundation models (FMs) leveraging self-supervised…

Foundation models, first introduced in 2021, refer to large-scale pretrained models (e.g., large language models (LLMs) and vision-language models (VLMs)) that learn from extensive unlabeled datasets through unsupervised methods, enabling…

This position paper explores the rapid development of Foundation Models (FMs) in AI and their implications for intelligence and reasoning. It examines the characteristics of FMs, including their training on vast datasets and use of…

Artificial Intelligence · Computer Science 2025-08-05 Alan F. Smeaton

Music is essential in daily life, fulfilling emotional and entertainment needs, and connecting us personally, socially, and culturally. A better understanding of music can enhance our emotions, cognitive skills, and cultural connections.…

Over the past decades, computer-aided diagnosis tools for breast cancer have been developed to enhance screening procedures, yet their clinical adoption remains challenged by data variability and inherent biases. Although foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Elodie Germani , Ilayda Selin Türk , Fatima Zeineddine , Charbel Mourad , Shadi Albarqouni

Foundation models (FMs) are rapidly reshaping medical imaging, shifting the field from narrowly trained, task-specific networks toward large, general-purpose models that can be adapted across modalities, anatomies, and clinical tasks. In…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Chuang Niu , Pengwei Wu , Bruno De Man , Ge Wang

Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data…

Quantitative Methods · Quantitative Biology 2026-04-23 Amgad Muneer , Kai Zhang , Ibraheem Hamdi , Rizwan Qureshi , Muhammad Waqas , Shereen Fouad , Hazrat Ali , Syed Muhammad Anwar , Jia Wu

Foundation models (FMs), such as GPT-4 and AlphaFold, are reshaping the landscape of scientific research. Beyond accelerating tasks such as hypothesis generation, experimental design, and result interpretation, they prompt a more…

Machine Learning · Computer Science 2025-10-20 Fan Liu , Jindong Han , Tengfei Lyu , Weijia Zhang , Zhe-Rui Yang , Lu Dai , Cancheng Liu , Hao Liu

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

With the rapid advancements in large language model (LLM) technology and the emergence of bioinformatics-specific language models (BioLMs), there is a growing need for a comprehensive analysis of the current landscape, computational…

The advent of foundation models (FMs) in healthcare offers unprecedented opportunities to enhance medical diagnostics through automated classification and segmentation tasks. However, these models also raise significant concerns about their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ruinan Jin , Zikang Xu , Yuan Zhong , Qiongsong Yao , Qi Dou , S. Kevin Zhou , Xiaoxiao Li

Denoising diffusion models have emerged as one of the most powerful generative models in recent years. They have achieved remarkable success in many fields, such as computer vision, natural language processing (NLP), and bioinformatics.…

Machine Learning · Computer Science 2023-02-23 Zhiye Guo , Jian Liu , Yanli Wang , Mengrui Chen , Duolin Wang , Dong Xu , Jianlin Cheng

Over the past few years, the landscape of Artificial Intelligence (AI) has been reshaped by the emergence of Foundation Models (FMs). Pre-trained on massive datasets, these models exhibit exceptional performance across diverse downstream…

Machine Learning · Computer Science 2026-02-17 Shenghui Li , Fanghua Ye , Meng Fang , Jiaxu Zhao , Yun-Hin Chan , Edith C. H. Ngai , Thiemo Voigt

The advent of foundation models (FMs), large-scale pre-trained models with strong generalization capabilities, has opened new frontiers for financial engineering. While general-purpose FMs such as GPT-4 and Gemini have demonstrated…

Computational Finance · Quantitative Finance 2025-12-16 Liyuan Chen , Shuoling Liu , Jiangpeng Yan , Xiaoyu Wang , Henglin Liu , Chuang Li , Kecheng Jiao , Jixuan Ying , Yang Veronica Liu , Qiang Yang , Xiu Li

Foundation Models (FMs) are models trained on large corpora of data that, at very large scale, can generalize to new tasks without any task-specific finetuning. As these models continue to grow in size, innovations continue to push the…

Machine Learning · Computer Science 2022-12-27 Avanika Narayan , Ines Chami , Laurel Orr , Simran Arora , Christopher Ré

Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models, are…

Although the applications of artificial intelligence especially deep learning had greatly improved various aspects of intelligent manufacturing, they still face challenges for wide employment due to the poor generalization ability,…

Artificial Intelligence · Computer Science 2023-12-27 Haotian Zhang , Semujju Stuart Dereck , Zhicheng Wang , Xianwei Lv , Kang Xu , Liang Wu , Ye Jia , Jing Wu , Zhuo Long , Wensheng Liang , X. G. Ma , Ruiyan Zhuang

Foundation Models (FMs) are large-scale, pre-trained artificial intelligence (AI) systems that have revolutionized natural language processing and computer vision, and are now advancing geospatial analysis and Earth Observation (EO). They…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pedram Ghamisi , Weikang Yu , Xiaokang Zhang , Aldino Rizaldy , Jian Wang , Chufeng Zhou , Richard Gloaguen , Gustau Camps-Valls

In recent years, foundation models (FMs) such as large language models (LLMs) and latent diffusion models (LDMs) have profoundly impacted diverse sectors, including music. This comprehensive review examines state-of-the-art (SOTA)…

This paper surveys foundation models for AI-enabled biological design, focusing on recent developments in applying large-scale, self-supervised models to tasks such as protein engineering, small molecule design, and genomic sequence design.…

Artificial Intelligence · Computer Science 2025-05-20 Asher Moldwin , Amarda Shehu