English
Related papers

Related papers: Progress and Opportunities of Foundation Models in…

200 papers

Computational pathology foundation models (CPathFMs) have emerged as a powerful approach for analyzing histopathological data, leveraging self-supervised learning to extract robust feature representations from unlabeled whole-slide images.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Ajit J. Nirmal , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Large Language Models (LLMs) have emerged as a transformative AI paradigm, profoundly influencing daily life through their exceptional language understanding and contextual generation capabilities. Despite their remarkable performance, LLMs…

Artificial Intelligence · Computer Science 2024-12-10 Yedi Zhang , Yufan Cai , Xinyue Zuo , Xiaokun Luan , Kailong Wang , Zhe Hou , Yifan Zhang , Zhiyuan Wei , Meng Sun , Jun Sun , Jing Sun , Jin Song Dong

Understanding the inner mechanisms of black-box foundation models (FMs) is essential yet challenging in artificial intelligence and its applications. Over the last decade, the long-running focus has been on their explainability, leading to…

Machine Learning · Computer Science 2024-11-26 Shi Fu , Yuzhu Chen , Yingjie Wang , Dacheng Tao

In the era of big data, transformation of biomedical big data into valuable knowledge has been one of the most important challenges in bioinformatics. Deep learning has advanced rapidly since the early 2000s and now demonstrates…

Machine Learning · Computer Science 2016-06-21 Seonwoo Min , Byunghan Lee , Sungroh Yoon

Over the recent years, the field of robotics has been undergoing a transformative paradigm shift from fixed, single-task, domain-specific solutions towards adaptive, multi-function, general-purpose agents, capable of operating in complex,…

Computational pathology, which involves analyzing whole slide images for automated cancer diagnosis, relies on multiple instance learning, where performance depends heavily on the feature extractor and aggregator. Recent Pathology…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Conghao Xiong , Hao Chen , Joseph J. Y. Sung

Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus…

Artificial Intelligence · Computer Science 2024-12-04 Kai Sun , Siyan Xue , Fuchun Sun , Haoran Sun , Yu Luo , Ling Wang , Siyuan Wang , Na Guo , Lei Liu , Tian Zhao , Xinzhou Wang , Lei Yang , Shuo Jin , Jun Yan , Jiahong Dong

Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret…

Biological foundation models (BioFMs), pretrained on large-scale biological sequences, have recently shown strong potential in providing meaningful representations for diverse downstream bioinformatics tasks. However, such models often rely…

Machine Learning · Computer Science 2026-02-10 Yifan Wu , Jiyue Jiang , Xichen Ye , Yiqi Wang , Chang Zhou , Yitao Xu , Jiayang Chen , He Hu , Weizhong Zhang , Cheng Jin , Jiao Yuan , Yu Li

Foundation models (FMs) such as large language models have revolutionized the field of AI by showing remarkable performance in various tasks. However, they exhibit numerous limitations that prevent their broader adoption in many real-world…

Artificial Intelligence · Computer Science 2024-02-05 Debarun Bhattacharjya , Junkyu Lee , Don Joven Agravante , Balaji Ganesan , Radu Marinescu

Biomedical Foundation Models (FMs) are rapidly transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological technical features -- including variations in…

Foundation models can be disruptive for future AI development by scaling up deep learning in terms of model size and training data's breadth and size. These models achieve state-of-the-art performance (often through further adaptation) on a…

Artificial Intelligence · Computer Science 2022-12-20 Johannes Schneider

AI and its relevant technologies, including machine learning, deep learning, chatbots, virtual assistants, and others, are currently undergoing a profound transformation of development and organizational processes within companies.…

Cryptography and Security · Computer Science 2024-12-11 Tingting Bi , Guangsheng Yu , Qin Wang

Federated Recommendation Systems (FRSs) offer a privacy-preserving alternative to traditional centralized approaches by decentralizing data storage. However, they face persistent challenges such as data sparsity and heterogeneity, largely…

Information Retrieval · Computer Science 2025-04-14 Zhiwei Li , Guodong Long , Chunxu Zhang , Honglei Zhang , Jing Jiang , Chengqi Zhang

Foundation models (FMs) are increasingly spearheading recent advances on a variety of tasks that fall under the purview of computer audition -- the use of machines to understand sounds. They feature several advantages over traditional…

The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing…

Artificial Intelligence · Computer Science 2026-05-19 Yu Qiao , Huy Q. Le , Avi Deb Raha , Phuong-Nam Tran , Apurba Adhikary , Mengchun Zhang , Loc X. Nguyen , Eui-Nam Huh , Dusit Niyato , Choong Seon Hong

Foundation models (FMs), including large language models, have become increasingly popular due to their wide-ranging applicability and ability to understand human-like semantics. While previous research has explored the use of FMs in…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Peiwen Jiang , Chao-Kai Wen , Xinping Yi , Xiao Li , Shi Jin , Jun Zhang

Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of…

The integration of machine learning techniques has become a cornerstone in the development of intelligent urban services, significantly contributing to the enhancement of urban efficiency, sustainability, and overall livability. Recent…

Computers and Society · Computer Science 2026-03-24 Weijia Zhang , Jindong Han , Zhao Xu , Hang Ni , Tengfei Lyu , Hao Liu , Hui Xiong

The past decade has witnessed the rapid development and adoption of ML & DL methodologies in agricultural systems, showcased by great successes in agricultural applications. However, these conventional ML/DL models have certain limitations:…

Machine Learning · Computer Science 2024-03-19 Jiajia Li , Mingle Xu , Lirong Xiang , Dong Chen , Weichao Zhuang , Xunyuan Yin , Zhaojian Li