English
Related papers

Related papers: Foundation models in brief: A historical, socio-te…

200 papers

Seismic processing plays a crucial role in transforming raw data into high-quality subsurface images, pivotal for various geoscience applications. Despite its importance, traditional seismic processing techniques face challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Fabian Fuchs , Mario Ruben Fernandez , Norman Ettrich , Janis Keuper

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

Machine Learning · Computer Science 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Foundation model, which is pre-trained on broad data and is able to adapt to a wide range of tasks, is advancing healthcare. It promotes the development of healthcare artificial intelligence (AI) models, breaking the contradiction between…

Computers and Society · Computer Science 2024-04-05 Yuting He , Fuxiang Huang , Xinrui Jiang , Yuxiang Nie , Minghao Wang , Jiguang Wang , Hao Chen

Growing interest and investment in the capabilities of foundation models has positioned such systems to impact a wide array of public services. Alongside these opportunities is the risk that these systems reify existing power imbalances and…

Computers and Society · Computer Science 2024-05-31 Harini Suresh , Emily Tseng , Meg Young , Mary L. Gray , Emma Pierson , Karen Levy

Artificial intelligence (AI) has emerged as a pivotal enabler for next-generation wireless communication systems. However, conventional AI-based models encounter several limitations, such as heavy reliance on labeled data, limited…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Jun Jiang , Yuan Gao , Xinyi Wu , Shugong Xu

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks. These models leverage…

Machine Learning · Computer Science 2025-07-22 Xinliang Zhou , Chenyu Liu , Zhisheng Chen , Kun Wang , Yi Ding , Ziyu Jia , Qingsong Wen

The latest advancements in machine learning, specifically in foundation models, are revolutionizing the frontiers of existing software engineering (SE) processes. This is a bi-directional phenomona, where 1) software systems are now…

Software Engineering · Computer Science 2024-06-27 Luís Cruz , Xavier Franch Gutierrez , Silverio Martínez-Fernández

Advances in machine learning over the past decade have resulted in a proliferation of algorithmic applications for encoding, characterizing, and acting on complex data that may contain many high dimensional features. Recently, the emergence…

Following its success for vision and text, the "foundation model" (FM) paradigm -- pretraining large models on massive data, then fine-tuning on target tasks -- has rapidly expanded to domains in the sciences, engineering, healthcare, and…

Machine Learning · Computer Science 2025-03-24 Zongzhe Xu , Ritvik Gupta , Wenduo Cheng , Alexander Shen , Junhong Shen , Ameet Talwalkar , Mikhail Khodak

The rapid advancement of foundation models in medical imaging represents a significant leap toward enhancing diagnostic accuracy and personalized treatment. However, the deployment of foundation models in healthcare necessitates a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Congzhen Shi , Ryan Rezai , Jiaxi Yang , Qi Dou , Xiaoxiao Li

Powerful foundation models, including large language models (LLMs), with Transformer architectures have ushered in a new era of Generative AI across various industries. Industry and research community have witnessed a large number of new…

We present the first large-scale analysis of AI foundation model usage in science - not just citations or keywords. We find that adoption has grown rapidly, at nearly-exponential rates, with the highest uptake in Linguistics, Computer…

Digital Libraries · Computer Science 2025-12-01 Ana Trišović , Alex Fogelson , Janakan Sivaloganathan , Neil Thompson

Current regulations on powerful AI capabilities are narrowly focused on "foundation" or "frontier" models. However, these terms are vague and inconsistently defined, leading to an unstable foundation for governance efforts. Critically,…

Computers and Society · Computer Science 2024-09-27 Ritwik Gupta , Leah Walker , Rodolfo Corona , Stephanie Fu , Suzanne Petryk , Janet Napolitano , Trevor Darrell , Andrew W. Reddie

Music is essential in daily life, fulfilling emotional and entertainment needs, and connecting us personally, socially, and culturally. A better understanding of music can enhance our emotions, cognitive skills, and cultural connections.…

Recent advances in machine learning have made revolutionary breakthroughs in computer games, image and natural language understanding, and scientific discovery. Foundation models and large-scale language models (LLMs) have recently achieved…

Neurons and Cognition · Quantitative Biology 2023-10-31 Ran Wang , Zhe Sage Chen

Foundation models have demonstrated remarkable generalization, data efficiency, and robustness properties across various domains. In this paper, we explore the feasibility of foundation models for applications in the control domain. The…

Machine Learning · Computer Science 2024-12-18 Martin Ziegler , Andres Felipe Posada-Moreno , Friedrich Solowjow , Sebastian Trimpe

Foundation models have demonstrated a great ability to achieve general human-level intelligence far beyond traditional approaches. As the technique keeps attracting attention from the AI community, an increasing number of foundation models…

Computation and Language · Computer Science 2024-05-07 Shizhe Diao , Rui Pan , Hanze Dong , Ka Shun Shum , Jipeng Zhang , Wei Xiong , Tong Zhang

As artificial intelligence systems become increasingly integrated into daily life, the field of explainability has gained significant attention. This trend is particularly driven by the complexity of modern AI models and their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

The chapter discusses the foundational impact of modern generative AI models on information access (IA) systems. In contrast to traditional AI, the large-scale training and superior data modeling of generative AI models enable them to…

Information Retrieval · Computer Science 2025-01-07 Qingyao Ai , Jingtao Zhan , Yiqun Liu