English
Related papers

Related papers: A Reference Architecture for Designing Foundation …

200 papers

This paper surveys foundation models for AI-enabled biological design, focusing on recent developments in applying large-scale, self-supervised models to tasks such as protein engineering, small molecule design, and genomic sequence design.…

Artificial Intelligence · Computer Science 2025-05-20 Asher Moldwin , Amarda Shehu

Foundation model-enabled generative artificial intelligence facilitates the development and implementation of agents, which can leverage distinguished reasoning and language processing capabilities to takes a proactive, autonomous role to…

Artificial Intelligence · Computer Science 2024-11-07 Yue Liu , Sin Kit Lo , Qinghua Lu , Liming Zhu , Dehai Zhao , Xiwei Xu , Stefan Harrer , Jon Whittle

Multimodal models are expected to be a critical component to future advances in artificial intelligence. This field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural…

Computation and Language · Computer Science 2024-06-11 Sai Munikoti , Ian Stewart , Sameera Horawalavithana , Henry Kvinge , Tegan Emerson , Sandra E Thompson , Karl Pazdernik

The rapid integration of Artificial Intelligence (AI) into organizational technology frameworks has transformed how organizations engage with AI-driven models, influencing both operational performance and strategic innovation. With the…

Software Engineering · Computer Science 2025-10-22 Johannes Schneider , Rene Abraham

Utilising quantum computing technology to enhance artificial intelligence systems is expected to improve training and inference times, increase robustness against noise and adversarial attacks, and reduce the number of parameters without…

Software Engineering · Computer Science 2024-12-18 Mykhailo Klymenko , Thong Hoang , Xiwei Xu , Zhenchang Xing , Muhammad Usman , Qinghua Lu , Liming Zhu

Foundation models--such as GPT, CLIP, and DINO--have achieved revolutionary progress in the past several years and are commonly believed to be a promising approach for general-purpose AI. In particular, self-supervised learning is adopted…

Cryptography and Security · Computer Science 2023-06-12 Jinyuan Jia , Hongbin Liu , Neil Zhenqiang Gong

We present the first large-scale analysis of AI foundation model usage in science - not just citations or keywords. We find that adoption has grown rapidly, at nearly-exponential rates, with the highest uptake in Linguistics, Computer…

Digital Libraries · Computer Science 2025-12-01 Ana Trišović , Alex Fogelson , Janakan Sivaloganathan , Neil Thompson

As artificial intelligence systems become increasingly integrated into daily life, the field of explainability has gained significant attention. This trend is particularly driven by the complexity of modern AI models and their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Foundational models have caused a paradigm shift in the way artificial intelligence (AI) systems are built. They have had a major impact in natural language processing (NLP), and several other domains, not only reducing the amount of…

Networking and Internet Architecture · Computer Science 2022-11-15 Franck Le , Mudhakar Srivatsa , Raghu Ganti , Vyas Sekar

Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions. Once pretrained, large AI models demonstrate impressive…

Artificial Intelligence · Computer Science 2023-09-26 Jianing Qiu , Lin Li , Jiankai Sun , Jiachuan Peng , Peilun Shi , Ruiyang Zhang , Yinzhao Dong , Kyle Lam , Frank P. -W. Lo , Bo Xiao , Wu Yuan , Ningli Wang , Dong Xu , Benny Lo

Although AI has significant potential to transform society, there are serious concerns about its ability to behave and make decisions responsibly. Many ethical regulations, principles, and guidelines for responsible AI have been issued…

Artificial Intelligence · Computer Science 2022-09-21 Qinghua Lu , Liming Zhu , Xiwei Xu , Jon Whittle

One goal of AI (and AGI) is to identify and understand specific mechanisms and representations sufficient for general intelligence. Often, this work manifests in research focused on architectures and many cognitive architectures have been…

Artificial Intelligence · Computer Science 2025-06-17 Robert E. Wray , James R. Kirk , John E. Laird

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

The integration of large language models into software systems is transforming capabilities such as natural language understanding, decision-making, and autonomous task execution. However, the absence of a commonly accepted software…

Software Engineering · Computer Science 2025-01-23 Alessio Bucaioni , Martin Weyssow , Junda He , Yunbo Lyu , David Lo

Over the past year, there has been a robust debate about the benefits and risks of open sourcing foundation models. However, this discussion has often taken place at a high level of generality or with a narrow focus on specific technical…

Artificial intelligence (AI) in its various forms finds more and more its way into complex distributed systems. For instance, it is used locally, as part of a sensor system, on the edge for low-latency high-performance inference, or in the…

Software Engineering · Computer Science 2022-12-29 Hans-Martin Heyn , Eric Knauss , Patrizio Pelliccione

Artificial intelligence (AI) has significantly advanced Earth sciences, yet its full potential in to comprehensively modeling Earth's complex dynamics remains unrealized. Geoscience foundation models (GFMs) emerge as a paradigm-shifting…

Artificial Intelligence · Computer Science 2024-11-13 Hao Zhang , Jin-Jian Xu , Hong-Wei Cui , Lin Li , Yaowen Yang , Chao-Sheng Tang , Niklas Boers

The world has recently witnessed an unprecedented acceleration in demands for Machine Learning and Artificial Intelligence applications. This spike in demand has imposed tremendous strain on the underlying technology stack in supply chain,…

Emerging Technologies · Computer Science 2024-10-15 Paolo Faraboschi , Ellis Giles , Justin Hotard , Konstanty Owczarek , Andrew Wheeler

As a current trend in Artificial Intelligence (AI), large foundation models are increasingly employed as the core of AI services. However, even after training, serving such models at scale remains a challenging task due to their heavy…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-17 Tingyang Sun , Ting He , I-Hong Hou

Federated machine learning is growing fast in academia and industries as a solution to solve data hungriness and privacy issues in machine learning. Being a widely distributed system, federated machine learning requires various system…

Machine Learning · Computer Science 2023-05-01 Sin Kit Lo , Qinghua Lu , Hye-Young Paik , Liming Zhu