English
Related papers

Related papers: All-in-one foundational models learning across qua…

200 papers

Amorphous materials are coming within reach of realistic computer simulations, but new approaches are needed to fully understand their intricate atomic structures. Here, we show how machine-learning (ML)-based techniques can give new,…

Hybrid quantum-classical learning models increasingly integrate neural networks with variational quantum circuits (VQCs) to exploit complementary inductive biases. However, many existing approaches rely on tightly coupled architectures or…

Machine Learning · Computer Science 2026-01-30 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hsiu Hsieh , Hector Zenil , Jesper Tegner

The development of accurate and transferable machine learning (ML) potentials for predicting molecular energetics is a challenging task. The process of data generation to train such ML potentials is a task neither well understood nor…

Computational Physics · Physics 2018-05-25 Justin S. Smith , Ben Nebgen , Nicholas Lubbers , Olexandr Isayev , Adrian E. Roitberg

We present an attention-based foundation model architecture for learning and predicting quantum states across Hamiltonian parameters, system sizes, and physical systems. Using only basis configurations and physical parameters as inputs, our…

Strongly Correlated Electrons · Physics 2025-12-16 Timothy Zaklama , Daniele Guerci , Liang Fu

Determining the stability of molecules and condensed phases is the cornerstone of atomistic modelling, underpinning our understanding of chemical and materials properties and transformations. Here we show that a machine learning model,…

Foundational Models are an emerging widely used technique of GenAI. These models are distinguished by their scalability and the ease with which they can be adapted through the exploitation of Transfer Learning. The availability of high…

Machine Learning · Computer Science 2025-05-13 M. Germán-Morales , A. J. Rivera-Rivas , M. J. del Jesus Díaz , C. J. Carmona

Traditional atomistic machine learning (ML) models serve as surrogates for quantum mechanical (QM) properties, predicting quantities such as dipole moments and polarizabilities, directly from compositions and geometries of atomic…

As foundation models (FMs) continue to shape the landscape of AI, the in-context learning (ICL) paradigm thrives but also encounters issues such as toxicity, hallucination, disparity, adversarial vulnerability, and inconsistency. Ensuring…

Machine Learning · Computer Science 2024-02-28 Yunpeng Huang , Yaonan Gu , Jingwei Xu , Zhihong Zhu , Zhaorun Chen , Xiaoxing Ma

Foundation models are highly versatile neural-network architectures capable of processing different data types, such as text and images, and generalizing across various tasks like classification and generation. Inspired by this success, we…

QML-HCS is a research-grade framework for constructing and analyzing quantum-inspired machine learning models operating under hypercausal feedback dynamics. Hypercausal refers to AI systems that leverage extended, deep, or nonlinear causal…

Machine Learning · Computer Science 2025-11-25 Hector E Mozo

Rapid developments of AI tools are expected to offer unprecedented assistance to the research of natural science including chemistry. However, neither existing unimodal task-specific specialist models nor emerging general large multimodal…

Machine Learning · Computer Science 2025-01-03 Zihan Zhao , Bo Chen , Jingpiao Li , Lu Chen , Liyang Wen , Pengyu Wang , Zichen Zhu , Danyang Zhang , Ziping Wan , Yansi Li , Zhongyang Dai , Xin Chen , Kai Yu

Foundation models have been transformational in machine learning fields such as natural language processing and computer vision. Similar success in atomic property prediction has been limited due to the challenges of training effective…

Machine Learning · Computer Science 2024-05-07 Nima Shoghi , Adeesh Kolluru , John R. Kitchin , Zachary W. Ulissi , C. Lawrence Zitnick , Brandon M. Wood

This tutorial intends to introduce readers with a background in AI to quantum machine learning (QML) -- a rapidly evolving field that seeks to leverage the power of quantum computers to reshape the landscape of machine learning. For…

Developing accurate models for chemical reactors is often challenging due to the complexity of reaction kinetics and process dynamics. Traditional approaches require retraining models for each new system, limiting generalizability and…

Computational Engineering, Finance, and Science · Computer Science 2025-05-29 Zihao Wang , Zhe Wu

Foundation models are multi-dataset and multi-task machine learning methods that once pre-trained can be fine-tuned for a large variety of downstream applications. The successful development of such general-purpose models for physics data…

High Energy Physics - Phenomenology · Physics 2024-09-10 Joschka Birk , Anna Hallin , Gregor Kasieczka

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Quantum Machine Learning (QML) represents a promising frontier at the intersection of quantum computing and artificial intelligence, aiming to leverage quantum computational advantages to enhance data-driven tasks. This review explores the…

Machine Learning · Computer Science 2025-07-14 Samarth Kashyap , Rohit K Ramakrishnan , Kumari Jyoti , Apoorva D Patel

Machine learning approaches, enabled by the emergence of comprehensive databases of materials properties, are becoming a fruitful direction for materials analysis. As a result, a plethora of models have been constructed and trained on…

Developing machine learning-based interatomic potentials from ab-initio electronic structure methods remains a challenging task for computational chemistry and materials science. This work studies the capability of transfer learning, in…

Computational Physics · Physics 2023-03-22 Viktor Zaverkin , David Holzmüller , Luca Bonfirraro , Johannes Kästner

Artificial Intelligence (AI) has demonstrated unprecedented performance across various domains, and its application to communication systems is an active area of research. While current methods focus on task-specific solutions, the broader…

Artificial Intelligence · Computer Science 2025-05-21 Davide Buffelli , Sowmen Das , Yu-Wei Lin , Sattar Vakili , Chien-Yi Wang , Masoud Attarifar , Pritthijit Nath , Da-shan Shiu