English
Related papers

Related papers: Towards Foundation Models for Materials Science: T…

200 papers

In this big data era, the use of large dataset in conjunction with machine learning (ML) has been increasingly popular in both industry and academia. In recent times, the field of materials science is also undergoing a big data revolution,…

Materials Science · Physics 2023-09-27 Sue Sin Chong , Yi Sheng Ng , Hui-Qiong Wang , Jin-Cheng Zheng

Applied machine learning (ML) has rapidly spread throughout the physical sciences; in fact, ML-based data analysis and experimental decision-making has become commonplace. We suggest a shift in the conversation from proving that ML can be…

Materials Science · Physics 2021-12-21 Naohiro Fujinuma , Brian L. DeCost , Jason Hattrick-Simpers , Samuel E. Lofland

Foundation models, as a mainstream technology in artificial intelligence, have demonstrated immense potential across various domains in recent years, particularly in handling complex tasks and multimodal data. In the field of geophysics,…

Geophysics · Physics 2025-04-28 Hanlin Sheng , Xinming Wu , Hang Gao , Haibin Di , Sergey Fomel , Jintao Li , Xu Si

Machine-learned interatomic potentials are revolutionising atomistic materials simulations by providing accurate and scalable predictions within the scope covered by the training data. However, generation of an accurate and robust training…

Materials Science · Physics 2025-07-30 Mariia Radova , Wojciech G. Stark , Connor S. Allen , Reinhard J. Maurer , Albert P. Bartók

Material scientists are increasingly adopting the use of machine learning (ML) for making potentially important decisions, such as, discovery, development, optimization, synthesis and characterization of materials. However, despite ML's…

Computational Physics · Physics 2019-03-12 Bhavya Kailkhura , Brian Gallagher , Sookyung Kim , Anna Hiszpanski , T. Yong-Jin Han

Generative pretraining (the "GPT" in ChatGPT) enables language models to learn from vast amounts of internet text without human supervision. This approach has driven breakthroughs across AI by allowing deep neural networks to learn from…

Neurons and Cognition · Quantitative Biology 2025-09-23 Thomas Serre , Ellie Pavlick

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

Accelerated discovery with machine learning (ML) has begun to provide the advances in efficiency needed to overcome the combinatorial challenge of computational materials design. Nevertheless, ML-accelerated discovery both inherits the…

Materials Science · Physics 2022-05-09 Chenru Duan , Fang Liu , Aditya Nandy , Heather J. Kulik

Deep learning methods for material property prediction have been widely explored to advance materials discovery. However, the prevailing pre-train then fine-tune paradigm often fails to address the inherent diversity and disparity of…

Machine learning has been increasingly applied in climate modeling on system emulation acceleration, data-driven parameter inference, forecasting, and knowledge discovery, addressing challenges such as physical consistency, multi-scale…

The convergence of artificial intelligence and materials science presents a transformative opportunity, but achieving true acceleration in discovery requires moving beyond task-isolated, fine-tuned models toward agentic systems that plan,…

Artificial Intelligence is rapidly transforming materials science and engineering, offering powerful tools to navigate complexity, accelerate discovery, and optimize material design in ways previously unattainable. Driven by the…

In this review, we highlight recent developments in the application of machine learning for molecular modeling and simulation. After giving a brief overview of the foundations, components, and workflow of a typical supervised learning…

Data Analysis, Statistics and Probability · Physics 2019-02-21 Mojtaba Haghighatlari , Johannes Hachmann

While machine learning has emerged in recent years as a useful tool for rapid prediction of materials properties, generating sufficient data to reliably train models without overfitting is still impractical for many applications. Towards…

Materials Science · Physics 2022-07-29 Rees Chang , Yu-Xiong Wang , Elif Ertekin

We introduce a novel continued pre-training method, MELT (MatEriaLs-aware continued pre-Training), specifically designed to efficiently adapt the pre-trained language models (PLMs) for materials science. Unlike previous adaptation…

Computation and Language · Computer Science 2024-10-22 Junho Kim , Yeachan Kim , Jun-Hyung Park , Yerim Oh , Suho Kim , SangKeun Lee

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and materials discovery. Self-supervised pretraining of transformer models requires large-scale…

Machine Learning · Computer Science 2023-10-27 Pei Zhang , Logan Kearney , Debsindhu Bhowmik , Zachary Fox , Amit K. Naskar , John Gounley

Machine-learning (ML) techniques have revolutionized a host of research fields of chemical and materials science with accelerated, high-efficiency discoveries in design, synthesis, manufacturing, characterization and application of novel…

Materials Science · Physics 2021-08-31 Zhexu Xi

The rapid advancement of machine learning and artificial intelligence (AI)-driven techniques is revolutionizing materials discovery, property prediction, and material design by minimizing human intervention and accelerating scientific…

Materials Science · Physics 2026-01-06 Dilshod Nematov , Mirabbos Hojamberdiev

Recent advances in Foundation Models for Materials Science are poised to revolutionize the discovery, manufacture, and design of novel materials with tailored properties and responses. Although great strides have been made, successes have…

Machine Learning · Computer Science 2025-06-16 Michael Buzzy , Andreas Robertson , Peng Chen , Surya Kalidindi

Large language models (LLMs) have demonstrated rapid progress across a wide array of domains. Owing to the very large number of parameters and training data in LLMs, these models inherently encompass an expansive and comprehensive materials…

Materials Science · Physics 2024-11-20 Siyu Liu , Tongqi Wen , A. S. L. Subrahmanyam Pattamatta , David J. Srolovitz