English

Machine learning of microstructure--property relationships in materials leveraging microstructure representation from foundational vision transformers

Computer Vision and Pattern Recognition 2025-06-27 v2 Materials Science Machine Learning Computational Physics

Abstract

Machine learning of microstructure--property relationships from data is an emerging approach in computational materials science. Most existing machine learning efforts focus on the development of task-specific models for each microstructure--property relationship. We propose utilizing pre-trained foundational vision transformers for the extraction of task-agnostic microstructure features and subsequent light-weight machine learning of a microstructure-dependent property. We demonstrate our approach with pre-trained state-of-the-art vision transformers (CLIP, DINOv2, SAM) in two case studies on machine-learning: (i) elastic modulus of two-phase microstructures based on simulations data; and (ii) Vicker's hardness of Ni-base and Co-base superalloys based on experimental data published in literature. Our results show the potential of foundational vision transformers for robust microstructure representation and efficient machine learning of microstructure--property relationships without the need for expensive task-specific training or fine-tuning of bespoke deep learning models.

Keywords

Cite

@article{arxiv.2501.18637,
  title  = {Machine learning of microstructure--property relationships in materials leveraging microstructure representation from foundational vision transformers},
  author = {Sheila E. Whitman and Marat I. Latypov},
  journal= {arXiv preprint arXiv:2501.18637},
  year   = {2025}
}
R2 v1 2026-06-28T21:26:20.289Z