English

Projection-based multifidelity linear regression for data-scarce applications

Machine Learning 2026-03-31 v1 Computational Engineering, Finance, and Science Machine Learning

Abstract

Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear regression targeting data-limited applications with high-dimensional outputs. Multifidelity methods integrate many inexpensive low-fidelity model evaluations with limited, costly high-fidelity evaluations. We introduce two projection-based multifidelity linear regression approaches that leverage principal component basis vectors for dimensionality reduction and combine multifidelity data through: (i) a direct data augmentation using low-fidelity data, and (ii) a data augmentation incorporating explicit linear corrections between low-fidelity and high-fidelity data. The data augmentation approaches combine high-fidelity and low-fidelity data into a unified training set and train the linear regression model through weighted least squares with fidelity-specific weights. Various weighting schemes and their impact on regression accuracy are explored. The proposed multifidelity linear regression methods are demonstrated on approximating the surface pressure field of a hypersonic vehicle in flight. In a low-data regime of no more than ten high-fidelity samples, multifidelity linear regression achieves approximately 3% - 12% improvement in median accuracy compared to single-fidelity methods with comparable computational cost.

Keywords

Cite

@article{arxiv.2508.08517,
  title  = {Projection-based multifidelity linear regression for data-scarce applications},
  author = {Vignesh Sella and Julie Pham and Karen Willcox and Anirban Chaudhuri},
  journal= {arXiv preprint arXiv:2508.08517},
  year   = {2026}
}

Comments

23 page, 7 figures, submitted to Machine Learning for Computational Science and Engineering special issue Accelerating Numerical Methods With Scientific Machine Learning

R2 v1 2026-07-01T04:45:21.135Z