English
Related papers

Related papers: Multifidelity Cross-validation

200 papers

Multi-fidelity machine learning methods address the accuracy-efficiency trade-off by integrating scarce, resource-intensive high-fidelity data with abundant but less accurate low-fidelity data. We propose a practical multi-fidelity strategy…

Machine Learning · Computer Science 2025-03-26 Jiaxiang Yi , Ji Cheng , Miguel A. Bessa

To balance quality and cost, various domain areas of science and engineering run simulations at multiple levels of sophistication. Multi-fidelity active learning aims to learn a direct mapping from input parameters to simulation outputs at…

Machine Learning · Computer Science 2023-06-06 Dongxia Wu , Ruijia Niu , Matteo Chinazzi , Yian Ma , Rose Yu

Monte Carlo (MC) sampling is a popular method for estimating the statistics (e.g. expectation and variance) of a random variable. Its slow convergence has led to the emergence of advanced techniques to reduce the variance of the MC…

Statistics Theory · Mathematics 2024-06-21 Mohamed Reda El Amri , Paul Mycek , Sophie Ricci , Matthias De Lozzo

Resided at the intersection of multi-fidelity optimization (MFO) and Bayesian optimization (BO), MF BO has found a niche in solving expensive engineering design optimization problems, thanks to its advantages in incorporating physical and…

Computational Engineering, Finance, and Science · Computer Science 2026-01-01 Bach Do , Ruda Zhang

In many practical cases, a sensitivity analysis or an optimization of a complex time consuming computer code requires to build a fast running approximation of it - also called surrogate model. We consider in this paper the problem of…

Statistics Theory · Mathematics 2013-01-14 Loic Le Gratiet

How can we efficiently gather information to optimize an unknown function, when presented with multiple, mutually dependent information sources with different costs? For example, when optimizing a robotic system, intelligently trading off…

Machine Learning · Computer Science 2018-11-05 Jialin Song , Yuxin Chen , Yisong Yue

Composite materials exhibit strongly hierarchical and anisotropic properties governed by coupled mechanisms spanning constituents, plies, laminates, structures, and manufacturing history. This intrinsic complexity makes predictive modeling…

Computational Physics · Physics 2026-05-05 Haizhou Wen , Elham Kiyani , Gang Li , Srikanth Pilla , George Em Karniadakis , Zhen Li

Multi-fidelity modeling and calibration are data fusion tasks that ubiquitously arise in engineering design. In this paper, we introduce a novel approach based on latent-map Gaussian processes (LMGPs) that enables efficient and accurate…

Machine Learning · Statistics 2022-01-17 Nicholas Oune , Jonathan Tammer Eweis-Labolle , Ramin Bostanabad

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

This paper deals with the Gaussian process based approximation of a code which can be run at different levels of accuracy. This method, which is a particular case of co-kriging, allows us to improve a surrogate model of a complex computer…

Statistics Theory · Mathematics 2012-09-25 Loic Le Gratiet

The key task of physical simulation is to solve partial differential equations (PDEs) on discretized domains, which is known to be costly. In particular, high-fidelity solutions are much more expensive than low-fidelity ones. To reduce the…

Machine Learning · Statistics 2020-06-11 Zheng Wang , Wei Xing , Robert Kirby , Shandian Zhe

Emulating high-accuracy computationally expensive models is crucial for tasks requiring numerous model evaluations, such as uncertainty quantification and optimization. When lower-fidelity models are available, they can be used to improve…

Methodology · Statistics 2024-10-30 Katerina Giannoukou , Stefano Marelli , Bruno Sudret

Standard techniques such as leave-one-out cross-validation (LOOCV) might not be suitable for evaluating the predictive performance of models incorporating structured random effects. In such cases, the correlation between the training and…

Methodology · Statistics 2024-06-21 A. Adin , E. Krainski , A. Lenzi , Z. Liu , J. Martínez-Minaya , H. Rue

With advances in scientific computing and mathematical modeling, complex scientific phenomena such as galaxy formations and rocket propulsion can now be reliably simulated. Such simulations can however be very time-intensive, requiring…

Methodology · Statistics 2024-02-29 Yi Ji , Simon Mak , Derek Soeder , J-F Paquet , Steffen A. Bass

Multifidelity surrogate modelling combines data of varying accuracy and cost from different sources. It strategically uses low-fidelity models for rapid evaluations, saving computational resources, and high-fidelity models for detailed…

Machine Learning · Computer Science 2024-04-24 Daniel N Wilke

We develop tools to do valid post-selective inference for a family of model selection procedures, including choosing a model via cross-validated Lasso. The tools apply universally when the following random vectors are jointly asymptotically…

Methodology · Statistics 2018-02-13 Jelena Markovic , Lucy Xia , Jonathan Taylor

Multi-fidelity Gaussian process is a common approach to address the extensive computationally demanding algorithms such as optimization, calibration and uncertainty quantification. Adaptive sampling for multi-fidelity Gaussian process is a…

Machine Learning · Statistics 2019-07-30 Sayan Ghosh , Jesper Kristensen , Yiming Zhang , Waad Subber , Liping Wang

Gaussian process (GP) models are widely used to analyze spatially referenced data and to predict values at locations without observations. In contrast to many algorithmic procedures, GP models are based on a statistical framework, which…

Computation · Statistics 2020-01-01 Florian Gerber , Douglas W. Nychka

We present a multi-fidelity method for uncertainty quantification of parameter estimates in complex systems, leveraging generative models trained to sample the target conditional distribution. In the Bayesian inference setting, traditional…

Machine Learning · Computer Science 2025-04-03 Caroline Tatsuoka , Minglei Yang , Dongbin Xiu , Guannan Zhang

Monte Carlo simulation is often used for the reliability assessment of power systems, but it converges slowly when the system is complex. Multilevel Monte Carlo (MLMC) can be applied to speed up computation without compromises on model…

Computation · Statistics 2022-07-12 Ensieh Sharifnia , Simon Tindemans