English
Related papers

Related papers: Multifidelity Cross-validation

200 papers

Multi-output Gaussian process (MOGP) regression allows modelling dependencies among multiple correlated response variables. Similarly to standard Gaussian processes, MOGPs are sensitive to model misspecification and outliers, which can…

We present a hybrid sampling-surrogate approach for reducing the computational expense of uncertainty quantification in nonlinear dynamical systems. Our motivation is to enable rapid uncertainty quantification in complex mechanical systems…

Computation · Statistics 2022-01-27 Hang Yang , Yuji Fujii , K. W. Wang , Alex A. Gorodetsky

Statistical machine learning models should be evaluated and validated before putting to work. Conventional k-fold Monte Carlo Cross-Validation (MCCV) procedure uses a pseudo-random sequence to partition instances into k subsets, which…

Machine Learning · Statistics 2019-07-05 Liang Guo , Jianya Liu , Ruodan Lu

Uncertainty Quantification (UQ) is receiving more and more attention for engineering applications in particular from robust optimization. Indeed, running a computer experiment only provides a limited knowledge in terms of uncertainty and…

Computer simulations often involve both qualitative and numerical inputs. Existing Gaussian process (GP) methods for handling this mainly assume a different response surface for each combination of levels of the qualitative factors and…

Machine Learning · Statistics 2019-01-31 Yichi Zhang , Siyu Tao , Wei Chen , Daniel W. Apley

Markov chain Monte Carlo (MCMC) is an established approach for uncertainty quantification and propagation in scientific applications. A key challenge in applying MCMC to scientific domains is computation: the target density of interest is…

Machine Learning · Statistics 2022-10-05 Diana Cai , Ryan P. Adams

Accurately modelling the Earth's climate has widespread applications ranging from forecasting local weather to understanding global climate change. Low-fidelity simulations of climate phenomena are readily available, but high-fidelity…

Atmospheric and Oceanic Physics · Physics 2021-09-17 Ben Hudson , Frederik Nijweide , Isaac Sebenius

High-fidelity numerical simulations of partial differential equations (PDEs) given a restricted computational budget can significantly limit the number of parameter configurations considered and/or time window evaluated for modeling a given…

Machine Learning · Computer Science 2023-09-04 Paolo Conti , Mengwu Guo , Andrea Manzoni , Attilio Frangi , Steven L. Brunton , J. Nathan Kutz

We present an approach for constructing a surrogate from ensembles of information sources of varying cost and accuracy. The multifidelity surrogate encodes connections between information sources as a directed acyclic graph, and is trained…

Machine Learning · Computer Science 2021-08-25 Alex Gorodetsky , John D. Jakeman , Gianluca Geraci

For linear models that may have asymmetric errors, we study variable selection by cross-validation. The data are split into training and validation sets, with the number of observations in the validation set much larger than in the training…

Methodology · Statistics 2026-01-16 Bilel Bousselmi , Gabriela Ciuperca

Risk assessment of hurricane-driven storm surge relies on deterministic computer models that produce outputs over a large spatial domain. The surge models can often be run at a range of fidelity levels, with greater precision yielding more…

Methodology · Statistics 2026-03-31 Cyrus S. McCrimmon , Pulong Ma

In the present work, we consider multi-fidelity surrogate modelling to fuse the output of multiple aero-servo-elastic computer simulators of varying complexity. In many instances, predictions from multiple simulators for the same quantity…

Computation · Statistics 2017-09-25 I. Abdallah , C. Lataniotis , B. Sudret

Solving inverse problems in cardiovascular modeling is particularly challenging due to the high computational cost of running high-fidelity simulations. In this work, we focus on Bayesian parameter estimation and explore different methods…

Machine Learning · Statistics 2025-12-22 Chloe H. Choi , Andrea Zanoni , Daniele E. Schiavazzi , Alison L. Marsden

Bayesian cross-validation (CV) is a popular method for predictive model assessment that is simple to implement and broadly applicable. A wide range of CV schemes is available for time series applications, including generic leave-one-out…

Methodology · Statistics 2023-10-12 Alex Cooper , Dan Simpson , Lauren Kennedy , Catherine Forbes , Aki Vehtari

A vital stage in the mathematical modelling of real-world systems is to calibrate a model's parameters to observed data. Likelihood-free parameter inference methods, such as Approximate Bayesian Computation, build Monte Carlo samples of the…

Computation · Statistics 2021-12-23 Thomas P Prescott , Ruth E Baker

Multi-task regression attempts to exploit the task similarity in order to achieve knowledge transfer across related tasks for performance improvement. The application of Gaussian process (GP) in this scenario yields the non-parametric yet…

Machine Learning · Statistics 2021-09-21 Haitao Liu , Jiaqi Ding , Xinyu Xie , Xiaomo Jiang , Yusong Zhao , Xiaofang Wang

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

Machine Learning · Statistics 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Surrogate models are often used to replace costly-to-evaluate complex coastal codes to achieve substantial computational savings. In many of those models, the hydrometeorological forcing conditions (inputs) or flood events (outputs) are…

Machine Learning · Statistics 2021-11-04 A. F. López-Lopera , D. Idier , J. Rohmer , F. Bachoc

As a technique that can compactly represent complex patterns, machine learning has significant potential for predictive inference. K-fold cross-validation (CV) is the most common approach to ascertaining the likelihood that a machine…

Machine Learning · Statistics 2026-04-24 Juan M Gorriz , R. Martin Clemente , F Segovia , J Ramirez , A Ortiz , J. Suckling

We construct flexible likelihoods for multi-output Gaussian process models that leverage neural networks as components. We make use of sparse variational inference methods to enable scalable approximate inference for the resulting class of…

Machine Learning · Statistics 2019-06-03 Martin Jankowiak , Jacob Gardner