English
Related papers

Related papers: RMFGP: Rotated Multi-fidelity Gaussian process wit…

200 papers

Markov chain Monte Carlo (MCMC) simulation methods are widely used to assess parametric uncertainties of hydrologic models conditioned on measurements of observable state variables. However, when the model is CPU-intensive and…

Optimization and Control · Mathematics 2018-06-18 Jiangjiang Zhang , Jun Man , Guang Lin , Laosheng Wu , Lingzao Zeng

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…

Machine Learning · Statistics 2017-11-15 Hugh Salimbeni , Marc Deisenroth

Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting…

Mean field games (MFGs) describe the collective behavior of large populations of interacting agents. In this work, we tackle ill-posed inverse problems in potential MFGs, aiming to recover the agents' population, momentum, and environmental…

Machine Learning · Computer Science 2025-02-18 Jingguo Zhang , Xianjin Yang , Chenchen Mou , Chao Zhou

This paper investigates a recursive formulation of auto-regressive multi-fidelity Gaussian process regression in the challenging setting of noisy and non-nested high- and low-fidelity data. We propose a decoupled optimization strategy based…

Applications · Statistics 2026-05-21 Nils Baillie , Baptiste Kerleguer , Cyril Feau , Josselin Garnier

We present new large-scale algorithms for fitting a subgradient regularized multivariate convex regression function to $n$ samples in $d$ dimensions -- a key problem in shape constrained nonparametric regression with applications in…

Optimization and Control · Mathematics 2023-12-06 Wenyu Chen , Rahul Mazumder

We propose a parametric sampling strategy for the reduction of large-scale PDE systems with multidimensional input parametric spaces by leveraging models of different fidelity. The design of this methodology allows a user to adaptively…

Numerical Analysis · Mathematics 2023-01-24 Manisha Chetry , Domenico Borzacchiello , Lucas Lestandi , Luisa Rocha Da Silva

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

In many scientific research and engineering applications where repeated simulations of complex systems are conducted, a surrogate is commonly adopted to quickly estimate the whole system. To reduce the expensive cost of generating training…

Machine Learning · Statistics 2023-01-18 Yuxin Wang , Zheng Xing , Wei W. Xing

This paper deals with surrogate modelling of a computer code output in a hierarchical multi-fidelity context, i.e., when the output can be evaluated at different levels of accuracy and computational cost. Using observations of the output at…

Statistics Theory · Mathematics 2023-12-06 Baptiste Kerleguer , Claire Cannamela , Josselin Garnier

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are nonparametric probabilistic models…

Optimization constrained by high-fidelity computational models has potential for transformative impact. However, such optimization is frequently unattainable in practice due to the complexity and computational intensity of the model. An…

Numerical Analysis · Mathematics 2024-06-04 Joseph Hart , Bart van Bloemen Waanders

Multi-fidelity surrogate learning is important for physical simulation related applications in that it avoids running numerical solvers from scratch, which is known to be costly, and it uses multi-fidelity examples for training and greatly…

Machine Learning · Computer Science 2023-11-10 Zheng Wang , Shibo Li , Shikai Fang , Shandian Zhe

With the development of new remote sensing technology, large or even massive spatial datasets covering the globe become available. Statistical analysis of such data is challenging. This article proposes a semiparametric approach to model…

Methodology · Statistics 2019-10-24 Pulong Ma , Emily L. Kang

Gaussian processes (GPs) are generally regarded as the gold standard surrogate model for emulating computationally expensive computer-based simulators. However, the problem of training GPs as accurately as possible with a minimum number of…

Methodology · Statistics 2024-11-26 Hossein Mohammadi , Peter Challenor

In engineering design and scientific computing, computational cost and predictive accuracy are intrinsically coupled. High-fidelity simulations provide accurate predictions but at substantial computational costs, while lower-fidelity…

Machine Learning · Computer Science 2026-05-11 Ahmed Mohamed Eisa Nasr , Ali Elham , Haris Moazam Sheikh

Heteroscedastic regression considering the varying noises among observations has many applications in the fields like machine learning and statistics. Here we focus on the heteroscedastic Gaussian process (HGP) regression which integrates…

Machine Learning · Statistics 2020-01-22 Haitao Liu , Yew-Soon Ong , Jianfei Cai

Gradient-based dimension reduction decreases the cost of Bayesian inference and probabilistic modeling by identifying maximally informative (and informed) low-dimensional projections of the data and parameters, allowing high-dimensional…

Computation · Statistics 2025-06-02 Ricardo Baptista , Michael Brennan , Youssef Marzouk

The increasing significance of digital twin technology across engineering and industrial domains, such as aerospace, infrastructure, and automotive, is undeniable. However, the lack of detailed application-specific information poses…

Machine Learning · Computer Science 2023-06-27 AS Desai , Navaneeth N , S Adhikari , S Chakraborty

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic…

Machine Learning · Computer Science 2025-08-26 Harrison J. Goldwyn , Mitchell Krock , Johann Rudi , Daniel Getter , Julie Bessac