English
Related papers

Related papers: Multi-fidelity classification using Gaussian proce…

200 papers

Challenges in multi-fidelity modeling relate to accuracy, uncertainty estimation and high-dimensionality. A novel additive structure is introduced in which the highest fidelity solution is written as a sum of the lowest fidelity solution…

Machine Learning · Computer Science 2021-04-09 Wei W. Xing , Akeel A. Shah , Peng Wang , Shandian Zhe Qian Fu , Robert. M. Kirby

Fitting a theoretical model to experimental data in a Bayesian manner using Markov chain Monte Carlo typically requires one to evaluate the model thousands (or millions) of times. When the model is a slow-to-compute physics simulation,…

Machine Learning · Statistics 2022-08-25 Steven Stetzler , Michael Grosskopf , Earl Lawrence

Machine learning (ML) methods, which fit to data the parameters of a given parameterized model class, have garnered significant interest as potential methods for learning surrogate models for complex engineering systems for which…

Machine Learning · Statistics 2024-07-03 Elizabeth Qian , Dayoung Kang , Vignesh Sella , Anirban Chaudhuri

Markov chain Monte Carlo (MCMC) is an established approach for uncertainty quantification and propagation in scientific applications. A key challenge in applying MCMC to scientific domains is computation: the target density of interest is…

Machine Learning · Statistics 2022-10-05 Diana Cai , Ryan P. Adams

Highly accurate numerical or physical experiments are often time-consuming or expensive to obtain. When time or budget restrictions prohibit the generation of additional data, the amount of available samples may be too limited to provide…

Numerical Analysis · Mathematics 2021-12-22 Mengwu Guo , Andrea Manzoni , Maurice Amendt , Paolo Conti , Jan S. Hesthaven

Multi-fidelity modelling arises in many situations in computational science and engineering world. It enables accurate inference even when only a small set of accurate data is available. Those data often come from a high-fidelity model,…

Machine Learning · Statistics 2022-04-12 Jiahao Zhang , Shiqi Zhang , Guang Lin

With advances in scientific computing and mathematical modeling, complex scientific phenomena such as galaxy formations and rocket propulsion can now be reliably simulated. Such simulations can however be very time-intensive, requiring…

Methodology · Statistics 2024-02-29 Yi Ji , Simon Mak , Derek Soeder , J-F Paquet , Steffen A. Bass

In an era where scientific experimentation is often costly, multi-fidelity emulation provides a powerful tool for predictive scientific computing. While there has been notable work on multi-fidelity modeling, existing models do not…

This paper deals with the Gaussian process based approximation of a code which can be run at different levels of accuracy. This method, which is a particular case of co-kriging, allows us to improve a surrogate model of a complex computer…

Statistics Theory · Mathematics 2012-09-25 Loic Le Gratiet

Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, full-scale approximations…

Methodology · Statistics 2026-01-13 Tim Gyger , Reinhard Furrer , Fabio Sigrist

The design process of complex systems such as new configurations of aircraft or launch vehicles is usually decomposed in different phases which are characterized for instance by the depth of the analyses in terms of number of design…

Machine Learning · Computer Science 2020-07-01 Loïc Brevault , Mathieu Balesdent , Ali Hebbal

This work focuses on the design of experiments of multi-fidelity computer experiments. We consider the autoregressive Gaussian process model proposed by Kennedy and O'Hagan (2000) and the optimal nested design that maximizes the prediction…

Methodology · Statistics 2024-06-03 Gecheng Chen , Rui Tuo

We propose a new scalable multi-class Gaussian process classification approach building on a novel modified softmax likelihood function. The new likelihood has two benefits: it leads to well-calibrated uncertainty estimates and allows for…

Machine Learning · Statistics 2019-05-24 Théo Galy-Fajou , Florian Wenzel , Christian Donner , Manfred Opper

We present methods for emulating the matter power spectrum by combining information from cosmological $N$-body simulations at different resolutions. An emulator allows estimation of simulation output by interpolating across the parameter…

Cosmology and Nongalactic Astrophysics · Physics 2021-11-17 Ming-Feng Ho , Simeon Bird , Christian R. Shelton

This paper investigates a recursive formulation of auto-regressive multi-fidelity Gaussian process regression in the challenging setting of noisy and non-nested high- and low-fidelity data. We propose a decoupled optimization strategy based…

Applications · Statistics 2026-05-21 Nils Baillie , Baptiste Kerleguer , Cyril Feau , Josselin Garnier

Models of stochastic processes are widely used in almost all fields of science. Theory validation, parameter estimation, and prediction all require model calibration and statistical inference using data. However, data are almost always…

Computation · Statistics 2022-09-07 David J. Warne , Thomas P. Prescott , Ruth E. Baker , Matthew J. Simpson

Gaussian processes are employed for non-parametric regression in a Bayesian setting. They generalize linear regression, embedding the inputs in a latent manifold inside an infinite-dimensional reproducing kernel Hilbert space. We can…

Numerical Analysis · Mathematics 2021-07-13 Francesco Romor , Marco Tezzele , Gianluigi Rozza

This paper presents an efficient multi-fidelity Bayesian optimization approach for analog circuit synthesis. The proposed method can significantly reduce the overall computational cost by fusing the simple but potentially inaccurate…

Systems and Control · Electrical Eng. & Systems 2019-12-03 Shuhan Zhang , Wenlong Lyu , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng , Xiangdong Hu

Emulating the mapping between quantities of interest and their control parameters using surrogate models finds widespread application in engineering design, including in numerical optimization and uncertainty quantification. Gaussian…

Computation · Statistics 2024-07-02 S. Ashwin Renganathan , Kade Carlson

Investigating uncertainties in computer simulations can be prohibitive in terms of computational costs, since the simulator needs to be run over a large number of input values. Building an emulator, i.e. a statistical surrogate model of the…

Methodology · Statistics 2022-10-18 Ayao Ehara , Serge Guillas