English
Related papers

Related papers: Convergence Certificate for Stochastic Derivative-…

200 papers

Numerous engineering problems of interest to the industry are often characterized by expensive black-box objective experiments or computer simulations. Obtaining insight into the problem or performing subsequent optimizations requires…

Machine Learning · Statistics 2019-07-29 Piyush Pandita , Jesper Kristensen , Liping Wang

Multifidelity models integrate data from multiple sources to produce a single approximator for the underlying process. Dense low-fidelity samples are used to reduce interpolation error, while sparse high-fidelity samples are used to…

Machine Learning · Statistics 2024-02-27 Viv Bone , Chris van der Heide , Kieran Mackle , Ingo H. J. Jahn , Peter M. Dower , Chris Manzie

We here consider the subset simulation method which approaches a failure event using a decreasing sequence of nested intermediate failure events. The method resembles importance sampling, which actively explores a probability space by…

Computation · Statistics 2020-03-16 Kenan Šehić , Mirza Karamehmedović

We present a framework for transfer learning based on modular variational Gaussian processes (GP). We develop a module-based method that having a dictionary of well fitted GPs, one could build ensemble GP models without revisiting any data.…

Machine Learning · Statistics 2021-10-27 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

Gaussian process (GP) regression is a powerful probabilistic modeling technique with built-in uncertainty quantification. When one has access to multiple correlated simulations (tasks), it is common to fit a multitask GP (MTGP) surrogate…

Computation · Statistics 2026-03-18 Aleksei G. Sorokin , Pieterjan Robbe , Fred J. Hickernell

Gaussian process ($GP$) regression is a widely used non-parametric modeling tool, but its cubic complexity in the training size limits its use on massive data sets. A practical remedy is to predict using only the nearest neighbours of each…

Machine Learning · Statistics 2026-04-09 Robert Allison , Tomasz Maciazek , Anthony Stephenson

Modern scientific problems are often multi-disciplinary and require integration of computer models from different disciplines, each with distinct functional complexities, programming environments, and computation times. Linked Gaussian…

Machine Learning · Statistics 2023-06-05 Deyu Ming , Daniel Williamson

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

A recent novel extension of multi-output Gaussian processes handles heterogeneous outputs assuming that each output has its own likelihood function. It uses a vector-valued Gaussian process prior to jointly model all likelihoods' parameters…

Machine Learning · Statistics 2020-07-15 Juan-José Giraldo , Mauricio A. Álvarez

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Inter-domain Gaussian processes (GPs) allow for high flexibility and low computational cost when performing approximate inference in GP models. They are particularly suitable for modeling data exhibiting global structure but are limited to…

Machine Learning · Statistics 2020-11-03 Tim G. J. Rudner , Dino Sejdinovic , Yarin Gal

Model Predictive Control evolved as the state of the art paradigm for safety critical control tasks. Control-as-Inference approaches thereof model the constrained optimization problem as a probabilistic inference problem. The constraints…

Optimization and Control · Mathematics 2025-11-21 Jörn Tebbe , Andreas Besginow , Markus Lange-Hegermann

Deep Gaussian Processes (DGPs) compose GP layers to warp inputs, enabling improved emulation of computer models with nonstationary input-output behavior compared with ordinary GPs. In contrast to GPs, the predictive uncertainty for DGP…

Computation · Statistics 2026-05-12 Yiming Yang , Deyu Ming , Serge Guillas

Decentralized Gaussian process (GP) methods offer a scalable framework for multi-agent scalar-field estimation by replacing a centralized global model with multiple local models maintained by individual agents. A team of agents operates…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Hossein Papi , Muzaffar Qureshi , Kyle Volle , Rushikesh Kamalapurkar

Optimizing industrial processes often involves gray-box models that couple algebraic glass-box equations with black-box components lacking analytic derivatives. Such systems challenge derivative-based solvers. The classical trust-region…

Optimization and Control · Mathematics 2026-04-15 Gul Hameed , Tao Chen , Antonio del Rio Chanona , Lorenz T. Biegler , Michael Short

We introduce constrained Gaussian process (CGP), a Gaussian process model for random functions that allows easy placement of mathematical constrains (e.g., non-negativity, monotonicity, etc) on its sample functions. CGP comes with…

Statistics Theory · Mathematics 2019-04-23 Jeremiah Zhe Liu

Gaussian processes (GPs) offer a principled probabilistic model over functions, but exact inference is restricted to the linear-Gaussian regime. We establish an explicit equivalence between GPs and a class of linear diffusion models,…

With advances in scientific computing and mathematical modeling, complex scientific phenomena such as galaxy formations and rocket propulsion can now be reliably simulated. Such simulations can however be very time-intensive, requiring…

Methodology · Statistics 2024-02-29 Yi Ji , Simon Mak , Derek Soeder , J-F Paquet , Steffen A. Bass

Excessive loads near wounds produce pathological scarring and other complications. Presently, stress cannot easily be measured by surgeons in the operating room. Instead, surgeons rely on intuition and experience. Predictive computational…

Medical Physics · Physics 2020-10-07 Casey Stowers , Taeksang Lee , Ilias Bilionis , Arun Gosain , Adrian Buganza Tepole