English
Related papers

Related papers: Enhancing Performance and Calibration in Quantile …

200 papers

Hyperparameter optimization is the process of identifying the appropriate hyperparameter configuration of a given machine learning model with regard to a given learning task. For smaller data sets, an exhaustive search is possible; However,…

Machine Learning · Computer Science 2022-09-30 Blaž Škrlj , Adi Schwartz , Jure Ferlež , Davorin Kopič , Naama Ziporin

The key idea of Bayesian optimization is replacing an expensive target function with a cheap surrogate model. By selection of an acquisition function for Bayesian optimization, we trade off between exploration and exploitation. The…

Machine Learning · Statistics 2019-02-20 Leonid Matyushin , Alexey Zaytsev , Oleg Alenkin , Andrey Ustuzhanin

For developing innovative systems architectures, modeling and optimization techniques have been central to frame the architecting process and define the optimization and modeling problems. In this context, for system-of-systems the use of…

Artificial Intelligence · Computer Science 2026-05-07 Paul Saves , Jasper Bussemaker , Rémi Lafage , Thierry Lefebvre , Nathalie Bartoli , Youssef Diouane , Joseph Morlier

Tuning control policies manually to meet high-level objectives is often time-consuming. Bayesian optimization provides a data-efficient framework for automating this process using numerical evaluations of an objective function. However,…

Machine Learning · Computer Science 2026-03-26 Lukas Theiner , Maik Pfefferkorn , Yongpeng Zhao , Sebastian Hirt , Rolf Findeisen

Excessive loads near wounds produce pathological scarring and other complications. Presently, stress cannot easily be measured by surgeons in the operating room. Instead, surgeons rely on intuition and experience. Predictive computational…

Medical Physics · Physics 2020-10-07 Casey Stowers , Taeksang Lee , Ilias Bilionis , Arun Gosain , Adrian Buganza Tepole

Automatically searching for optimal hyperparameter configurations is of crucial importance for applying deep learning algorithms in practice. Recently, Bayesian optimization has been proposed for optimizing hyperparameters of various…

Artificial Intelligence · Computer Science 2017-01-24 Ilija Ilievski , Taimoor Akhtar , Jiashi Feng , Christine Annette Shoemaker

Gaussian process (GP) regression is a non-parametric, Bayesian framework to approximate complex models. Standard GP regression can lead to an unbounded model in which some points can take infeasible values. We introduce a new GP method that…

Machine Learning · Statistics 2024-04-04 Didem Kochan , Xiu Yang

Gaussian processes (GPs) are non-linear probabilistic models popular in many applications. However, na\"ive GP realizations require quadratic memory to store the covariance matrix and cubic computation to perform inference or evaluate the…

Computation · Statistics 2021-05-03 Amanda Muyskens , Benjamin Priest , Imène Goumiri , Michael Schneider

We describe a local surrogate model for use in conjunction with global structure search methods. The model follows the Gaussian approximation potential (GAP) formalism and is based on a the smooth overlap of atomic positions descriptor with…

Parametric partial differential equations (PDEs) serve as fundamental mathematical tools for modeling complex physical phenomena, yet repeated high-fidelity numerical simulations across parameter spaces remain computationally prohibitive.…

Machine Learning · Statistics 2026-04-08 Pucheng Tang , Hongqiao Wang , Wenzhou Lin , Qian Chen , Heng Yong

Gaussian processes (GPs) are non-parametric probabilistic regression models that are popular due to their flexibility, data efficiency, and well-calibrated uncertainty estimates. However, standard GP models assume homoskedastic Gaussian…

Machine Learning · Computer Science 2025-01-08 Sebastian Ament , Elizabeth Santorella , David Eriksson , Ben Letham , Maximilian Balandat , Eytan Bakshy

Bayesian optimization (BO) has demonstrated potential for optimizing control performance in data-limited settings, especially for systems with unknown dynamics or unmodeled performance objectives. The BO algorithm efficiently trades-off…

Machine Learning · Computer Science 2022-11-02 Ankush Chakrabarty

Gaussian processes provide probabilistic surrogates for various applications including classification, uncertainty quantification, and optimization. Using a gradient-enhanced covariance matrix can be beneficial since it provides a more…

Optimization and Control · Mathematics 2023-07-13 André L. Marchildon , David W. Zingg

The optimization of atomic structures plays a pivotal role in understanding and designing materials with desired properties. However, conventional computational methods often struggle with the formidable task of navigating the vast…

Materials Science · Physics 2024-11-19 Peder Lyngby , Casper Larsen , Karsten Wedel Jacobsen

The computational burden of running a complex computer model can make optimization impractical. Gaussian Processes (GPs) are statistical surrogates (also known as emulators) that alleviate this issue since they cheaply replace the computer…

Computation · Statistics 2019-09-11 Theodoros Mathikolonis , Serge Guillas

The estimation of unknown values of parameters (or hidden variables, control variables) that characterise a physical system often relies on the comparison of measured data with synthetic data produced by some numerical simulator of the…

Machine Learning · Computer Science 2019-01-28 Xi Chen , Mike Hobson

Convolved Gaussian Process (CGP) is able to capture the correlations not only between inputs and outputs but also among the outputs. This allows a superior performance of using CGP than standard Gaussian Process (GP) in the modelling of…

Neural and Evolutionary Computing · Computer Science 2017-09-14 Gang Cao , Edmund M-K Lai , Fakhrul Alam

Many functions have approximately-known upper and/or lower bounds, potentially aiding the modeling of such functions. In this paper, we introduce Gaussian process models for functions where such bounds are (approximately) known. More…

Machine Learning · Computer Science 2022-10-20 Vu Nguyen , Marc Peter Deisenroth , Michael A. Osborne

Gaussian process (GP) surrogate modeling for large computer experiments is limited by cubic runtimes, especially with data from stochastic simulations with input-dependent noise. A popular workaround to reduce computational complexity…

Methodology · Statistics 2022-06-01 D Austin Cole , Robert B Gramacy , Mike Ludkovski

Gaussian process (GP) methods have been widely studied recently, especially for large-scale systems with big data and even more extreme cases when data is sparse. Key advantages of these methods consist in: 1) the ability to provide…

Methodology · Statistics 2024-09-13 Chenyi Lyu , Xingchi Liu , Lyudmila Mihaylova