English
Related papers

Related papers: Gradient and Uncertainty Enhanced Sequential Sampl…

200 papers

Machine learning classification techniques have been used widely to recognize the feasible design domain and discover hidden patterns in engineering design. An accurate classification model needs a large dataset; however, generating a large…

Data Analysis, Statistics and Probability · Physics 2021-07-13 Xianping Du , Kai Zhang , Onur Bilgen , Laurent Burlion , Hongyi Xu

This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the…

Optimization and Control · Mathematics 2022-08-18 Charles Audet , Sébastien Le Digabel , Renaud Saltet

Surrogate models - also called emulators - are widely used to facilitate Bayesian inference in settings where computational costs preclude the use of standard posterior inference algorithms. Their deployment is now standard practice across…

Methodology · Statistics 2026-03-17 Andrew Gerard Roberts , Michael C. Dietze , Jonathan H. Huggins

Recent advances in data collection technologies have led to the emergence of massive spatial datasets, with measurements obtained at millions of spatial locations. Geostatistical models typically employ Gaussian processes (GPs) to capture…

Methodology · Statistics 2026-05-18 Nicholas Rios , Ben Seiyon Lee

Recent developments in surrogate construction predominantly focused on two strategies to improve surrogate accuracy. Firstly, component-wise domain scaling informed by cross-validation. Secondly, regression to construct response surfaces…

Optimization and Control · Mathematics 2023-04-03 Johann Bouwer , Daniel N. Wilke , Schalk Kok

There is a high interest in accelerating multiscale models using data-driven surrogate modeling techniques. Creating a large training dataset encompassing all relevant load scenarios is essential for a good surrogate, yet the computational…

Numerical Analysis · Mathematics 2025-04-24 J. Storm , W. Sun , I. B. C. M. Rocha , F. P. van der Meer

We propose a nonparametric procedure to achieve fast inference in generative graphical models when the number of latent states is very large. The approach is based on iterative latent variable preselection, where we alternate between…

Machine Learning · Statistics 2021-10-06 Jacquelyn A. Shelton , Jan Gasthaus , Zhenwen Dai , Joerg Luecke , Arthur Gretton

Modeling correlated or highly stratified multiple-response data becomes a common data analysis task due to modern data monitoring facilities and methods. Generalized estimating equations (GEE) is one of the popular statistical methods for…

Methodology · Statistics 2019-03-05 Zimu Chen , Zhanfeng Wang , Yuan-chin Ivan Chang

Concurrent multiscale finite element analysis (FE2) is a powerful approach for high-fidelity modeling of materials for which a suitable macroscopic constitutive model is not available. However, the extreme computational effort associated…

Numerical Analysis · Mathematics 2020-07-16 I. B. C. M. Rocha , P. Kerfriden , F. P. van der Meer

This work presents a technique for statistically modeling errors introduced by reduced-order models. The method employs Gaussian-process regression to construct a mapping from a small number of computationally inexpensive `error indicators'…

Numerical Analysis · Computer Science 2015-04-16 Martin Drohmann , Kevin Carlberg

In Smyl et al. [Local and global trend Bayesian exponential smoothing models. International Journal of Forecasting, 2024.], a generalised exponential smoothing model was proposed that is able to capture strong trends and volatility in time…

Machine Learning · Computer Science 2024-07-02 Xueying Long , Daniel F. Schmidt , Christoph Bergmeir , Slawek Smyl

Bayesian graphical models have been shown to be a powerful tool for discovering uncertainty and causal structure from real-world data in many application fields. Current inference methods primarily follow different kinds of trade-offs…

Machine Learning · Computer Science 2018-02-20 Daniel Rugeles , Zhen Hai , Gao Cong , Manoranjan Dash

We introduce data structures for solving robust regression through stochastic gradient descent (SGD) by sampling gradients with probability proportional to their norm, i.e., importance sampling. Although SGD is widely used for large scale…

Machine Learning · Computer Science 2022-07-19 Sepideh Mahabadi , David P. Woodruff , Samson Zhou

The high computational cost of phase field simulations remains a major limitation for predicting dendritic solidification in metals, particularly in additive manufacturing, where microstructural control is critical. This work presents a…

Weak gravitational lensing maps compactly encode the evolution of cosmic large-scale structure and are a key tool for cosmological analyses. Performing inference directly at the map level allows flexible choices of statistics and can…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-25 Guangjian Li , Tomasz Kacprzak

We demonstrate the adaption of three established methods to the field of surrogate machine learning model development. These methods are data augmentation, custom loss functions and transfer learning. Each of these methods have seen…

Machine Learning · Computer Science 2022-11-04 H. Rhys Jones , Tingting Mu , Andrei C. Popescu , Yusuf Sulehman

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning…

Machine Learning · Computer Science 2021-02-17 Qi Wang , Herke van Hoof

Multi-fidelity optimization employs surrogate models that integrate information from varying levels of fidelity to guide efficient exploration of complex design spaces while minimizing the reliance on (expensive) high-fidelity objective…

We present a direct inverse modeling method named SURGIN, a SURrogate-guided Generative INversion framework tailed for subsurface multiphase flow data assimilation. Unlike existing inversion methods that require adaptation for each new…

Machine Learning · Statistics 2025-09-17 Zhao Feng , Bicheng Yan , Luanxiao Zhao , Xianda Shen , Renyu Zhao , Wenhao Wang , Fengshou Zhang

This work studies how an AI-controlled dog-fighting agent with tunable decision-making parameters can learn to optimize performance against an intelligent adversary, as measured by a stochastic objective function evaluated on simulated…

Machine Learning · Computer Science 2017-08-01 Brett W. Israelsen , Nisar Ahmed , Kenneth Center , Roderick Green , Winston Bennett