English
Related papers

Related papers: Improved prediction rule ensembling through model-…

200 papers

Neural network surrogate models have emerged as a promising approach to model solution fields for a wide variety of boundary value problems encountered in physical modeling. Stochastic problems represent an area of particularly high…

Machine Learning · Statistics 2026-05-18 Noah Wade , Kirubel Teferra

Adaptive designs are increasingly used in clinical trials and online experiments to improve participant outcomes by dynamically updating treatment allocation as data accumulate. In practice, experimenters often consider multiple candidate…

Methodology · Statistics 2026-04-08 Wenxin Zhang , Aaron Hudson , Maya Petersen , Mark van der Laan

Surrogate-based optimization relies on so-called infill criteria (acquisition functions) to decide which point to evaluate next. When Kriging is used as the surrogate model of choice (also called Bayesian optimization), one of the most…

Neural and Evolutionary Computing · Computer Science 2020-02-18 Frederik Rehbach , Martin Zaefferer , Boris Naujoks , Thomas Bartz-Beielstein

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

Most real-world optimization problems are difficult to solve with traditional statistical techniques or with metaheuristics. The main difficulty is related to the existence of a considerable number of local optima, which may result in the…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Gloria Pietropolli , Giuliamaria Menara , Mauro Castelli

We propose a novel learning-based surrogate data assimilation (DA) model for efficient state estimation in a limited area. Our model employs a feedforward neural network for online computation, eliminating the need for integrating…

Numerical Analysis · Mathematics 2023-07-17 Wei Kang , Liang Xu , Hong Zhou

Surrogate models are effective tools for accelerated design of complex systems. The result of a design optimization procedure using surrogate models can be used to initialize an optimization routine using the full order system. High…

Computational Engineering, Finance, and Science · Computer Science 2025-01-15 Anas Abdelrehim , Dhairya Gandhi , Sharan Yalburgi , Ashutosh Bharambe , Ranjan Anantharaman , Chris Rackauckas

The ongoing development of quantum processors is driving breakthroughs in scientific discovery. Despite this progress, the formidable cost of fabricating large-scale quantum processors means they will remain rare for the foreseeable future,…

Quantum Physics · Physics 2025-07-24 Wei-You Liao , Yuxuan Du , Xinbiao Wang , Tian-Ci Tian , Yong Luo , Bo Du , Dacheng Tao , He-Liang Huang

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually…

Applications · Statistics 2024-10-15 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Performing reliability analysis on complex systems is often computationally expensive. In particular, when dealing with systems having high input dimensionality, reliability estimation becomes a daunting task. A popular approach to overcome…

Machine Learning · Statistics 2021-12-22 Navaneeth N. , Souvik Chakraborty

The method of surrogate data is a tool to test whether data were generated by some class of model. Tests based on the periodogram have been proposed to decide if linear systems driven by Gaussian noise could have generated a sample time…

comp-gas · Physics 2008-02-03 J. Timmer

Model merging techniques aim to integrate the abilities of multiple models into a single model. Most model merging techniques have hyperparameters, and their setting affects the performance of the merged model. Because several existing…

Machine Learning · Computer Science 2025-09-03 Rio Akizuki , Yuya Kudo , Nozomu Yoshinari , Yoichi Hirose , Toshiyuki Nishimoto , Kento Uchida , Shinichi Shirakawa

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Machine Learning · Statistics 2020-09-10 Erik Bodin , Markus Kaiser , Ieva Kazlauskaite , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

Simulation-based plasma scenario development, optimization and control are crucial elements towards the successful deployment of next-generation experimental tokamaks and Fusion power plants. Current simulation codes require extremely…

Plasma Physics · Physics 2024-02-14 N. Carey , L. Zanisi , S. Pamela , V. Gopakumar , J. Omotani , J. Buchanan , J. Brandstetter

This work is in the context of blackbox optimization where the functions defining the problem are expensive to evaluate and where no derivatives are available. A tried and tested technique is to build surrogates of the objective and the…

Optimization and Control · Mathematics 2022-08-18 Charles Audet , Sébastien Le Digabel , Renaud Saltet

Surrogate models for partial-differential equations are widely used in the design of meta-materials to rapidly evaluate the behavior of composable components. However, the training cost of accurate surrogates by machine learning can rapidly…

Machine Learning · Computer Science 2020-11-04 Raphaël Pestourie , Youssef Mroueh , Thanh V. Nguyen , Payel Das , Steven G. Johnson

We are interested in building low-dimensional surrogate models to reduce optimization costs, while having theoretical guarantees that the optimum will satisfy the constraints of the full-size model, by making conservative approximations.…

Numerical Analysis · Mathematics 2025-11-12 Philippe-André Luneau

Vertical equilibrium (VE) models have been introduced as computationally efficient alternatives to traditional mass and momentum balance equations for fluid flow in porous media. Since VE models are only accurate in regions where phase…

Fluid Dynamics · Physics 2026-04-21 Ivan Buntic , Bernd Flemisch

Predictor screening rules, which discard predictors before fitting a model, have had considerable impact on the speed with which sparse regression problems, such as the lasso, can be solved. In this paper we present a new screening rule for…

Machine Learning · Statistics 2024-05-14 Johan Larsson , Jonas Wallin

Gaussian process regression is widely applied in computational science and engineering for surrogate modeling owning to its kernel-based and probabilistic nature. In this work, we propose a Bayesian approach that integrates the variability…

Machine Learning · Computer Science 2025-01-03 Dongwei Ye , Weihao Yan , Christoph Brune , Mengwu Guo