English
Related papers

Related papers: Quantifying uncertainty with ensembles of surrogat…

200 papers

Deep learning-based surrogate models have demonstrated remarkable advantages over classical solvers in terms of speed, often achieving speedups of 10 to 1000 times over traditional partial differential equation (PDE) solvers. However, a…

Machine Learning · Computer Science 2024-02-14 Tailin Wu , Willie Neiswanger , Hongtao Zheng , Stefano Ermon , Jure Leskovec

Gradient-free optimization methods, such as surrogate based optimization (SBO) methods, and genetic (GAs), or evolutionary (EAs) algorithms have gained popularity in the field of constrained optimization of expensive black-box functions.…

Optimization and Control · Mathematics 2021-07-22 Ahmed Abouhussein , Nusrat Islam , Yulia T. Peet

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov…

Data Analysis, Statistics and Probability · Physics 2013-12-25 AbdoulAhad Validi

Many real-world decision-making processes rely on solving mixed-integer nonlinear programming (MINLP) problems. However, finding high-quality solutions to MINLPs is often computationally demanding. This has motivated the development of…

Optimization and Control · Mathematics 2025-10-17 Marina Cuesta , Claudia D'Ambrosio , María Durban , Vanesa Guerrero , Renan Spencer Trindade

We present a new machine learning approach to estimate personalized treatment effects in the classical potential outcomes framework with binary outcomes. To overcome the problem that both treatment and control outcomes for the same unit are…

Machine Learning · Statistics 2018-05-07 Siong Thye Goh , Cynthia Rudin

Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same…

Optimization and Control · Mathematics 2020-06-16 Johannes Wiebe , Inês Cecílio , Jonathan Dunlop , Ruth Misener

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

Methodology · Statistics 2025-09-15 Jocelyn Minini , Micha Wasem

Optimisation problems often have multiple conflicting objectives that can be computationally and/or financially expensive. Mono-surrogate Bayesian optimisation (BO) is a popular model-based approach for optimising such black-box functions.…

Machine Learning · Computer Science 2022-08-11 George De Ath , Tinkle Chugh , Alma A. M. Rahat

This work introduces the StoMADS-PB algorithm for constrained stochastic blackbox optimization, which is an extension of the mesh adaptive direct-search (MADS) method originally developed for deterministic blackbox optimization under…

Optimization and Control · Mathematics 2022-07-29 Kwassi Joseph Dzahini , Michael Kokkolaras , Sébastien Le Digabel

Significant effort has been made to solve computationally expensive optimization problems in the past two decades, and various optimization methods incorporating surrogates into optimization have been proposed. Most research focuses on…

Optimization and Control · Mathematics 2022-04-11 Julian Blank , Kalyanmoy Deb

Optimization of real-world black-box functions defined over purely categorical variables is an active area of research. In particular, optimization and design of biological sequences with specific functional or structural properties have a…

Machine Learning · Computer Science 2022-02-25 Hamid Dadkhahi , Jesus Rios , Karthikeyan Shanmugam , Payel Das

The computational burden of running a complex computer model can make optimization impractical. Gaussian Processes (GPs) are statistical surrogates (also known as emulators) that alleviate this issue since they cheaply replace the computer…

Computation · Statistics 2019-09-11 Theodoros Mathikolonis , Serge Guillas

Evolutionary optimization algorithms often face defects and limitations that complicate the evolution processes or even prevent them from reaching the global optimum. A notable constraint pertains to the considerable quantity of function…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Farshid Farhadi Khouzani , Abdolreza Mirzaei , Paul La Plante , Laxmi Gewali

Bayesian optimization (BO) has been widely used in machine learning and simulation optimization. With the increase in computational resources and storage capacities in these fields, high-dimensional and large-scale problems are becoming…

Machine Learning · Computer Science 2022-06-02 Haowei Wang , Ercong Zhang , Szu Hui Ng , Giulia Pedrielli

This paper presents a novel learning-based approach to construct a surrogate problem that approximates a given parametric nonconvex optimization problem. The surrogate function is designed to be the minimum of a finite set of functions,…

Optimization and Control · Mathematics 2026-04-08 Renzi Wang , Panagiotis Patrinos , Alberto Bemporad

Prediction+optimization is a common real-world paradigm where we have to predict problem parameters before solving the optimization problem. However, the criteria by which the prediction model is trained are often inconsistent with the goal…

Machine Learning · Computer Science 2021-11-23 Kai Yan , Jie Yan , Chuan Luo , Liting Chen , Qingwei Lin , Dongmei Zhang

Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Yuxin Wu , Hongshu Guo , Ting Huang , Yue-Jiao Gong , Zeyuan Ma

In engineering design and scientific computing, computational cost and predictive accuracy are intrinsically coupled. High-fidelity simulations provide accurate predictions but at substantial computational costs, while lower-fidelity…

Machine Learning · Computer Science 2026-05-11 Ahmed Mohamed Eisa Nasr , Ali Elham , Haris Moazam Sheikh

The effect of uncertainties and noise on a quantity of interest (model output) is often better described by its probability density function (PDF) than by its moments. Although density estimation is a common task, the adequacy of…

Numerical Analysis · Mathematics 2019-06-21 Adi Ditkowski , Gadi Fibich , Amir Sagiv

Ultra-fast, precise, and controlled amplitude surrogates are essential for future LHC event generation. First, we investigate the noise reduction and biases of network ensembles and outline a new method to learn well-calibrated systematic…

High Energy Physics - Phenomenology · Physics 2026-04-09 Henning Bahl , Nina Elmer , Tilman Plehn , Ramon Winterhalder