English
Related papers

Related papers: Combining Lipschitz and RBF Surrogate Models for H…

200 papers

Global optimization of expensive functions has important applications in physical and computer experiments. It is a challenging problem to develop efficient optimization scheme, because each function evaluation can be costly and the…

Machine Learning · Statistics 2020-01-22 Ray-Bing Chen , Yuan Wang , C. F. Jeff Wu

Most real-world optimization problems are difficult to solve with traditional statistical techniques or with metaheuristics. The main difficulty is related to the existence of a considerable number of local optima, which may result in the…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Gloria Pietropolli , Giuliamaria Menara , Mauro Castelli

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a…

Optimization and Control · Mathematics 2025-12-08 Ruanui Nicholson , Radoslav Vuchkov , Umberto Villa , Noemi Petra

In this paper, we introduce a new heuristics for global optimization in scenarios where extensive evaluations of the cost function are expensive, inaccessible, or even prohibitive. The method, which we call Landscape-Sketch-and-Step (LSS),…

Machine Learning · Computer Science 2023-10-06 Rafael Monteiro , Kartik Sau

Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a…

Machine Learning · Statistics 2019-01-17 Dan Lu , Daniel Ricciuto

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

Surrogate-assisted search-based testing (SA-SBT) aims to reduce the computational time for testing compute-intensive systems. Surrogates enhance testing techniques by improving test case generation focusing the testing budget on the most…

Software Engineering · Computer Science 2023-05-02 Shiva Nejati , Lev Sorokin , Damir Safin , Federico Formica , Mohammad Mahdi Mahboob , Claudio Menghi

Data-driven evolutionary optimization has witnessed great success in solving complex real-world optimization problems. However, existing data-driven optimization algorithms require that all data are centrally stored, which is not always…

Neural and Evolutionary Computing · Computer Science 2021-02-17 Jinjin Xu , Yaochu Jin , Wenli Du , Sai Gu

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is…

Neural and Evolutionary Computing · Computer Science 2019-06-12 Niru Maheswaranathan , Luke Metz , George Tucker , Dami Choi , Jascha Sohl-Dickstein

In many mechanistic medical, biological, physical and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Biological models require the…

Soft Condensed Matter · Physics 2021-02-11 J. Quetzalcóatl Toledo-Marín , Geoffrey Fox , James P. Sluka , James A. Glazier

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

Numerical solutions of partial differential equations (PDEs) require expensive simulations, limiting their application in design optimization, model-based control, and large-scale inverse problems. Surrogate modeling techniques seek to…

Computational Physics · Physics 2022-05-18 James Duvall , Karthik Duraisamy , Shaowu Pan

This paper presents several types of evolutionary algorithms (EAs) used for global optimization on real domains. The interest has been focused on multimodal problems, where the difficulties of a premature convergence usually occurs. First…

Neural and Evolutionary Computing · Computer Science 2009-02-11 O. Hrstka , A. Kucerova

This paper presents comparison of several stochastic optimization algorithms developed by authors in their previous works for the solution of some problems arising in Civil Engineering. The introduced optimization methods are: the integer…

Neural and Evolutionary Computing · Computer Science 2009-02-11 O. Hrstka , A. Kucerova , M. Leps , J. Zeman

During the design process of an autonomous underwater vehicle (AUV), the pressure vessel has a critical role. The pressure vessel contains dry electronics, power sources, and other sensors that can not be flooded. A traditional design…

Machine Learning · Computer Science 2022-07-12 Harsh Vardhan , Janos Sztipanovits

Bayesian optimization is a highly efficient approach to optimizing objective functions which are expensive to query. These objectives are typically represented by Gaussian process (GP) surrogate models which are easy to optimize and support…

Machine Learning · Computer Science 2024-05-09 Yucen Lily Li , Tim G. J. Rudner , Andrew Gordon Wilson

Surrogate models are often used as computationally efficient approximations to complex simulation models, enabling tasks such as solving inverse problems, sensitivity analysis, and probabilistic forward predictions, which would otherwise be…

Machine Learning · Statistics 2026-05-13 Philipp Reiser , Paul-Christian Bürkner , Anneli Guthke

Many global optimization algorithms of the memetic variety rely on some form of stochastic search, and yet they often lack a sound probabilistic basis. Without a recourse to the powerful tools of stochastic calculus, treading the fine…

Optimization and Control · Mathematics 2024-12-17 Rajdeep Dutta , T Venkatesh Varma , Saikat Sarkar , Mariya Mamajiwala , Noor Awad , Senthilnath Jayavelu , Debasish Roy

Multi-Objective Evolutionary Algorithms (MOEAs) have proven effective at solving Multi-Objective Optimisation Problems (MOOPs). However, their performance can be significantly hindered when applied to computationally intensive industrial…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Tiwonge Msulira Banda , Alexandru-Ciprian Zăvoianu

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

Optimization and Control · Mathematics 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss