English
Related papers

Related papers: Gradient-enhanced kriging for high-dimensional pro…

200 papers

Evolutionary Strategies (ES) are known to be an effective black-box optimization technique for deep neural networks when the true gradients cannot be computed, such as in Reinforcement Learning. We continue a recent line of research that…

Neural and Evolutionary Computing · Computer Science 2019-10-14 Florian Meier , Asier Mujika , Marcelo Matheus Gauy , Angelika Steger

A problem of considerable importance within the field of uncertainty quantification (UQ) is the development of efficient methods for the construction of accurate surrogate models. Such efforts are particularly important to applications…

Computational Physics · Physics 2019-03-01 Rohit Tripathy , Ilias Bilionis

Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Michael Fischer , Tobias Ritschel

Global aerodynamic design optimization using Euler or Navier-Stokes equations requires very reliable surrogate modeling techniques since the computational effort for the underlying flow simulations is usually high. In general, for such…

Optimization and Control · Mathematics 2018-11-02 Emre Özkaya , Nicolas R. Gauger

Heuristic optimisation algorithms explore the search space by sampling solutions, evaluating their fitness, and biasing the search in the direction of promising solutions. However, in many cases, this fitness function involves executing…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Pablo S. Naharro , Pablo Toharia , Antonio LaTorre , José-María Peña

In reliability engineering, conventional surrogate models encounter the "curse of dimensionality" as the number of random variables increases. While the active learning Kriging surrogate approaches with high-dimensional model representation…

Machine Learning · Computer Science 2025-09-10 Wenxiong Li , Hanyu Liao , Suiyin Chen

Studying complex phenomena in detail by performing real experiments is often an unfeasible task. Virtual experiments using simulations are usually used to support the development process. However, numerical simulations are limited by their…

Optimization and Control · Mathematics 2022-11-17 Pietro Lualdi , Ralf Sturm , Tjark Siefkes

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

Gradient-based optimization of engineering designs is limited by non-differentiable components in the typical computer-aided engineering (CAE) workflow, which calculates performance metrics from design parameters. While gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-11-17 Andrin Rehmann , Nolan Black , Josiah Bjorgaard , Alessandro Angioi , Andrei Paleyes , Niklas Heim , Dion Häfner , Alexander Lavin

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a…

Machine Learning · Statistics 2019-01-17 Dan Lu , Daniel Ricciuto

Simulation models are widely used in practice to facilitate decision-making in a complex, dynamic and stochastic environment. But they are computationally expensive to execute and optimize, due to lack of analytical tractability. Simulation…

Optimization and Control · Mathematics 2021-06-14 L. Jeff Hong , Xiaowei Zhang

The data-centric construction of inexpensive surrogates for fine-grained, physical models has been at the forefront of computational physics due to its significant utility in many-query tasks such as uncertainty quantification. Recent…

Machine Learning · Statistics 2021-03-17 Maximilian Rixner , Phaedon-Stelios Koutsourelakis

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

Crash simulations play an essential role in improving vehicle safety, design optimization, and injury risk estimation. Unfortunately, numerical solutions of such problems using state-of-the-art high-fidelity models require significant…

Machine Learning · Computer Science 2024-02-16 Jonas Kneifl , Jörg Fehr , Steven L. Brunton , J. Nathan Kutz

Surrogate-assisted evolutionary algorithms (SAEAs) aim to use efficient computational models with the goal of approximating the fitness function in evolutionary computation systems. This area of research has been active for over two decades…

Neural and Evolutionary Computing · Computer Science 2023-08-08 Fergal Stapleton , Edgar Galván

We propose a novel method for gradient-based optimization of black-box simulators using differentiable local surrogate models. In fields such as physics and engineering, many processes are modeled with non-differentiable simulators with…

Machine Learning · Computer Science 2020-09-30 Sergey Shirobokov , Vladislav Belavin , Michael Kagan , Andrey Ustyuzhanin , Atılım Güneş Baydin

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

Optimization and Control · Mathematics 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

Surrogate models are often used as computationally efficient approximations to complex simulation models, enabling tasks such as solving inverse problems, sensitivity analysis, and probabilistic forward predictions, which would otherwise be…

Machine Learning · Statistics 2026-05-13 Philipp Reiser , Paul-Christian Bürkner , Anneli Guthke

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta