English
Related papers

Related papers: Which Surrogate Works for Empirical Performance Mo…

200 papers

Meta-materials are an important emerging class of engineered materials in which complex macroscopic behaviour--whether electromagnetic, thermal, or mechanical--arises from modular substructure. Simulation and optimization of these materials…

Machine Learning · Computer Science 2020-05-18 Alex Beatson , Jordan T. Ash , Geoffrey Roeder , Tianju Xue , Ryan P. Adams

Can we evolve better training data for machine learning algorithms? To investigate this question we use population-based optimisation algorithms to generate artificial surrogate training data for naive Bayes for regression. We demonstrate…

Artificial Intelligence · Computer Science 2018-11-29 Michael Mayo , Eibe Frank

Designing a high-quality plasma injector electron source driven by a laser beam relies on numerical parametric studies using particle-in-cell codes. The common input parameters to explore are laser characteristics, plasma species and…

We present a novel way of accelerating hybrid surrogate methods for the calculation of failure probabilities. The main idea is to use mesh refinement in order to obtain improved local surrogates of low computation cost to simulate on. These…

Numerical Analysis · Mathematics 2015-09-23 Jing Li , Panos Stinis

Most real-world optimization problems are difficult to solve with traditional statistical techniques or with metaheuristics. The main difficulty is related to the existence of a considerable number of local optima, which may result in the…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Gloria Pietropolli , Giuliamaria Menara , Mauro Castelli

In a task where many similar inverse problems must be solved, evaluating costly simulations is impractical. Therefore, replacing the model $y$ with a surrogate model $y_s$ that can be evaluated quickly leads to a significant speedup. The…

Numerical Analysis · Mathematics 2024-05-15 Phillip Semler , Martin Weiser

Microstructure evolution, which plays a critical role in determining materials properties, is commonly simulated by the high-fidelity but computationally expensive phase-field method. To address this, we approximate microstructure evolution…

Materials Science · Physics 2024-11-22 Saurabh Tiwari , Prathamesh Satpute , Supriyo Ghosh

This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yash Patel , Tomas Hodan , Jiri Matas

Surrogate endpoints are used in place of long-term outcomes in randomized experiments when observing the real outcome for a large enough cohort is prohibitively expensive or impractical. A short-term surrogate is good if the result of an…

Inference on unknown quantities in dynamical systems via observational data is essential for providing meaningful insight, furnishing accurate predictions, enabling robust control, and establishing appropriate designs for future…

Methodology · Statistics 2018-02-06 M. Chung , M. Binois , R. B. Gramacy , D. J. Moquin , A. P. Smith , A. M. Smith

A novel refinement measure for non-intrusive surrogate modelling of partial differential equations (PDEs) with uncertain parameters is proposed. Our approach uses an empirical interpolation procedure, where the proposed refinement measure…

Numerical Analysis · Mathematics 2019-07-10 Yous van Halder , Benjamin Sanderse , Barry Koren

Tuning parameters is an important step for the application of metaheuristics to problem classes of interest. In this work we present a tuning framework based on the sequential optimization of perturbed regression models. Besides providing…

Neural and Evolutionary Computing · Computer Science 2019-12-02 Áthila R. Trindade , Felipe Campelo

Gradient-based optimization of engineering designs is limited by non-differentiable components in the typical computer-aided engineering (CAE) workflow, which calculates performance metrics from design parameters. While gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-11-17 Andrin Rehmann , Nolan Black , Josiah Bjorgaard , Alessandro Angioi , Andrei Paleyes , Niklas Heim , Dion Häfner , Alexander Lavin

Carefully designed activation functions can improve the performance of neural networks in many machine learning tasks. However, it is difficult for humans to construct optimal activation functions, and current activation function search…

Machine Learning · Computer Science 2023-11-10 Garrett Bingham , Risto Miikkulainen

Heuristic optimisation algorithms are in high demand due to the overwhelming amount of complex optimisation problems that need to be solved. The complexity of these problems is well beyond the boundaries of applicability of exact…

Neural and Evolutionary Computing · Computer Science 2021-05-12 Bas van Stein , Fabio Caraffini , Anna V. Kononova

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

Machine Learning · Computer Science 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota

The method of surrogates is one of the key concepts of nonlinear data analysis. Here, we demonstrate that commonly used algorithms for generating surrogates often fail to generate truly linear time series. Rather, they create surrogate…

Data Analysis, Statistics and Probability · Physics 2015-06-03 C. Raeth , M. Gliozzi , I. E. Papadakis , W. Brinkmann

Simulation-based problems involving mixed-variable inputs frequently feature domains that are hierarchical, conditional, heterogeneous, or tree-structured. These characteristics pose challenges for data representation, modeling, and…

Machine Learning · Computer Science 2026-01-21 Paul Saves , Edward Hallé-Hannan , Jasper Bussemaker , Youssef Diouane , Nathalie Bartoli

Trial level surrogates are useful tools for improving the speed and cost effectiveness of trials, but surrogates that have not been properly evaluated can cause misleading results. The evaluation procedure is often contextual and depends on…

Methodology · Statistics 2022-08-23 Michael C Sachs , Erin E Gabriel , Alessio Crippa , Michael J Daniels

Highly accurate datasets from numerical or physical experiments are often expensive and time-consuming to acquire, posing a significant challenge for applications that require precise evaluations, potentially across multiple scenarios and…

Machine Learning · Computer Science 2026-02-06 Paolo Conti , Mengwu Guo , Attilio Frangi , Andrea Manzoni